org.apache.drill.yarn.zk

Class ZKClusterCoordinatorDriver

java.lang.Object

org.apache.drill.yarn.zk.ZKClusterCoordinatorDriver

All Implemented Interfaces:

AMRegistrar

public class ZKClusterCoordinatorDriver
extends Object
implements AMRegistrar

Driver class for the ZooKeeper cluster coordinator. Provides defaults for most options, but allows customizing each. Provides a build() method to create and start the ZK service. Obtains the initial set of Drillbits (which should be empty for a YARN-defined cluster) which can be retrieved after building.

Maintains the ZK connection and monitors for disconnect. This class simply detects a disconnect timeout, it does not send a disconnect event itself to avoid creating a timer thread just for this purpose. Instead, the caller can poll hasFailed().

Defaults match those in Drill. (Actual Drill defaults are not yet used due to code incompatibility issues.)

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.drill.yarn.appMaster.AMRegistrar

AMRegistrar.AMRegistrationException

Constructor Summary

Constructors

Constructor and Description
ZKClusterCoordinatorDriver()

Method Summary

Modifier and Type	Method and Description
void	addDrillbitListener(DrillbitStatusListener listener)
static String	asString(CoordinationProtos.DrillbitEndpoint bit) Convenience method to convert a Drillbit to a string.
ZKClusterCoordinatorDriver	build() Builds and starts the ZooKeeper cluster coordinator, translating any errors that occur.
void	close()
void	deregister()
static String	formatKey(String host, int userPort, int controlPort, int dataPort)
List<CoordinationProtos.DrillbitEndpoint>	getInitialEndpoints() Returns the set of Drillbits registered at the time of the build() call.
long	getLostConnectionDurationMs()
boolean	hasFailed() Reports our best guess as to whether ZK has failed.
void	register(String amHost, int amPort, String appId)
void	removeDrillbitListener(DrillbitStatusListener listener)
ZKClusterCoordinatorDriver	setConnect(String connect) Specify connect string in the form: host:/zkRoot/clusterId
ZKClusterCoordinatorDriver	setConnect(String connect, String zkRoot, String clusterId)
ZKClusterCoordinatorDriver	setConnectTimeoutMs(int ms)
ZKClusterCoordinatorDriver	setFailureTimoutMs(int ms)
ZKClusterCoordinatorDriver	setMaxStartWaitMs(int ms)
ZKClusterCoordinatorDriver	setPorts(int userPort, int controlPort, int dataPort)
ZKClusterCoordinatorDriver	setRetryCount(int n)
ZKClusterCoordinatorDriver	setRetryDelayMs(int ms)
protected void	stateChanged(org.apache.curator.framework.state.ConnectionState newState) Translate ZK connection events into a connected/disconnected state along with the time of the first disconnect not followed by a connect.
String	toKey(String host)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ZKClusterCoordinatorDriver

public ZKClusterCoordinatorDriver()

Method Detail

setConnect

public ZKClusterCoordinatorDriver setConnect(String connect)
                                      throws ZKConfigException

Specify connect string in the form: host:/zkRoot/clusterId

Parameters:

connect -

Returns:

This ZKClusterCoordinatorDriver.

Throws:

ZKConfigException

setConnect

public ZKClusterCoordinatorDriver setConnect(String connect,
                                             String zkRoot,
                                             String clusterId)

setRetryCount

public ZKClusterCoordinatorDriver setRetryCount(int n)

setConnectTimeoutMs

public ZKClusterCoordinatorDriver setConnectTimeoutMs(int ms)

setRetryDelayMs

public ZKClusterCoordinatorDriver setRetryDelayMs(int ms)

setMaxStartWaitMs

public ZKClusterCoordinatorDriver setMaxStartWaitMs(int ms)

setFailureTimoutMs

public ZKClusterCoordinatorDriver setFailureTimoutMs(int ms)

setPorts

public ZKClusterCoordinatorDriver setPorts(int userPort,
                                           int controlPort,
                                           int dataPort)

build

public ZKClusterCoordinatorDriver build()
                                 throws ZKRuntimeException

Builds and starts the ZooKeeper cluster coordinator, translating any errors that occur. After this call, the listener will start receiving messages.

Returns:

This ZKClusterCoordinatorDriver.

Throws:

ZKRuntimeException - if ZK startup fails

addDrillbitListener

public void addDrillbitListener(DrillbitStatusListener listener)

removeDrillbitListener

public void removeDrillbitListener(DrillbitStatusListener listener)

getInitialEndpoints

public List<CoordinationProtos.DrillbitEndpoint> getInitialEndpoints()

Returns the set of Drillbits registered at the time of the build() call. Should be empty for a cluster managed by YARN.

Returns:

The set of Drillbits registered at the time of the build() call.

asString

public static String asString(CoordinationProtos.DrillbitEndpoint bit)

Convenience method to convert a Drillbit to a string. Note that ZK does not advertise the HTTP port, so it does not appear in the generated string.

Parameters:

bit -

Returns:

A string representation of a Drillbit.

toKey

public String toKey(String host)

formatKey

public static String formatKey(String host,
                               int userPort,
                               int controlPort,
                               int dataPort)

stateChanged

protected void stateChanged(org.apache.curator.framework.state.ConnectionState newState)

Translate ZK connection events into a connected/disconnected state along with the time of the first disconnect not followed by a connect.

Parameters:

newState -

hasFailed

public boolean hasFailed()

Reports our best guess as to whether ZK has failed. We assume ZK has failed if we received a connection lost notification without a subsequent connect notification, and we received the disconnect notification log enough ago that we assume that a timeout has occurred.

Returns:

True if we think zookeeper has failed. False otherwise.

getLostConnectionDurationMs

public long getLostConnectionDurationMs()

close

public void close()

register

public void register(String amHost,
                     int amPort,
                     String appId)
              throws AMRegistrar.AMRegistrationException

Specified by:

register in interface AMRegistrar

Throws:

AMRegistrar.AMRegistrationException

deregister

public void deregister()

Specified by:

deregister in interface AMRegistrar