Package org.apache.drill.yarn.appMaster

Implements the Drill Application Master for YARN.

See: Description

Interface Summary

Interface	Description
AMRegistrar	Interface to register the AM.
AMYarnFacade	Defines the interface between the Application Master and YARN.
ClusterController	Interface which identifies the cluster controller methods that are save to call from the Dispatcher.
ControllerFactory
ControllerVisitor
DispatcherAddOn	Interface for an add-on to the dispatcher that should be started at start of the run and ended at the end of the run.
Pollable	Interface for objects that are polled on each controller clock tick in order to perform time-based tasks.
PulseRunnable.PulseCallback	Interface implemented to receive calls on each clock "tick."
RegistryHandler	Callback from the ZooKeeper registry to announce events related to Drillbit registration.
Scheduler	The scheduler describes the set of tasks to run.
Scheduler.TaskManager
SchedulerState	The cluster state for tasks managed by a scheduler.
SchedulerStateActions	Represents the set of commands called by the cluster controller to manage the state of tasks within a task group.
TaskLifecycleListener
TaskVisitor

Class Summary

Class	Description
AbstractDrillbitScheduler	Base class for schedulers (pools) for Drillbits.
AbstractScheduler
AbstractTaskManager	Task manager that does nothing.
AMYarnFacade.YarnAppHostReport	Provides a collection of web UI links for the YARN Resource Manager and the Node Manager that is running the Drill-on-YARN AM.
AMYarnFacadeImpl	Wrapper around the asynchronous versions of the YARN AM-RM and AM-NM interfaces.
BatchScheduler
ClusterControllerImpl	Controls the Drill cluster by representing the current cluster state with a desired state, taking corrective action to keep the cluster in the desired state.
Dispatcher	Dispatches YARN, timer and ZooKeeper events to the cluster controller.
DrillApplicationMaster	Application Master for Drill.
DrillbitScheduler
DrillControllerFactory	Builds a controller for a cluster of Drillbits.
DrillControllerFactory.ZKRegistryAddOn
EventContext
NodeInventory	Creates an AM-side inventory of cluster nodes.
PersistentTaskScheduler	Abstract base class for schedulers that work with persistent (long-running) tasks.
PulseRunnable	Clock driver that calls a callback once each pulse period.
SchedulerStateImpl	Manages a the set of tasks associated with a scheduler.
Task	AM-side state of individual containers.
TaskSpec
TaskState	Represents the behaviors associated with each state in the lifecycle of a task.
TaskState.EndingState	Task for which a termination request has been sent to the Drill-bit, but confirmation has not yet been received from the Node Manager.
TaskState.KillingState	Task for which a forced termination request has been sent to the Node Manager, but a stop message has not yet been received.

Enum Summary

Enum	Description
ClusterControllerImpl.State	Controller lifecycle state.
Task.Disposition
Task.TrackingState	Tracking plugin state.
TaskLifecycleListener.Event

Exception Summary

Exception	Description
AMException
AMRegistrar.AMRegistrationException
ControllerFactory.ControllerFactoryException
YarnFacadeException	Exceptions thrown from the YARN facade: the wrapper around the YARN AM interfaces.

Error Summary

Error	Description
AMWrapperException

Package org.apache.drill.yarn.appMaster Description

Implements the Drill Application Master for YARN.

Note that AM implementation classes use org.apache.commons.logging to be consistent with the logging used within YARN itself. However, the AM uses Drill's class path which uses logback logging. To enable logging, modify $DRILL_HOME/conf/logback.xml and add a section something like this:

   <logger name="org.apache.drill.yarn" additivity="false">
    <level value="trace" />
    <appender-ref ref="STDOUT" />
   </logger>