org.apache.drill.yarn.appMaster

Class DrillbitScheduler

java.lang.Object

org.apache.drill.yarn.appMaster.AbstractScheduler

org.apache.drill.yarn.appMaster.PersistentTaskScheduler

org.apache.drill.yarn.appMaster.AbstractDrillbitScheduler

org.apache.drill.yarn.appMaster.DrillbitScheduler

All Implemented Interfaces:

Scheduler

public class DrillbitScheduler
extends AbstractDrillbitScheduler

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.drill.yarn.appMaster.AbstractDrillbitScheduler

AbstractDrillbitScheduler.DrillbitManager

Nested classes/interfaces inherited from interface org.apache.drill.yarn.appMaster.Scheduler

Scheduler.TaskManager

Field Summary

Fields inherited from class org.apache.drill.yarn.appMaster.PersistentTaskScheduler

quantity

Fields inherited from class org.apache.drill.yarn.appMaster.AbstractScheduler

failCount, isTracked, priority, state, taskManager, taskSpec

Constructor Summary

Constructors

Constructor and Description
DrillbitScheduler(String name, TaskSpec taskSpec, int quantity, int requestTimeoutSecs, int maxExtraNodes)

Method Summary

Modifier and Type	Method and Description
int	getRequestTimeoutSec() Maximum amount of time to wait when cancelling a job in the REQUESTING state.
int	resize(int level) Set the number of running tasks to the quantity given.

Methods inherited from class org.apache.drill.yarn.appMaster.PersistentTaskScheduler

adjust, completed, getProgress, getTarget, hasMoreTasks, requestTimedOut

Methods inherited from class org.apache.drill.yarn.appMaster.AbstractScheduler

addTasks, change, getName, getResource, getTaskManager, getType, isTracked, limitContainerSize, registerState, setPriority, setTaskManager

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DrillbitScheduler

public DrillbitScheduler(String name,
                         TaskSpec taskSpec,
                         int quantity,
                         int requestTimeoutSecs,
                         int maxExtraNodes)

Method Detail

resize

public int resize(int level)

Set the number of running tasks to the quantity given. Limits the quantity to only a small margin above the number of estimated free YARN nodes. This avoids a common users error where someone requests 20 nodes on a 5-node cluster.

Specified by:

resize in interface Scheduler

Overrides:

resize in class PersistentTaskScheduler

Parameters:

level - the target number of tasks

Returns:

the actual resize level, which may be lower than the requested level if the system cannot provide the requested level

getRequestTimeoutSec

public int getRequestTimeoutSec()

Description copied from interface: Scheduler

Maximum amount of time to wait when cancelling a job in the REQUESTING state. YARN will happily wait forever for a resource, this setting forcibly cancels the request at timeout.

Specified by:

getRequestTimeoutSec in interface Scheduler

Overrides:

getRequestTimeoutSec in class AbstractScheduler

Returns:

the number of seconds to wait for timeout. 0 means no timeout