org.apache.drill.exec.work.batch

Class SpoolingRawBatchBuffer

java.lang.Object

org.apache.drill.exec.work.batch.BaseRawBatchBuffer<org.apache.drill.exec.work.batch.SpoolingRawBatchBuffer.RawFragmentBatchWrapper>

org.apache.drill.exec.work.batch.SpoolingRawBatchBuffer

All Implemented Interfaces:

AutoCloseable, RawFragmentBatchProvider, RawBatchBuffer

public class SpoolingRawBatchBuffer
extends BaseRawBatchBuffer<org.apache.drill.exec.work.batch.SpoolingRawBatchBuffer.RawFragmentBatchWrapper>

This implementation of RawBatchBuffer starts writing incoming batches to disk once the buffer size reaches a threshold. The order of the incoming buffers is maintained.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.drill.exec.work.batch.BaseRawBatchBuffer

BaseRawBatchBuffer.BufferQueue<T>

Field Summary

Fields

Modifier and Type	Field and Description
static long	ALLOCATOR_INITIAL_RESERVATION
static long	ALLOCATOR_MAX_RESERVATION

Fields inherited from class org.apache.drill.exec.work.batch.BaseRawBatchBuffer

bufferQueue, bufferSizePerSocket, context, enableDynamicFC, outOfMemory

Constructor Summary

Constructors

Constructor and Description
SpoolingRawBatchBuffer(FragmentContext context, int fragmentCount, int oppositeId, int bufferIndex, boolean enableDynamicFC)

Method Summary

Modifier and Type	Method and Description
void	close()
protected void	enqueueInner(RawFragmentBatch batch) implementation specific method to enqueue batch
String	getDir()
void	kill(FragmentContext context)
protected void	upkeep(RawFragmentBatch batch) Handle miscellaneous tasks after batch retrieval

Methods inherited from class org.apache.drill.exec.work.batch.BaseRawBatchBuffer

enqueue, getFragmentCount, getNext, isTerminated

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

ALLOCATOR_INITIAL_RESERVATION

public static final long ALLOCATOR_INITIAL_RESERVATION

See Also:

Constant Field Values

ALLOCATOR_MAX_RESERVATION

public static final long ALLOCATOR_MAX_RESERVATION

See Also:

Constant Field Values

Constructor Detail

SpoolingRawBatchBuffer

public SpoolingRawBatchBuffer(FragmentContext context,
                              int fragmentCount,
                              int oppositeId,
                              int bufferIndex,
                              boolean enableDynamicFC)

Method Detail

getDir

public String getDir()

enqueueInner

protected void enqueueInner(RawFragmentBatch batch)
                     throws IOException

Description copied from class: BaseRawBatchBuffer

implementation specific method to enqueue batch

Specified by:

enqueueInner in class BaseRawBatchBuffer<org.apache.drill.exec.work.batch.SpoolingRawBatchBuffer.RawFragmentBatchWrapper>

Throws:

IOException

kill

public void kill(FragmentContext context)

Specified by:

kill in interface RawFragmentBatchProvider

Overrides:

kill in class BaseRawBatchBuffer<org.apache.drill.exec.work.batch.SpoolingRawBatchBuffer.RawFragmentBatchWrapper>

upkeep

protected void upkeep(RawFragmentBatch batch)

Description copied from class: BaseRawBatchBuffer

Handle miscellaneous tasks after batch retrieval

Specified by:

upkeep in class BaseRawBatchBuffer<org.apache.drill.exec.work.batch.SpoolingRawBatchBuffer.RawFragmentBatchWrapper>

close

public void close()

Specified by:

close in interface AutoCloseable

Specified by:

close in interface RawFragmentBatchProvider

Overrides:

close in class BaseRawBatchBuffer<org.apache.drill.exec.work.batch.SpoolingRawBatchBuffer.RawFragmentBatchWrapper>