org.apache.drill.exec.store.parquet.columnreaders

Class VarLengthValuesColumn<V extends ValueVector>

java.lang.Object

org.apache.drill.exec.store.parquet.columnreaders.ColumnReader<V>

org.apache.drill.exec.store.parquet.columnreaders.VarLengthColumn

org.apache.drill.exec.store.parquet.columnreaders.VarLengthValuesColumn<V>

Direct Known Subclasses:

NullableVarLengthValuesColumn, VarLengthColumnReaders.VarBinaryColumn, VarLengthColumnReaders.VarCharColumn, VarLengthColumnReaders.VarDecimalColumn

public abstract class VarLengthValuesColumn<V extends ValueVector>
extends VarLengthColumn

Field Summary

Fields

Modifier and Type	Field and Description
protected org.apache.drill.exec.store.parquet.columnreaders.VarLenColumnBulkInput.BulkReaderState	bulkReaderState Bulk read operation state that needs to be maintained across batch calls

Fields inherited from class org.apache.drill.exec.store.parquet.columnreaders.ColumnReader

DICTIONARY_ENCODINGS, VALUE_ENCODINGS, vectorData

Method Summary

Modifier and Type	Method and Description
protected abstract VarLenColumnBulkInput<V>	newVLBulkInput(int recordsToRead)
protected boolean	readAndStoreValueSizeInformation()
protected void	readField(long recordToRead)
protected int	readRecordsInBulk(int recordsToRead)
abstract boolean	setSafe(int index, DrillBuf bytes, int start, int length) Store a variable length entry if there is enough memory.
protected abstract void	setSafe(VarLenBulkInput<VarLenBulkEntry> bulkInput) Store a set of variable entries in bulk; this method will automatically extend the underlying value vector if needed.
boolean	skipReadyToReadPositionUpdate()
void	updatePosition()
void	updateReadyToReadPosition()

Methods inherited from class org.apache.drill.exec.store.parquet.columnreaders.VarLengthColumn

processPageData, reset

Methods inherited from class org.apache.drill.exec.store.parquet.columnreaders.ColumnReader

capacity, checkVectorCapacityReached, clear, determineSize, getRecordsReadInCurrentPass, hitRowGroupEnd, postPageRead, processPages, processPagesAsync, readIntLittleEndian, readPage, readPageAsync, readRecords, readRecordsAsync, readValues, recordsRequireDecoding, totalValuesReadAndReadyToReadInPage

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

bulkReaderState

protected final org.apache.drill.exec.store.parquet.columnreaders.VarLenColumnBulkInput.BulkReaderState bulkReaderState

Bulk read operation state that needs to be maintained across batch calls

Method Detail

setSafe

public abstract boolean setSafe(int index,
                                DrillBuf bytes,
                                int start,
                                int length)

Store a variable length entry if there is enough memory.

Parameters:

index - entry's index

bytes - byte array container

start - start offset

length - entry's length

Returns:

true if the entry was successfully inserted; false otherwise

setSafe

protected abstract void setSafe(VarLenBulkInput<VarLenBulkEntry> bulkInput)

Store a set of variable entries in bulk; this method will automatically extend the underlying value vector if needed.

Parameters:

bulkInput - set of variable length entries

newVLBulkInput

protected abstract VarLenColumnBulkInput<V> newVLBulkInput(int recordsToRead)
                                                    throws IOException

Returns:

new variable bulk input object

Throws:

IOException

readRecordsInBulk

protected final int readRecordsInBulk(int recordsToRead)
                               throws IOException

Overrides:

readRecordsInBulk in class ColumnReader

Throws:

IOException

readField

protected void readField(long recordToRead)

Specified by:

readField in class ColumnReader

updateReadyToReadPosition

public void updateReadyToReadPosition()

Overrides:

updateReadyToReadPosition in class ColumnReader

updatePosition

public void updatePosition()

Overrides:

updatePosition in class ColumnReader

skipReadyToReadPositionUpdate

public boolean skipReadyToReadPositionUpdate()

Specified by:

skipReadyToReadPositionUpdate in class VarLengthColumn

readAndStoreValueSizeInformation

protected boolean readAndStoreValueSizeInformation()
                                            throws IOException

Specified by:

readAndStoreValueSizeInformation in class VarLengthColumn

Throws:

IOException