Class VarLenOverflowReader
java.lang.Object
org.apache.drill.exec.store.parquet.columnreaders.VarLenOverflowReader
This class is responsible for processing serialized overflow data (generated in a previous batch); this way
overflow data becomes an input source and is thus a) efficiently re-loaded into the current
batch ValueVector and b) subjected to the same batching constraints rules.
-
Field Summary
Modifier and TypeFieldDescriptionprotected final ByteBuffer
byte buffer used for buffering page dataprotected final org.apache.drill.exec.store.parquet.columnreaders.VarLenColumnBulkEntry
Bulk entry -
Method Summary
Modifier and TypeMethodDescriptionprotected boolean
batchMemoryConstraintsReached
(int newBitsMemory, int newOffsetsMemory, int newDataMemory)
-
Field Details
-
buffer
byte buffer used for buffering page data -
entry
protected final org.apache.drill.exec.store.parquet.columnreaders.VarLenColumnBulkEntry entryBulk entry
-
-
Method Details
-
batchMemoryConstraintsReached
protected boolean batchMemoryConstraintsReached(int newBitsMemory, int newOffsetsMemory, int newDataMemory) - Parameters:
newBitsMemory
- new "bits" memory sizenewOffsetsMemory
- new "offsets" memory sizenewDataMemory
- new "data" memory size- Returns:
- true if the new payload ("bits", "offsets", "data") will trigger a constraint violation; false otherwise
-