Interface | Description |
---|---|
RecordBatchSizerManager.FieldOverflowState |
An abstraction to allow column readers attach custom field overflow state
|
Class | Description |
---|---|
BatchSizingMemoryUtil |
Helper class to assist the Flat Parquet reader build batches which adhere to memory sizing constraints
|
BatchSizingMemoryUtil.ColumnMemoryUsageInfo |
A container class to hold a column batch memory usage information.
|
BatchSizingMemoryUtil.VectorMemoryUsageInfo |
Container class which holds memory usage information about a variable length
ValueVector ;
all values are in bytes. |
RecordBatchOverflow |
Logic for handling batch record overflow; this class essentially serializes overflow vector data in a
compact manner so that it is reused for building the next record batch.
|
RecordBatchOverflow.Builder |
Builder class to construct a
RecordBatchOverflow object |
RecordBatchOverflow.FieldOverflowDefinition |
Field overflow definition
|
RecordBatchOverflow.RecordOverflowDefinition |
Record batch definition
|
RecordBatchSizerManager |
This class is tasked with managing all aspects of flat Parquet reader record batch sizing logic.
|
RecordBatchSizerManager.ColumnMemoryQuota |
Field memory quota
|
RecordBatchSizerManager.FieldOverflowStateContainer |
Container object to hold current field overflow state
|
RecordBatchSizerManager.VarLenColumnBatchStats |
Container object to supply variable columns statistics to the batch sizer
|
Copyright © 1970 The Apache Software Foundation. All rights reserved.