Package org.apache.drill.exec.store.parquet.columnreaders.batchsizing
package org.apache.drill.exec.store.parquet.columnreaders.batchsizing
-
ClassDescriptionHelper class to assist the Flat Parquet reader build batches which adhere to memory sizing constraintsA container class to hold a column batch memory usage information.Container class which holds memory usage information about a variable length
ValueVector; all values are in bytes.Logic for handling batch record overflow; this class essentially serializes overflow vector data in a compact manner so that it is reused for building the next record batch.Builder class to construct aRecordBatchOverflowobjectField overflow definitionRecord batch definitionThis class is tasked with managing all aspects of flat Parquet reader record batch sizing logic.Field memory quotaAn abstraction to allow column readers attach custom field overflow stateContainer object to hold current field overflow stateContainer object to supply variable columns statistics to the batch sizer