Class DrillParquetReader
java.lang.Object
org.apache.drill.exec.store.AbstractRecordReader
org.apache.drill.exec.store.CommonParquetRecordReader
org.apache.drill.exec.store.parquet2.DrillParquetReader
- All Implemented Interfaces:
AutoCloseable
,RecordReader
-
Nested Class Summary
Nested classes/interfaces inherited from class org.apache.drill.exec.store.CommonParquetRecordReader
CommonParquetRecordReader.Metric
-
Field Summary
Fields inherited from class org.apache.drill.exec.store.CommonParquetRecordReader
footer, fragmentContext, NUM_RECORDS_TO_READ_NOT_SPECIFIED, operatorContext, parquetReaderStats
Fields inherited from class org.apache.drill.exec.store.AbstractRecordReader
DEFAULT_TEXT_COLS_TO_READ
Fields inherited from interface org.apache.drill.exec.store.RecordReader
ALLOCATOR_INITIAL_RESERVATION, ALLOCATOR_MAX_RESERVATION
-
Constructor Summary
ConstructorDescriptionDrillParquetReader
(FragmentContext fragmentContext, org.apache.parquet.hadoop.metadata.ParquetMetadata footer, RowGroupReadEntry entry, List<SchemaPath> columns, DrillFileSystem fileSystem, ParquetReaderUtility.DateCorruptionStatus containsCorruptedDates, long recordsToRead) -
Method Summary
Modifier and TypeMethodDescriptionvoid
allocate
(Map<String, ValueVector> vectorMap) void
close()
int
next()
Increments this record reader forward, writing via the provided output mutator into the output batch.void
setup
(OperatorContext context, OutputMutator output) Configure the RecordReader with the provided schema and the record batch that should be written to.toString()
Methods inherited from class org.apache.drill.exec.store.CommonParquetRecordReader
closeStats, handleAndRaise, initNumRecordsToRead, updateRowGroupsStats
Methods inherited from class org.apache.drill.exec.store.AbstractRecordReader
getColumns, getDefaultColumnsToRead, hasNext, isSkipQuery, isStarQuery, setColumns, transformColumns
-
Constructor Details
-
DrillParquetReader
public DrillParquetReader(FragmentContext fragmentContext, org.apache.parquet.hadoop.metadata.ParquetMetadata footer, RowGroupReadEntry entry, List<SchemaPath> columns, DrillFileSystem fileSystem, ParquetReaderUtility.DateCorruptionStatus containsCorruptedDates, long recordsToRead)
-
-
Method Details
-
allocate
- Specified by:
allocate
in interfaceRecordReader
- Overrides:
allocate
in classAbstractRecordReader
- Throws:
OutOfMemoryException
-
setup
Description copied from interface:RecordReader
Configure the RecordReader with the provided schema and the record batch that should be written to.- Parameters:
context
- operator context for the readeroutput
- The place where output for a particular scan should be written. The record reader is responsible for mutating the set of schema values for that particular record.- Throws:
ExecutionSetupException
-
next
public int next()Description copied from interface:RecordReader
Increments this record reader forward, writing via the provided output mutator into the output batch.- Returns:
- The number of additional records added to the output.
-
close
public void close() -
toString
- Overrides:
toString
in classAbstractRecordReader
-