org.apache.drill.exec.store

Class CommonParquetRecordReader

java.lang.Object

org.apache.drill.exec.store.AbstractRecordReader

org.apache.drill.exec.store.CommonParquetRecordReader

All Implemented Interfaces:

AutoCloseable, RecordReader

Direct Known Subclasses:

DrillParquetReader, ParquetRecordReader

public abstract class CommonParquetRecordReader
extends AbstractRecordReader

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	CommonParquetRecordReader.Metric

Field Summary

Fields

Modifier and Type	Field and Description
protected org.apache.parquet.hadoop.metadata.ParquetMetadata	footer
protected FragmentContext	fragmentContext
static int	NUM_RECORDS_TO_READ_NOT_SPECIFIED Set when caller wants to read all the rows contained within the Parquet file
protected OperatorContext	operatorContext
ParquetReaderStats	parquetReaderStats

Fields inherited from class org.apache.drill.exec.store.AbstractRecordReader

DEFAULT_TEXT_COLS_TO_READ

Fields inherited from interface org.apache.drill.exec.store.RecordReader

ALLOCATOR_INITIAL_RESERVATION, ALLOCATOR_MAX_RESERVATION

Constructor Summary

Constructors

Constructor and Description
CommonParquetRecordReader(org.apache.parquet.hadoop.metadata.ParquetMetadata footer, FragmentContext fragmentContext)

Method Summary

Modifier and Type	Method and Description
protected void	closeStats(org.slf4j.Logger logger, org.apache.hadoop.fs.Path hadoopPath)
protected RuntimeException	handleAndRaise(String message, Exception e)
protected int	initNumRecordsToRead(long numRecordsToRead, int rowGroupIndex, org.apache.parquet.hadoop.metadata.ParquetMetadata footer)
void	updateRowGroupsStats(long numRowGroups, long rowGroupsPruned)

Methods inherited from class org.apache.drill.exec.store.AbstractRecordReader

allocate, getColumns, getDefaultColumnsToRead, hasNext, isSkipQuery, isStarQuery, setColumns, toString, transformColumns

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.drill.exec.store.RecordReader

next, setup

Methods inherited from interface java.lang.AutoCloseable

close

Field Detail

NUM_RECORDS_TO_READ_NOT_SPECIFIED

public static final int NUM_RECORDS_TO_READ_NOT_SPECIFIED

Set when caller wants to read all the rows contained within the Parquet file

See Also:

Constant Field Values

fragmentContext

protected final FragmentContext fragmentContext

parquetReaderStats

public ParquetReaderStats parquetReaderStats

operatorContext

protected OperatorContext operatorContext

footer

protected org.apache.parquet.hadoop.metadata.ParquetMetadata footer

Constructor Detail

CommonParquetRecordReader

public CommonParquetRecordReader(org.apache.parquet.hadoop.metadata.ParquetMetadata footer,
                                 FragmentContext fragmentContext)

Method Detail

updateRowGroupsStats

public void updateRowGroupsStats(long numRowGroups,
                                 long rowGroupsPruned)

closeStats

protected void closeStats(org.slf4j.Logger logger,
                          org.apache.hadoop.fs.Path hadoopPath)

initNumRecordsToRead

protected int initNumRecordsToRead(long numRecordsToRead,
                                   int rowGroupIndex,
                                   org.apache.parquet.hadoop.metadata.ParquetMetadata footer)

handleAndRaise

protected RuntimeException handleAndRaise(String message,
                                          Exception e)