Package | Description |
---|---|
org.apache.drill.exec.store.parquet | |
org.apache.drill.exec.store.parquet.metadata |
Modifier and Type | Field and Description |
---|---|
protected MetadataBase.ParquetTableMetadataBase |
BaseParquetMetadataProvider.parquetTableMetadata |
Modifier and Type | Method and Description |
---|---|
static void |
ParquetReaderUtility.correctDatesInMetadataCache(MetadataBase.ParquetTableMetadataBase parquetTableMetadata) |
static RowsMatch |
FilterEvaluatorUtils.evalFilter(LogicalExpression expr,
MetadataBase.ParquetTableMetadataBase footer,
int rowGroupIndex,
OptionManager options,
FragmentContext fragmentContext) |
static Map<SchemaPath,TypeProtos.MajorType> |
ParquetTableMetadataUtils.getFileFields(MetadataBase.ParquetTableMetadataBase parquetTableMetadata,
MetadataBase.ParquetFileMetadata file)
Returns map of column names with their drill types for specified
file . |
static Map<SchemaPath,TypeProtos.MajorType> |
ParquetTableMetadataUtils.getIntermediateFields(MetadataBase.ParquetTableMetadataBase parquetTableMetadata,
MetadataBase.RowGroupMetadata rowGroup)
Returns map of column names with their Drill types for every
NameSegment in SchemaPath
in specified rowGroup . |
static NonInterestingColumnsMetadata |
ParquetTableMetadataUtils.getNonInterestingColumnsMeta(MetadataBase.ParquetTableMetadataBase parquetTableMetadata)
Returns the non-interesting column's metadata
|
static org.apache.parquet.schema.OriginalType |
ParquetTableMetadataUtils.getOriginalType(MetadataBase.ParquetTableMetadataBase parquetTableMetadata,
MetadataBase.ColumnMetadata column)
Returns
OriginalType type for the specified column. |
static org.apache.parquet.schema.PrimitiveType.PrimitiveTypeName |
ParquetTableMetadataUtils.getPrimitiveTypeName(MetadataBase.ParquetTableMetadataBase parquetTableMetadata,
MetadataBase.ColumnMetadata column)
Returns
PrimitiveType.PrimitiveTypeName type for the specified column. |
static Map<SchemaPath,ColumnStatistics<?>> |
ParquetTableMetadataUtils.getRowGroupColumnStatistics(MetadataBase.ParquetTableMetadataBase tableMetadata,
MetadataBase.RowGroupMetadata rowGroupMetadata)
Converts specified
MetadataBase.RowGroupMetadata into the map of ColumnStatistics
instances with column names as keys. |
static Map<SchemaPath,TypeProtos.MajorType> |
ParquetTableMetadataUtils.getRowGroupFields(MetadataBase.ParquetTableMetadataBase parquetTableMetadata,
MetadataBase.RowGroupMetadata rowGroup)
Returns map of column names with their drill types for specified
rowGroup . |
static RowGroupMetadata |
ParquetTableMetadataUtils.getRowGroupMetadata(MetadataBase.ParquetTableMetadataBase tableMetadata,
MetadataBase.RowGroupMetadata rowGroupMetadata,
int rgIndexInFile,
org.apache.hadoop.fs.Path location)
Returns
RowGroupMetadata instance converted from specified parquet rowGroupMetadata . |
static org.apache.drill.shaded.guava.com.google.common.collect.Multimap<org.apache.hadoop.fs.Path,RowGroupMetadata> |
ParquetTableMetadataUtils.getRowGroupsMetadata(MetadataBase.ParquetTableMetadataBase tableMetadata)
Returns list of
RowGroupMetadata received by converting parquet row groups metadata
taken from the specified tableMetadata. |
static void |
ParquetReaderUtility.transformBinaryInMetadataCache(MetadataBase.ParquetTableMetadataBase parquetTableMetadata,
ParquetReaderConfig readerConfig)
Transforms values for min / max binary statistics to byte array.
|
Modifier and Type | Class and Description |
---|---|
static class |
Metadata_V1.ParquetTableMetadata_v1 |
static class |
Metadata_V2.ParquetTableMetadata_v2
Struct which contains the metadata for an entire parquet directory structure
|
static class |
Metadata_V3.ParquetTableMetadata_v3 |
static class |
Metadata_V4.ParquetTableMetadata_v4 |
Modifier and Type | Method and Description |
---|---|
abstract MetadataBase.ParquetTableMetadataBase |
MetadataBase.ParquetTableMetadataBase.clone() |
MetadataBase.ParquetTableMetadataBase |
Metadata_V3.ParquetTableMetadata_v3.clone() |
MetadataBase.ParquetTableMetadataBase |
Metadata_V4.ParquetTableMetadata_v4.clone() |
MetadataBase.ParquetTableMetadataBase |
Metadata_V1.ParquetTableMetadata_v1.clone() |
MetadataBase.ParquetTableMetadataBase |
Metadata_V2.ParquetTableMetadata_v2.clone() |
static MetadataBase.ParquetTableMetadataBase |
Metadata.readBlockMeta(org.apache.hadoop.fs.FileSystem fs,
List<org.apache.hadoop.fs.Path> paths,
MetadataContext metaContext,
ParquetReaderConfig readerConfig)
Get the parquet metadata for the table by reading the metadata file
|
Constructor and Description |
---|
ParquetTableMetadata_v2(String metadataVersion,
MetadataBase.ParquetTableMetadataBase parquetTable,
List<Metadata_V2.ParquetFileMetadata_v2> files,
List<org.apache.hadoop.fs.Path> directories,
String drillVersion) |
ParquetTableMetadata_v3(String metadataVersion,
MetadataBase.ParquetTableMetadataBase parquetTable,
List<Metadata_V3.ParquetFileMetadata_v3> files,
List<org.apache.hadoop.fs.Path> directories,
String drillVersion) |
ParquetTableMetadata_v4(String metadataVersion,
MetadataBase.ParquetTableMetadataBase parquetTableMetadata,
List<Metadata_V4.ParquetFileMetadata_v4> files,
List<org.apache.hadoop.fs.Path> directories,
String drillVersion,
long totalRowCount,
boolean allColumnsInteresting) |
Copyright © 1970 The Apache Software Foundation. All rights reserved.