org.apache.drill.exec.store.parquet2

Class DrillParquetGroupConverter

java.lang.Object

org.apache.parquet.io.api.Converter

org.apache.parquet.io.api.GroupConverter

org.apache.drill.exec.store.parquet2.DrillParquetGroupConverter

public class DrillParquetGroupConverter
extends org.apache.parquet.io.api.GroupConverter

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	DrillParquetGroupConverter.CorruptionDetectingDateConverter
static class	DrillParquetGroupConverter.DrillBigIntConverter
static class	DrillParquetGroupConverter.DrillBoolConverter
static class	DrillParquetGroupConverter.DrillCorruptedDateConverter
static class	DrillParquetGroupConverter.DrillDateConverter
static class	DrillParquetGroupConverter.DrillFixedBinaryToTimeStampConverter Parquet currently supports a fixed binary type INT96 for storing hive, impala timestamp with nanoseconds precision.
static class	DrillParquetGroupConverter.DrillFixedBinaryToVarbinaryConverter Parquet currently supports a fixed binary type, which is not implemented in Drill.
static class	DrillParquetGroupConverter.DrillFixedLengthByteArrayToInterval
static class	DrillParquetGroupConverter.DrillFloat4Converter
static class	DrillParquetGroupConverter.DrillFloat8Converter
static class	DrillParquetGroupConverter.DrillIntConverter
static class	DrillParquetGroupConverter.DrillTimeConverter
static class	DrillParquetGroupConverter.DrillTimeMicrosConverter
static class	DrillParquetGroupConverter.DrillTimeStampConverter
static class	DrillParquetGroupConverter.DrillTimeStampMicrosConverter
static class	DrillParquetGroupConverter.DrillVarBinaryConverter
static class	DrillParquetGroupConverter.DrillVarCharConverter
static class	DrillParquetGroupConverter.DrillVarDecimalConverter

Field Summary

Fields

Modifier and Type	Field and Description
protected List<org.apache.parquet.io.api.Converter>	converters

Constructor Summary

Constructors

Modifier	Constructor and Description
	DrillParquetGroupConverter(OutputMutator mutator, BaseWriter baseWriter, org.apache.parquet.schema.GroupType schema, Collection<SchemaPath> columns, OptionManager options, ParquetReaderUtility.DateCorruptionStatus containsCorruptedDates, boolean skipRepeated, String parentName) The constructor is responsible for creation of converters tree and may invoke itself for creation of child converters when nested field is group type field too.
protected	DrillParquetGroupConverter(OutputMutator mutator, BaseWriter baseWriter, OptionManager options, ParquetReaderUtility.DateCorruptionStatus containsCorruptedDates) Constructor is responsible for creation of converter without creation of child converters.

Method Summary

Modifier and Type	Method and Description
void	end()
org.apache.parquet.io.api.Converter	getConverter(int i)
protected org.apache.parquet.io.api.PrimitiveConverter	getConverterForType(String name, org.apache.parquet.schema.PrimitiveType type)
void	start()
String	toString()

Methods inherited from class org.apache.parquet.io.api.GroupConverter

asGroupConverter, isPrimitive

Methods inherited from class org.apache.parquet.io.api.Converter

asPrimitiveConverter

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

converters

protected final List<org.apache.parquet.io.api.Converter> converters

Constructor Detail

DrillParquetGroupConverter

protected DrillParquetGroupConverter(OutputMutator mutator,
                                     BaseWriter baseWriter,
                                     OptionManager options,
                                     ParquetReaderUtility.DateCorruptionStatus containsCorruptedDates)

Constructor is responsible for creation of converter without creation of child converters.

Parameters:

mutator - output mutator, used to share managed buffer with primitive converters

baseWriter - map or list writer associated with the group converter

options - option manager used to check enabled option when necessary

containsCorruptedDates - allows to select strategy for dates handling

DrillParquetGroupConverter

public DrillParquetGroupConverter(OutputMutator mutator,
                                  BaseWriter baseWriter,
                                  org.apache.parquet.schema.GroupType schema,
                                  Collection<SchemaPath> columns,
                                  OptionManager options,
                                  ParquetReaderUtility.DateCorruptionStatus containsCorruptedDates,
                                  boolean skipRepeated,
                                  String parentName)

The constructor is responsible for creation of converters tree and may invoke itself for creation of child converters when nested field is group type field too. Assumed that ordering of fields from schema parameter matches ordering of paths in columns list. Though columns may have fields which aren't present in schema.

Parameters:

mutator - output mutator, used to share managed buffer with primitive converters

baseWriter - map or list writer associated with the group converter

schema - group type of the converter

columns - columns to project

options - option manager used to check enabled option when necessary

containsCorruptedDates - allows to select strategy for dates handling

skipRepeated - true only if parent field in schema detected as list and current schema is repeated group type

parentName - name of group converter which called the constructor

Method Detail

getConverterForType

protected org.apache.parquet.io.api.PrimitiveConverter getConverterForType(String name,
                                                                           org.apache.parquet.schema.PrimitiveType type)

getConverter

public org.apache.parquet.io.api.Converter getConverter(int i)

Specified by:

getConverter in class org.apache.parquet.io.api.GroupConverter

start

public void start()

Specified by:

start in class org.apache.parquet.io.api.GroupConverter

end

public void end()

Specified by:

end in class org.apache.parquet.io.api.GroupConverter

toString

public String toString()

Overrides:

toString in class Object