org.apache.drill.exec.store.parquet

Class ParquetWriter

java.lang.Object

org.apache.drill.exec.physical.base.AbstractBase

org.apache.drill.exec.physical.base.AbstractSingle

org.apache.drill.exec.physical.base.AbstractWriter

org.apache.drill.exec.store.parquet.ParquetWriter

All Implemented Interfaces:

Iterable<PhysicalOperator>, GraphValue<PhysicalOperator>, PhysicalOperator, Writer

public class ParquetWriter
extends AbstractWriter

Field Summary

Fields

Modifier and Type	Field and Description
static String	OPERATOR_TYPE
static int	WRITER_VERSION Version of Drill's Parquet writer.

Fields inherited from class org.apache.drill.exec.physical.base.AbstractSingle

child

Fields inherited from class org.apache.drill.exec.physical.base.AbstractBase

INIT_ALLOCATION, initialAllocation, MAX_ALLOCATION, maxAllocation, userName

Constructor Summary

Constructors

Constructor and Description
ParquetWriter(PhysicalOperator child, String location, List<String> partitionColumns, ParquetFormatPlugin formatPlugin)
ParquetWriter(PhysicalOperator child, String location, List<String> partitionColumns, StorageStrategy storageStrategy, StoragePluginConfig storageConfig, StoragePluginRegistry engineRegistry)

Method Summary

Modifier and Type	Method and Description
FormatPluginConfig	getFormatConfig()
ParquetFormatPlugin	getFormatPlugin()
String	getLocation()
protected PhysicalOperator	getNewWithChild(PhysicalOperator child)
String	getOperatorType()
List<String>	getPartitionColumns()
StoragePluginConfig	getStorageConfig()
String	toString()

Methods inherited from class org.apache.drill.exec.physical.base.AbstractWriter

accept, getStorageStrategy, setStorageStrategy

Methods inherited from class org.apache.drill.exec.physical.base.AbstractSingle

getChild, getNewWithChildren, iterator

Methods inherited from class org.apache.drill.exec.physical.base.AbstractBase

accept, getCost, getInitialAllocation, getMaxAllocation, getOperatorId, getSVMode, getUserName, isBufferedOperator, isExecutable, setCost, setMaxAllocation, setOperatorId

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.drill.exec.physical.base.PhysicalOperator

getCost, getInitialAllocation, getMaxAllocation, getNewWithChildren, getOperatorId, getSVMode, getUserName, isBufferedOperator, isExecutable, setCost, setMaxAllocation, setOperatorId

Methods inherited from interface org.apache.drill.common.graph.GraphValue

accept

Methods inherited from interface java.lang.Iterable

forEach, iterator, spliterator

Field Detail

WRITER_VERSION

public static final int WRITER_VERSION

Version of Drill's Parquet writer. Increment this version (by 1) any time we make any format change to the file. Format changes include:

• Supporting new data types,
• Changes to the format of data fields,
• Adding new metadata to the file footer, etc.

Newer readers must be able to read old files. The Writer version tells the Parquet reader how to interpret fields or metadata when that data changes format from one writer version to another.

See Also:

Constant Field Values

OPERATOR_TYPE

public static final String OPERATOR_TYPE

See Also:

Constant Field Values

Constructor Detail

ParquetWriter

public ParquetWriter(PhysicalOperator child,
                     String location,
                     List<String> partitionColumns,
                     StorageStrategy storageStrategy,
                     StoragePluginConfig storageConfig,
                     StoragePluginRegistry engineRegistry)
              throws IOException,
                     ExecutionSetupException

Throws:

IOException

ExecutionSetupException

ParquetWriter

public ParquetWriter(PhysicalOperator child,
                     String location,
                     List<String> partitionColumns,
                     ParquetFormatPlugin formatPlugin)

Method Detail

getLocation

public String getLocation()

getStorageConfig

public StoragePluginConfig getStorageConfig()

getPartitionColumns

public List<String> getPartitionColumns()

getFormatConfig

public FormatPluginConfig getFormatConfig()

getFormatPlugin

public ParquetFormatPlugin getFormatPlugin()

getNewWithChild

protected PhysicalOperator getNewWithChild(PhysicalOperator child)

Specified by:

getNewWithChild in class AbstractSingle

getOperatorType

public String getOperatorType()

toString

public String toString()

Overrides:

toString in class Object