org.apache.drill.exec.store.ltsv

Class LTSVFormatPlugin

java.lang.Object

org.apache.drill.exec.store.dfs.easy.EasyFormatPlugin<LTSVFormatPluginConfig>

org.apache.drill.exec.store.ltsv.LTSVFormatPlugin

All Implemented Interfaces:

FormatPlugin

public class LTSVFormatPlugin
extends EasyFormatPlugin<LTSVFormatPluginConfig>

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.drill.exec.store.dfs.easy.EasyFormatPlugin

EasyFormatPlugin.EasyFormatConfig, EasyFormatPlugin.EasyFormatConfigBuilder

Field Summary

Fields inherited from class org.apache.drill.exec.store.dfs.easy.EasyFormatPlugin

formatConfig

Constructor Summary

Constructors

Constructor and Description
LTSVFormatPlugin(String name, DrillbitContext context, org.apache.hadoop.conf.Configuration fsConf, StoragePluginConfig storageConfig)
LTSVFormatPlugin(String name, DrillbitContext context, org.apache.hadoop.conf.Configuration fsConf, StoragePluginConfig config, LTSVFormatPluginConfig formatPluginConfig)

Method Summary

Modifier and Type	Method and Description
RecordReader	getRecordReader(FragmentContext context, DrillFileSystem dfs, FileWork fileWork, List<SchemaPath> columns, String userName) Return a record reader for the specific file format, when using the original ScanBatch scanner.
RecordWriter	getRecordWriter(FragmentContext context, EasyWriter writer)
String	getWriterOperatorType()
DrillStatsTable.TableStatistics	readStatistics(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path statsTablePath)
boolean	supportsPushDown() Does this plugin support projection push down? That is, can the reader itself handle the tasks of projecting table columns, creating null columns for missing table columns, and so on?
boolean	supportsStatistics()
void	writeStatistics(DrillStatsTable.TableStatistics statistics, org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path statsTablePath)

Methods inherited from class org.apache.drill.exec.store.dfs.easy.EasyFormatPlugin

easyConfig, frameworkBuilder, getConfig, getContext, getFsConf, getGroupScan, getGroupScan, getMatcher, getName, getOptimizerRules, getReaderBatch, getReaderOperatorType, getScanStats, getStatisticsRecordWriter, getStorageConfig, getWriter, getWriterBatch, initScanBuilder, isBlockSplittable, isCompressible, isStatisticsRecordWriter, newBatchReader, supportsAutoPartitioning, supportsFileImplicitColumns, supportsLimitPushdown, supportsRead, supportsWrite, useEnhancedScan

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.drill.exec.store.dfs.FormatPlugin

getGroupScan, getGroupScan, getOptimizerRules

Constructor Detail

LTSVFormatPlugin

public LTSVFormatPlugin(String name,
                        DrillbitContext context,
                        org.apache.hadoop.conf.Configuration fsConf,
                        StoragePluginConfig storageConfig)

LTSVFormatPlugin

public LTSVFormatPlugin(String name,
                        DrillbitContext context,
                        org.apache.hadoop.conf.Configuration fsConf,
                        StoragePluginConfig config,
                        LTSVFormatPluginConfig formatPluginConfig)

Method Detail

getRecordReader

public RecordReader getRecordReader(FragmentContext context,
                                    DrillFileSystem dfs,
                                    FileWork fileWork,
                                    List<SchemaPath> columns,
                                    String userName)

Description copied from class: EasyFormatPlugin

Return a record reader for the specific file format, when using the original ScanBatch scanner.

Overrides:

getRecordReader in class EasyFormatPlugin<LTSVFormatPluginConfig>

Parameters:

context - fragment context

dfs - Drill file system

fileWork - metadata about the file to be scanned

columns - list of projected columns (or may just contain the wildcard)

userName - the name of the user running the query

Returns:

a record reader for this format

getWriterOperatorType

public String getWriterOperatorType()

Overrides:

getWriterOperatorType in class EasyFormatPlugin<LTSVFormatPluginConfig>

supportsPushDown

public boolean supportsPushDown()

Description copied from class: EasyFormatPlugin

Does this plugin support projection push down? That is, can the reader itself handle the tasks of projecting table columns, creating null columns for missing table columns, and so on?

Overrides:

supportsPushDown in class EasyFormatPlugin<LTSVFormatPluginConfig>

Returns:

true if the plugin supports projection push-down, false if Drill should do the task by adding a project operator

getRecordWriter

public RecordWriter getRecordWriter(FragmentContext context,
                                    EasyWriter writer)

Overrides:

getRecordWriter in class EasyFormatPlugin<LTSVFormatPluginConfig>

supportsStatistics

public boolean supportsStatistics()

Specified by:

supportsStatistics in interface FormatPlugin

Overrides:

supportsStatistics in class EasyFormatPlugin<LTSVFormatPluginConfig>

readStatistics

public DrillStatsTable.TableStatistics readStatistics(org.apache.hadoop.fs.FileSystem fs,
                                                      org.apache.hadoop.fs.Path statsTablePath)

Specified by:

readStatistics in interface FormatPlugin

Overrides:

readStatistics in class EasyFormatPlugin<LTSVFormatPluginConfig>

writeStatistics

public void writeStatistics(DrillStatsTable.TableStatistics statistics,
                            org.apache.hadoop.fs.FileSystem fs,
                            org.apache.hadoop.fs.Path statsTablePath)

Specified by:

writeStatistics in interface FormatPlugin

Overrides:

writeStatistics in class EasyFormatPlugin<LTSVFormatPluginConfig>