org.apache.drill.exec.store.hive

Class HiveScan

java.lang.Object

org.apache.drill.exec.physical.base.AbstractBase

org.apache.drill.exec.physical.base.AbstractGroupScan

org.apache.drill.exec.store.hive.HiveScan

All Implemented Interfaces:

Iterable<PhysicalOperator>, GraphValue<PhysicalOperator>, FragmentLeaf, GroupScan, HasAffinity, Leaf, PhysicalOperator, Scan

public class HiveScan
extends AbstractGroupScan

Field Summary

Fields

Modifier and Type	Field and Description
protected List<SchemaPath>	columns

Fields inherited from class org.apache.drill.exec.physical.base.AbstractBase

INIT_ALLOCATION, initialAllocation, MAX_ALLOCATION, maxAllocation, userName

Fields inherited from interface org.apache.drill.exec.physical.base.GroupScan

ALL_COLUMNS

Constructor Summary

Constructors

Constructor and Description
HiveScan(HiveScan that)
HiveScan(String userName, HiveReadEntry hiveReadEntry, HiveStoragePluginConfig hiveStoragePluginConfig, List<SchemaPath> columns, Map<String,String> confProperties, StoragePluginRegistry pluginRegistry)
HiveScan(String userName, HiveReadEntry hiveReadEntry, HiveStoragePlugin hiveStoragePlugin, List<SchemaPath> columns, HiveMetadataProvider metadataProvider, Map<String,String> confProperties)

Method Summary

Modifier and Type	Method and Description
void	applyAssignments(List<CoordinationProtos.DrillbitEndpoint> endpoints)
boolean	canPushdownProjects(List<SchemaPath> columns) GroupScan should check the list of columns, and see if it could support all the columns in the list.
HiveScan	clone(HiveReadEntry hiveReadEntry)
GroupScan	clone(List<SchemaPath> columns) Returns a clone of GroupScan instance, except that the new GroupScan will use the provided list of columns .
List<SchemaPath>	getColumns() Returns a list of columns scanned by this group scan
Map<String,String>	getConfProperties()
String	getDigest() Returns a signature of the GroupScan which should usually be composed of all its attributes which could describe it uniquely.
org.apache.hadoop.hive.conf.HiveConf	getHiveConf()
HiveReadEntry	getHiveReadEntry()
HiveStoragePluginConfig	getHiveStoragePluginConfig()
int	getMaxParallelizationWidth()
PhysicalOperator	getNewWithChildren(List<PhysicalOperator> children) Regenerate with this node with a new set of children.
List<EndpointAffinity>	getOperatorAffinity() Get the list of Endpoints with associated affinities that this operator has preference for.
ScanStats	getScanStats()
SubScan	getSpecificScan(int minorFragmentId)
HiveStoragePlugin	getStoragePlugin()
boolean	isNativeReader()
boolean	supportsPartitionFilterPushdown() Whether or not this GroupScan supports pushdown of partition filters (directories for filesystems)
String	toString()

Methods inherited from class org.apache.drill.exec.physical.base.AbstractGroupScan

accept, applyFilter, applyLimit, enforceWidth, getAnalyzeInfoProvider, getColumnValueCount, getDistributionAffinity, getFiles, getFilter, getInitialAllocation, getMaxAllocation, getMetadataProvider, getMinParallelizationWidth, getOperatorType, getPartitionColumns, getScanStats, getScanStats, getSelectionRoot, getTableMetadata, hasFiles, isDistributed, isExecutable, iterator, supportsFilterPushDown, supportsLimitPushdown, usedMetastore

Methods inherited from class org.apache.drill.exec.physical.base.AbstractBase

accept, getCost, getOperatorId, getSVMode, getUserName, isBufferedOperator, setCost, setMaxAllocation, setOperatorId

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.drill.exec.physical.base.PhysicalOperator

getCost, getOperatorId, getSVMode, getUserName, isBufferedOperator, setCost, setMaxAllocation, setOperatorId

Methods inherited from interface org.apache.drill.common.graph.GraphValue

accept

Methods inherited from interface java.lang.Iterable

forEach, spliterator

Field Detail

columns

protected List<SchemaPath> columns

Constructor Detail

HiveScan

public HiveScan(String userName,
                HiveReadEntry hiveReadEntry,
                HiveStoragePluginConfig hiveStoragePluginConfig,
                List<SchemaPath> columns,
                Map<String,String> confProperties,
                StoragePluginRegistry pluginRegistry)
         throws ExecutionSetupException

Throws:

ExecutionSetupException

HiveScan

public HiveScan(String userName,
                HiveReadEntry hiveReadEntry,
                HiveStoragePlugin hiveStoragePlugin,
                List<SchemaPath> columns,
                HiveMetadataProvider metadataProvider,
                Map<String,String> confProperties)
         throws ExecutionSetupException

Throws:

ExecutionSetupException

HiveScan

public HiveScan(HiveScan that)

Method Detail

clone

public HiveScan clone(HiveReadEntry hiveReadEntry)
               throws ExecutionSetupException

Throws:

ExecutionSetupException

getHiveReadEntry

public HiveReadEntry getHiveReadEntry()

getHiveStoragePluginConfig

public HiveStoragePluginConfig getHiveStoragePluginConfig()

getColumns

public List<SchemaPath> getColumns()

Description copied from interface: GroupScan

Returns a list of columns scanned by this group scan

Specified by:

getColumns in interface GroupScan

Overrides:

getColumns in class AbstractGroupScan

getConfProperties

public Map<String,String> getConfProperties()

getStoragePlugin

public HiveStoragePlugin getStoragePlugin()

getHiveConf

public org.apache.hadoop.hive.conf.HiveConf getHiveConf()

isNativeReader

public boolean isNativeReader()

supportsPartitionFilterPushdown

public boolean supportsPartitionFilterPushdown()

Description copied from interface: GroupScan

Whether or not this GroupScan supports pushdown of partition filters (directories for filesystems)

Specified by:

supportsPartitionFilterPushdown in interface GroupScan

Overrides:

supportsPartitionFilterPushdown in class AbstractGroupScan

applyAssignments

public void applyAssignments(List<CoordinationProtos.DrillbitEndpoint> endpoints)

getSpecificScan

public SubScan getSpecificScan(int minorFragmentId)
                        throws ExecutionSetupException

Throws:

ExecutionSetupException

getMaxParallelizationWidth

public int getMaxParallelizationWidth()

getOperatorAffinity

public List<EndpointAffinity> getOperatorAffinity()

Description copied from interface: HasAffinity

Get the list of Endpoints with associated affinities that this operator has preference for.

Specified by:

getOperatorAffinity in interface HasAffinity

Overrides:

getOperatorAffinity in class AbstractGroupScan

Returns:

List of EndpointAffinity objects.

getScanStats

public ScanStats getScanStats()

Overrides:

getScanStats in class AbstractGroupScan

getNewWithChildren

public PhysicalOperator getNewWithChildren(List<PhysicalOperator> children)

Description copied from interface: PhysicalOperator

Regenerate with this node with a new set of children. This is used in the case of materialization or optimization.

getDigest

public String getDigest()

Description copied from interface: GroupScan

Returns a signature of the GroupScan which should usually be composed of all its attributes which could describe it uniquely.

toString

public String toString()

Overrides:

toString in class Object

clone

public GroupScan clone(List<SchemaPath> columns)

Description copied from interface: GroupScan

Returns a clone of GroupScan instance, except that the new GroupScan will use the provided list of columns .

Specified by:

clone in interface GroupScan

Overrides:

clone in class AbstractGroupScan

canPushdownProjects

public boolean canPushdownProjects(List<SchemaPath> columns)

Description copied from interface: GroupScan

GroupScan should check the list of columns, and see if it could support all the columns in the list.

Specified by:

canPushdownProjects in interface GroupScan

Overrides:

canPushdownProjects in class AbstractGroupScan