Package org.apache.drill.exec.physical.base

Class SchemalessScan

java.lang.Object

org.apache.drill.exec.physical.base.AbstractBase

org.apache.drill.exec.physical.base.AbstractGroupScan

org.apache.drill.exec.physical.base.AbstractFileGroupScan

org.apache.drill.exec.physical.base.SchemalessScan

All Implemented Interfaces:

Iterable<PhysicalOperator>, GraphValue<PhysicalOperator>, FileGroupScan, FragmentLeaf, GroupScan, HasAffinity, Leaf, PhysicalOperator, Scan, SubScan

public class SchemalessScan
extends AbstractFileGroupScan
implements SubScan

The type of scan operator, which allows to scan schemaless tables (DynamicDrillTable with null selection)

Field Summary

Fields inherited from class org.apache.drill.exec.physical.base.AbstractBase

INIT_ALLOCATION, initialAllocation, MAX_ALLOCATION, maxAllocation, userName

Fields inherited from interface org.apache.drill.exec.physical.base.GroupScan

ALL_COLUMNS

Constructor Summary

Constructors

Constructor	Description
SchemalessScan(String userName, org.apache.hadoop.fs.Path selectionRoot)
SchemalessScan(String userName, org.apache.hadoop.fs.Path selectionRoot, List<SchemaPath> columns)
SchemalessScan(SchemalessScan that)

Method Summary

Modifier and Type	Method	Description
void	applyAssignments(List<CoordinationProtos.DrillbitEndpoint> endpoints)
boolean	canPushdownProjects(List<SchemaPath> columns)	GroupScan should check the list of columns, and see if it could support all the columns in the list.
GroupScan	clone(List<SchemaPath> columns)	Returns a clone of GroupScan instance, except that the new GroupScan will use the provided list of columns .
String	getDigest()	Returns a signature of the GroupScan which should usually be composed of all its attributes which could describe it uniquely.
int	getMaxParallelizationWidth()
PhysicalOperator	getNewWithChildren(List<PhysicalOperator> children)	Regenerate with this node with a new set of children.
ScanStats	getScanStats()
org.apache.hadoop.fs.Path	getSelectionRoot()	Returns path to the selection root.
SubScan	getSpecificScan(int minorFragmentId)
boolean	supportsPartitionFilterPushdown()	Whether or not this GroupScan supports pushdown of partition filters (directories for filesystems)
String	toString()

Methods inherited from class org.apache.drill.exec.physical.base.AbstractFileGroupScan

clone, modifyFileSelection

Methods inherited from class org.apache.drill.exec.physical.base.AbstractGroupScan

accept, applyFilter, applyLimit, enforceWidth, getAnalyzeInfoProvider, getColumns, getColumnValueCount, getDistributionAffinity, getFiles, getFilter, getInitialAllocation, getMaxAllocation, getMetadataProvider, getMinParallelizationWidth, getOperatorAffinity, getOperatorType, getPartitionColumns, getScanStats, getScanStats, getTableMetadata, hasFiles, isDistributed, isExecutable, iterator, supportsFilterPushDown, supportsLimitPushdown, usedMetastore

Methods inherited from class org.apache.drill.exec.physical.base.AbstractBase

accept, getCost, getOperatorId, getSVMode, getUserName, isBufferedOperator, setCost, setMaxAllocation, setOperatorId

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.drill.common.graph.GraphValue

accept

Methods inherited from interface org.apache.drill.exec.physical.base.GroupScan

applyFilter, applyLimit, enforceWidth, getAnalyzeInfoProvider, getColumns, getColumnValueCount, getFiles, getFilter, getMetadataProvider, getMinParallelizationWidth, getPartitionColumns, getScanStats, getScanStats, getTableMetadata, hasFiles, isDistributed, supportsFilterPushDown, supportsLimitPushdown, usedMetastore

Methods inherited from interface org.apache.drill.exec.physical.base.HasAffinity

getDistributionAffinity, getOperatorAffinity

Methods inherited from interface java.lang.Iterable

forEach, iterator, spliterator

Methods inherited from interface org.apache.drill.exec.physical.base.PhysicalOperator

accept, getCost, getInitialAllocation, getMaxAllocation, getOperatorId, getOperatorType, getSVMode, getUserName, isBufferedOperator, isExecutable, setCost, setMaxAllocation, setOperatorId

Constructor Details

SchemalessScan

public SchemalessScan(String userName,
 org.apache.hadoop.fs.Path selectionRoot,
 List<SchemaPath> columns)

SchemalessScan

public SchemalessScan(String userName,
 org.apache.hadoop.fs.Path selectionRoot)

SchemalessScan

public SchemalessScan(SchemalessScan that)

Method Details

getSelectionRoot

public org.apache.hadoop.fs.Path getSelectionRoot()

Description copied from interface: GroupScan

Returns path to the selection root. If this GroupScan cannot provide selection root, it returns null.

Specified by:

getSelectionRoot in interface GroupScan

Overrides:

getSelectionRoot in class AbstractGroupScan

Returns:

path to the selection root

applyAssignments

public void applyAssignments(List<CoordinationProtos.DrillbitEndpoint> endpoints)

Specified by:

applyAssignments in interface GroupScan

getSpecificScan

public SubScan getSpecificScan(int minorFragmentId)

Specified by:

getSpecificScan in interface GroupScan

getMaxParallelizationWidth

public int getMaxParallelizationWidth()

Specified by:

getMaxParallelizationWidth in interface GroupScan

getDigest

public String getDigest()

Description copied from interface: GroupScan

Returns a signature of the GroupScan which should usually be composed of all its attributes which could describe it uniquely.

Specified by:

getDigest in interface GroupScan

toString

public String toString()

Overrides:

toString in class Object

getNewWithChildren

public PhysicalOperator getNewWithChildren(List<PhysicalOperator> children)

Description copied from interface: PhysicalOperator

Regenerate with this node with a new set of children. This is used in the case of materialization or optimization.

Specified by:

getNewWithChildren in interface PhysicalOperator

clone

public GroupScan clone(List<SchemaPath> columns)

Description copied from interface: GroupScan

Returns a clone of GroupScan instance, except that the new GroupScan will use the provided list of columns .

Specified by:

clone in interface GroupScan

Overrides:

clone in class AbstractGroupScan

getScanStats

public ScanStats getScanStats()

Overrides:

getScanStats in class AbstractGroupScan

canPushdownProjects

public boolean canPushdownProjects(List<SchemaPath> columns)

Description copied from interface: GroupScan

GroupScan should check the list of columns, and see if it could support all the columns in the list.

Specified by:

canPushdownProjects in interface GroupScan

Overrides:

canPushdownProjects in class AbstractGroupScan

supportsPartitionFilterPushdown

public boolean supportsPartitionFilterPushdown()

Description copied from interface: GroupScan

Whether or not this GroupScan supports pushdown of partition filters (directories for filesystems)

Specified by:

supportsPartitionFilterPushdown in interface GroupScan

Overrides:

supportsPartitionFilterPushdown in class AbstractFileGroupScan