Package org.apache.drill.exec.store.iceberg

Class IcebergGroupScan

java.lang.Object

org.apache.drill.exec.physical.base.AbstractBase

org.apache.drill.exec.physical.base.AbstractGroupScan

org.apache.drill.exec.store.iceberg.IcebergGroupScan

All Implemented Interfaces:

Iterable<PhysicalOperator>, GraphValue<PhysicalOperator>, FragmentLeaf, GroupScan, HasAffinity, Leaf, PhysicalOperator, Scan

public class IcebergGroupScan
extends AbstractGroupScan

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	IcebergGroupScan.IcebergGroupScanBuilder

Field Summary

Fields inherited from class org.apache.drill.exec.physical.base.AbstractBase

INIT_ALLOCATION, initialAllocation, MAX_ALLOCATION, maxAllocation, userName

Fields inherited from interface org.apache.drill.exec.physical.base.GroupScan

ALL_COLUMNS

Constructor Summary

Constructors

Constructor	Description
IcebergGroupScan(String userName, StoragePluginConfig storageConfig, FormatPluginConfig formatConfig, List<SchemaPath> columns, TupleMetadata schema, String path, LogicalExpression condition, Integer maxRecords, StoragePluginRegistry pluginRegistry)

Method Summary

Modifier and Type	Method	Description
void	applyAssignments(List<CoordinationProtos.DrillbitEndpoint> endpoints)
IcebergGroupScan	applyLimit(int maxRecords)	By default, return null to indicate row count based prune is not supported.
static IcebergGroupScan.IcebergGroupScanBuilder	builder()
IcebergGroupScan	clone(List<SchemaPath> columns)	Returns a clone of GroupScan instance, except that the new GroupScan will use the provided list of columns .
List<SchemaPath>	getColumns()	Returns a list of columns scanned by this group scan
LogicalExpression	getCondition()
String	getDigest()	Returns a signature of the GroupScan which should usually be composed of all its attributes which could describe it uniquely.
FormatPluginConfig	getFormatConfig()
IcebergFormatPlugin	getFormatPlugin()
int	getMaxParallelizationWidth()
int	getMaxRecords()
PhysicalOperator	getNewWithChildren(List<PhysicalOperator> children)	Regenerate with this node with a new set of children.
List<EndpointAffinity>	getOperatorAffinity()	Get the list of Endpoints with associated affinities that this operator has preference for.
String	getPath()
static String	getPath(SchemaPath schemaPath)
ScanStats	getScanStats()
TupleMetadata	getSchema()
IcebergSubScan	getSpecificScan(int minorFragmentId)
StoragePluginConfig	getStorageConfig()
org.apache.iceberg.TableScan	getTableScan()
static org.apache.iceberg.TableScan	initTableScan(IcebergFormatPlugin formatPlugin, String path, LogicalExpression condition)
static org.apache.iceberg.TableScan	projectColumns(org.apache.iceberg.TableScan tableScan, List<SchemaPath> columns)
boolean	supportsLimitPushdown()	Default is not to support limit pushdown.
IcebergGroupScan.IcebergGroupScanBuilder	toBuilder()
String	toString()

Methods inherited from class org.apache.drill.exec.physical.base.AbstractGroupScan

accept, applyFilter, canPushdownProjects, enforceWidth, getAnalyzeInfoProvider, getColumnValueCount, getDistributionAffinity, getFiles, getFilter, getInitialAllocation, getMaxAllocation, getMetadataProvider, getMinParallelizationWidth, getOperatorType, getPartitionColumns, getScanStats, getScanStats, getSelectionRoot, getTableMetadata, hasFiles, isDistributed, isExecutable, iterator, supportsFilterPushDown, supportsPartitionFilterPushdown, usedMetastore

Methods inherited from class org.apache.drill.exec.physical.base.AbstractBase

accept, getCost, getOperatorId, getSVMode, getUserName, isBufferedOperator, setCost, setMaxAllocation, setOperatorId

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.drill.common.graph.GraphValue

accept

Methods inherited from interface java.lang.Iterable

forEach, spliterator

Methods inherited from interface org.apache.drill.exec.physical.base.PhysicalOperator

getCost, getOperatorId, getSVMode, getUserName, isBufferedOperator, setCost, setMaxAllocation, setOperatorId

Constructor Details

IcebergGroupScan

public IcebergGroupScan(String userName,
 StoragePluginConfig storageConfig,
 FormatPluginConfig formatConfig,
 List<SchemaPath> columns,
 TupleMetadata schema,
 String path,
 LogicalExpression condition,
 Integer maxRecords,
 StoragePluginRegistry pluginRegistry)
                 throws IOException

Throws:

IOException

Method Details

initTableScan

public static org.apache.iceberg.TableScan initTableScan(IcebergFormatPlugin formatPlugin,
 String path,
 LogicalExpression condition)

builder

public static IcebergGroupScan.IcebergGroupScanBuilder builder()

clone

public IcebergGroupScan clone(List<SchemaPath> columns)

Description copied from interface: GroupScan

Returns a clone of GroupScan instance, except that the new GroupScan will use the provided list of columns .

Specified by:

clone in interface GroupScan

Overrides:

clone in class AbstractGroupScan

applyLimit

public IcebergGroupScan applyLimit(int maxRecords)

Description copied from class: AbstractGroupScan

By default, return null to indicate row count based prune is not supported. Each group scan subclass should override, if it supports row count based prune.

Specified by:

applyLimit in interface GroupScan

Overrides:

applyLimit in class AbstractGroupScan

Parameters:

maxRecords - : the number of rows requested from group scan.

Returns:

a new instance of group scan if the prune is successful. null when either if row-based prune is not supported, or if prune is not successful.

applyAssignments

public void applyAssignments(List<CoordinationProtos.DrillbitEndpoint> endpoints)

getSpecificScan

public IcebergSubScan getSpecificScan(int minorFragmentId)

getTableScan

public org.apache.iceberg.TableScan getTableScan()

getMaxRecords

public int getMaxRecords()

getMaxParallelizationWidth

public int getMaxParallelizationWidth()

getDigest

public String getDigest()

Description copied from interface: GroupScan

Returns a signature of the GroupScan which should usually be composed of all its attributes which could describe it uniquely.

getScanStats

public ScanStats getScanStats()

Overrides:

getScanStats in class AbstractGroupScan

getNewWithChildren

public PhysicalOperator getNewWithChildren(List<PhysicalOperator> children)

Description copied from interface: PhysicalOperator

Regenerate with this node with a new set of children. This is used in the case of materialization or optimization.

projectColumns

public static org.apache.iceberg.TableScan projectColumns(org.apache.iceberg.TableScan tableScan,
 List<SchemaPath> columns)

getPath

public static String getPath(SchemaPath schemaPath)

getOperatorAffinity

public List<EndpointAffinity> getOperatorAffinity()

Description copied from interface: HasAffinity

Get the list of Endpoints with associated affinities that this operator has preference for.

Specified by:

getOperatorAffinity in interface HasAffinity

Overrides:

getOperatorAffinity in class AbstractGroupScan

Returns:

List of EndpointAffinity objects.

supportsLimitPushdown

public boolean supportsLimitPushdown()

Description copied from class: AbstractGroupScan

Default is not to support limit pushdown.

Specified by:

supportsLimitPushdown in interface GroupScan

Overrides:

supportsLimitPushdown in class AbstractGroupScan

getColumns

public List<SchemaPath> getColumns()

Description copied from interface: GroupScan

Returns a list of columns scanned by this group scan

Specified by:

getColumns in interface GroupScan

Overrides:

getColumns in class AbstractGroupScan

getSchema

public TupleMetadata getSchema()

getStorageConfig

public StoragePluginConfig getStorageConfig()

getFormatConfig

public FormatPluginConfig getFormatConfig()

getPath

public String getPath()

getCondition

public LogicalExpression getCondition()

getFormatPlugin

public IcebergFormatPlugin getFormatPlugin()

toString

public String toString()

Overrides:

toString in class Object

toBuilder

public IcebergGroupScan.IcebergGroupScanBuilder toBuilder()