public abstract class AbstractPartitionDescriptor extends Object implements PartitionDescriptor, Iterable<List<PartitionLocation>>
Modifier and Type | Field and Description |
---|---|
protected List<List<PartitionLocation>> |
locationSuperList
A sequence of sublists of partition locations combined into a single super
list.
|
protected boolean |
sublistsCreated
Indicates if the sublists of the partition locations has been created
|
PARTITION_BATCH_SIZE
Constructor and Description |
---|
AbstractPartitionDescriptor() |
Modifier and Type | Method and Description |
---|---|
protected abstract void |
createPartitionSublists()
Create sublists of the partition locations, each sublist of size
at most
PartitionDescriptor.PARTITION_BATCH_SIZE |
org.apache.calcite.rel.core.TableScan |
createTableScan(List<PartitionLocation> newPartitions,
org.apache.hadoop.fs.Path cacheFileRoot,
boolean isAllPruned,
MetadataContext metaContext)
Create a new TableScan rel node, given the lists of new partitions or new files to scan and a path
to a metadata cache file
|
Iterator<List<PartitionLocation>> |
iterator()
Iterator that traverses over the super list of partition locations and
each time returns a single sublist of partition locations.
|
boolean |
supportsMetadataCachePruning() |
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
createTableScan, getBaseTableLocation, getIdIfValid, getMaxHierarchyLevel, getPartitionHierarchyIndex, getVectorType, isPartitionName, populatePartitionVectors
forEach, spliterator
protected List<List<PartitionLocation>> locationSuperList
PartitionDescriptor.PARTITION_BATCH_SIZE
For example if the size is
3, the complete list could be: {(a, b, c), {d, e, f), (g, h)}protected boolean sublistsCreated
protected abstract void createPartitionSublists()
PartitionDescriptor.PARTITION_BATCH_SIZE
public Iterator<List<PartitionLocation>> iterator()
iterator
in interface Iterable<List<PartitionLocation>>
public boolean supportsMetadataCachePruning()
supportsMetadataCachePruning
in interface PartitionDescriptor
public org.apache.calcite.rel.core.TableScan createTableScan(List<PartitionLocation> newPartitions, org.apache.hadoop.fs.Path cacheFileRoot, boolean isAllPruned, MetadataContext metaContext) throws Exception
PartitionDescriptor
createTableScan
in interface PartitionDescriptor
Exception
Copyright © 1970 The Apache Software Foundation. All rights reserved.