org.apache.drill.exec.physical.impl.project

Class ProjectMemoryManager

java.lang.Object

org.apache.drill.exec.record.RecordBatchMemoryManager

org.apache.drill.exec.physical.impl.project.ProjectMemoryManager

public class ProjectMemoryManager
extends RecordBatchMemoryManager

ProjectMemoryManager(PMM) is used to estimate the size of rows produced by ProjectRecordBatch. The PMM works as follows:

Setup phase: As and when ProjectRecordBatch creates or transfers a field, it registers the field with PMM. If the field is a variable-width field, PMM records the expression that produces the variable-width field. The expression is a tree of LogicalExpressions. The PMM walks this tree of LogicalExpressions to produce a tree of OutputWidthExpressions. The widths of fixed-width fields are just accumulated into a single total. Note: The PMM, currently, cannot handle new complex fields, it just uses a hard-coded estimate for such fields.

Execution phase: Just before a batch is processed by Project, the PMM walks the tree of OutputWidthExpressions and converts them to FixedWidthExpressions. It uses the RecordBatchSizer and the function annotations to do this conversion. See OutputWidthVisitor for details.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	ProjectMemoryManager.VariableWidthColumnInfo

Field Summary

Fields inherited from class org.apache.drill.exec.record.RecordBatchMemoryManager

DEFAULT_INPUT_INDEX, MAX_NUM_ROWS, MIN_NUM_ROWS

Constructor Summary

Constructors

Constructor and Description
ProjectMemoryManager(int configuredOutputSize)

Method Summary

Modifier and Type	Method and Description
void	addComplexField(ValueVector vv)
void	addNewField(ValueVector vvOut, LogicalExpression logicalExpression)
void	addTransferField(ValueVector vvIn, String inputColumnName, String outputColumnName)
static int	getFixedWidth(TypeProtos.MajorType majorType)
static int	getMetadataWidth(ValueVector vv)
RecordBatch	incomingBatch()
void	init(RecordBatch incomingBatch, ProjectRecordBatch outgoingBatch)
boolean	isComplex(TypeProtos.MajorType majorType)
boolean	isFixedWidth(TypedFieldId fieldId)
void	update()

Methods inherited from class org.apache.drill.exec.record.RecordBatchMemoryManager

adjustOutputRowCount, allocateVectors, allocateVectors, allocateVectors, allocateVectors, computeOutputRowCount, getAvgInputBatchSize, getAvgInputBatchSize, getAvgInputRowWidth, getAvgInputRowWidth, getAvgOutputBatchSize, getAvgOutputRowWidth, getColumnSize, getColumnSize, getCurrentOutgoingMaxRowCount, getNumIncomingBatches, getNumIncomingBatches, getNumOutgoingBatches, getOffsetVectorWidth, getOutgoingRowWidth, getOutputBatchSize, getOutputRowCount, getRecordBatchSizer, getRecordBatchSizer, getTotalInputRecords, getTotalInputRecords, getTotalOutputRecords, setCurrentOutgoingMaxRowCount, setOutgoingRowWidth, setOutputRowCount, setOutputRowCount, setRecordBatchSizer, setRecordBatchSizer, update, update, update, update, update, update, update, updateIfNeeded, updateIncomingStats, updateIncomingStats, updateOutgoingStats

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ProjectMemoryManager

public ProjectMemoryManager(int configuredOutputSize)

Method Detail

incomingBatch

public RecordBatch incomingBatch()

isComplex

public boolean isComplex(TypeProtos.MajorType majorType)

isFixedWidth

public boolean isFixedWidth(TypedFieldId fieldId)

getFixedWidth

public static int getFixedWidth(TypeProtos.MajorType majorType)

addTransferField

public void addTransferField(ValueVector vvIn,
                             String inputColumnName,
                             String outputColumnName)

addNewField

public void addNewField(ValueVector vvOut,
                        LogicalExpression logicalExpression)

addComplexField

public void addComplexField(ValueVector vv)

init

public void init(RecordBatch incomingBatch,
                 ProjectRecordBatch outgoingBatch)

update

public void update()

Overrides:

update in class RecordBatchMemoryManager

getMetadataWidth

public static int getMetadataWidth(ValueVector vv)