Package | Description |
---|---|
org.apache.drill.exec.dotdrill |
Meta-data persistence format, used for views and other cluster-wide
persistent state.
|
org.apache.drill.exec.metastore.analyze | |
org.apache.drill.exec.metastore.store | |
org.apache.drill.exec.metastore.store.parquet | |
org.apache.drill.exec.ops | |
org.apache.drill.exec.physical.impl.scan.file |
Handles optional file metadata columns: implicit columns and
partition columns.
|
org.apache.drill.exec.physical.impl.scan.v3.file | |
org.apache.drill.exec.store.dfs | |
org.apache.drill.exec.store.dfs.easy | |
org.apache.drill.exec.store.easy.json | |
org.apache.drill.exec.store.iceberg.format | |
org.apache.drill.exec.store.ltsv | |
org.apache.drill.exec.store.mapr | |
org.apache.drill.exec.store.mapr.db | |
org.apache.drill.exec.store.parquet | |
org.apache.drill.exec.store.parquet2 | |
org.apache.drill.exec.store.sys.store | |
org.apache.drill.exec.util |
Modifier and Type | Method and Description |
---|---|
static DotDrillFile |
DotDrillFile.create(DrillFileSystem fs,
org.apache.hadoop.fs.FileStatus status) |
static List<DotDrillFile> |
DotDrillUtil.getDotDrills(DrillFileSystem fs,
org.apache.hadoop.fs.Path root,
DotDrillType... types)
Return list of DotDrillFile objects whose file name ends with .drill and matches the provided Drill Dot files types
in a given parent Path.
|
static List<DotDrillFile> |
DotDrillUtil.getDotDrills(DrillFileSystem fs,
org.apache.hadoop.fs.Path root,
String name,
DotDrillType... types)
Return list of DotDrillFile objects whose file name matches the provided name pattern and Drill Dot files types
in a given parent Path.
|
Modifier and Type | Method and Description |
---|---|
static List<org.apache.hadoop.fs.FileStatus> |
FileMetadataInfoCollector.getFileStatuses(FileSelection fileSelection,
DrillFileSystem fs)
Returns list of
FileStatus file statuses obtained from specified FileSelection file selection. |
Modifier and Type | Method and Description |
---|---|
DrillFileSystem |
MetastoreFileTableMetadataProvider.Builder.fs() |
Modifier and Type | Method and Description |
---|---|
T |
FileTableMetadataProviderBuilder.withFileSystem(DrillFileSystem fs) |
T |
MetastoreFileTableMetadataProvider.Builder.withFileSystem(DrillFileSystem fs) |
SimpleFileTableMetadataProvider.Builder |
SimpleFileTableMetadataProvider.Builder.withFileSystem(DrillFileSystem fs) |
Modifier and Type | Method and Description |
---|---|
boolean |
ParquetTableMetadataProviderImpl.fileExists(DrillFileSystem fs,
List<org.apache.hadoop.fs.Path> paths) |
List<org.apache.hadoop.fs.Path> |
ParquetTableMetadataProviderImpl.populateMetaPaths(org.apache.hadoop.fs.Path p,
DrillFileSystem fs)
Returns list of metadata cache files
|
MetastoreParquetTableMetadataProvider.Builder |
MetastoreParquetTableMetadataProvider.Builder.withFileSystem(DrillFileSystem fs) |
ParquetTableMetadataProviderImpl.Builder |
ParquetTableMetadataProviderImpl.Builder.withFileSystem(DrillFileSystem fs) |
Modifier and Type | Method and Description |
---|---|
DrillFileSystem |
BaseOperatorContext.newFileSystem(org.apache.hadoop.conf.Configuration conf)
Creates DrillFileSystem that automatically tracks operator stats.
|
DrillFileSystem |
OperatorContext.newFileSystem(org.apache.hadoop.conf.Configuration conf) |
DrillFileSystem |
BaseOperatorContext.newNonTrackingFileSystem(org.apache.hadoop.conf.Configuration conf)
Creates a DrillFileSystem that does not automatically track operator stats.
|
DrillFileSystem |
OperatorContext.newNonTrackingFileSystem(org.apache.hadoop.conf.Configuration conf) |
Modifier and Type | Method and Description |
---|---|
DrillFileSystem |
FileScanFramework.fileSystem() |
DrillFileSystem |
FileScanFramework.FileSchemaNegotiator.fileSystem()
Gives the Drill file system for this operator.
|
DrillFileSystem |
FileScanFramework.FileSchemaNegotiatorImpl.fileSystem() |
Modifier and Type | Field and Description |
---|---|
protected DrillFileSystem |
ImplicitColumnResolver.ImplicitColumnOptions.dfs |
Modifier and Type | Method and Description |
---|---|
DrillFileSystem |
FileDescrip.fileSystem()
Gives the Drill file system for this operator.
|
DrillFileSystem |
FileScanLifecycle.fileSystem() |
Modifier and Type | Method and Description |
---|---|
ImplicitColumnResolver.ImplicitColumnOptions |
ImplicitColumnResolver.ImplicitColumnOptions.dfs(DrillFileSystem dfs) |
Constructor and Description |
---|
FileDescrip(DrillFileSystem dfs,
FileWork fileWork,
org.apache.hadoop.fs.Path selectionRoot) |
ImplicitFileColumnsHandler(DrillFileSystem dfs,
OptionSet options,
FileScanLifecycleBuilder scanOptions,
ResultVectorCache vectorCache,
ScanSchemaTracker schemaTracker) |
Modifier and Type | Method and Description |
---|---|
DrillFileSystem |
WorkspaceSchemaFactory.WorkspaceSchema.getFS() |
Modifier and Type | Method and Description |
---|---|
boolean |
WorkspaceSchemaFactory.accessible(DrillFileSystem fs)
Checks whether a FileSystem object has the permission to list/read workspace directory
|
boolean |
FileSelection.containsDirectories(DrillFileSystem fs) |
static FileSelection |
FileSelection.create(DrillFileSystem fs,
String parent,
String path,
boolean allowAccessOutsideWorkspace) |
WorkspaceSchemaFactory.WorkspaceSchema |
WorkspaceSchemaFactory.createSchema(List<String> parentSchemaPath,
SchemaConfig schemaConfig,
DrillFileSystem fs) |
org.apache.hadoop.fs.FileStatus |
FileSelection.getFirstPath(DrillFileSystem fs) |
List<org.apache.hadoop.fs.FileStatus> |
FileSelection.getStatuses(DrillFileSystem fs) |
boolean |
BasicFormatMatcher.isFileReadable(DrillFileSystem fs,
org.apache.hadoop.fs.FileStatus status)
Function returns true if the file extension matches the pattern.
|
abstract boolean |
FormatMatcher.isFileReadable(DrillFileSystem fs,
org.apache.hadoop.fs.FileStatus status) |
DrillTable |
BasicFormatMatcher.isReadable(DrillFileSystem fs,
FileSelection selection,
FileSystemPlugin fsPlugin,
String storageEngineName,
SchemaConfig schemaConfig) |
abstract DrillTable |
FormatMatcher.isReadable(DrillFileSystem fs,
FileSelection selection,
FileSystemPlugin fsPlugin,
String storageEngineName,
SchemaConfig schemaConfig) |
FileSelection |
FileSelection.minusDirectories(DrillFileSystem fs) |
Constructor and Description |
---|
WorkspaceSchema(List<String> parentSchemaPath,
String wsName,
SchemaConfig schemaConfig,
DrillFileSystem fs) |
Modifier and Type | Method and Description |
---|---|
RecordReader |
EasyFormatPlugin.getRecordReader(FragmentContext context,
DrillFileSystem dfs,
FileWork fileWork,
List<SchemaPath> columns,
String userName)
Return a record reader for the specific file format, when using the original
ScanBatch scanner. |
Modifier and Type | Method and Description |
---|---|
RecordReader |
JSONFormatPlugin.getRecordReader(FragmentContext context,
DrillFileSystem dfs,
FileWork fileWork,
List<SchemaPath> columns,
String userName) |
Constructor and Description |
---|
JSONRecordReader(FragmentContext fragmentContext,
com.fasterxml.jackson.databind.JsonNode embeddedContent,
DrillFileSystem fileSystem,
List<SchemaPath> columns)
Create a new JSON Record Reader that uses a in memory materialized JSON stream.
|
JSONRecordReader(FragmentContext fragmentContext,
org.apache.hadoop.fs.Path inputPath,
DrillFileSystem fileSystem,
List<SchemaPath> columns)
Create a JSON Record Reader that uses a file based input stream.
|
Modifier and Type | Method and Description |
---|---|
boolean |
IcebergFormatMatcher.isFileReadable(DrillFileSystem fs,
org.apache.hadoop.fs.FileStatus status) |
DrillTable |
IcebergFormatMatcher.isReadable(DrillFileSystem fs,
FileSelection selection,
FileSystemPlugin fsPlugin,
String storageEngineName,
SchemaConfig schemaConfig) |
Modifier and Type | Method and Description |
---|---|
RecordReader |
LTSVFormatPlugin.getRecordReader(FragmentContext context,
DrillFileSystem dfs,
FileWork fileWork,
List<SchemaPath> columns,
String userName) |
Constructor and Description |
---|
LTSVRecordReader(FragmentContext fragmentContext,
org.apache.hadoop.fs.Path path,
DrillFileSystem fileSystem,
List<SchemaPath> columns) |
Modifier and Type | Method and Description |
---|---|
boolean |
TableFormatMatcher.isFileReadable(DrillFileSystem fs,
org.apache.hadoop.fs.FileStatus status) |
DrillTable |
TableFormatMatcher.isReadable(DrillFileSystem fs,
FileSelection selection,
FileSystemPlugin fsPlugin,
String storageEngineName,
SchemaConfig schemaConfig) |
Modifier and Type | Method and Description |
---|---|
DrillTable |
MapRDBFormatMatcher.isReadable(DrillFileSystem fs,
FileSelection selection,
FileSystemPlugin fsPlugin,
String storageEngineName,
SchemaConfig schemaConfig) |
DrillTable |
MapRDBFormatMatcher.isReadableIndex(DrillFileSystem fs,
FileSelection selection,
FileSystemPlugin fsPlugin,
String storageEngineName,
String userName,
IndexDescriptor secondaryIndexDesc)
Get an instance of DrillTable for a particular native secondary index
|
Modifier and Type | Method and Description |
---|---|
protected abstract DrillFileSystem |
AbstractParquetScanBatchCreator.AbstractDrillFileSystemManager.get(org.apache.hadoop.conf.Configuration config,
org.apache.hadoop.fs.Path path) |
Constructor and Description |
---|
DrillParquetReader(FragmentContext fragmentContext,
org.apache.parquet.hadoop.metadata.ParquetMetadata footer,
RowGroupReadEntry entry,
List<SchemaPath> columns,
DrillFileSystem fileSystem,
ParquetReaderUtility.DateCorruptionStatus containsCorruptedDates,
long recordsToRead) |
Modifier and Type | Method and Description |
---|---|
static DrillFileSystem |
LocalPersistentStore.getFileSystem(DrillConfig config,
org.apache.hadoop.fs.Path root) |
Constructor and Description |
---|
LocalPersistentStore(DrillFileSystem fs,
org.apache.hadoop.fs.Path base,
PersistentStoreConfig<V> config) |
Modifier and Type | Method and Description |
---|---|
static DrillFileSystem |
ImpersonationUtil.createFileSystem(String proxyUserName,
org.apache.hadoop.conf.Configuration fsConf)
Create DrillFileSystem for given proxyUserName and configuration.
|
Copyright © 1970 The Apache Software Foundation. All rights reserved.