org.apache.drill.exec.store.easy.json

Class JSONRecordReader

java.lang.Object

org.apache.drill.exec.store.AbstractRecordReader

org.apache.drill.exec.store.easy.json.JSONRecordReader

All Implemented Interfaces:

AutoCloseable, RecordReader

public class JSONRecordReader
extends AbstractRecordReader

Field Summary

Fields

Modifier and Type	Field and Description
static long	DEFAULT_ROWS_PER_BATCH

Fields inherited from class org.apache.drill.exec.store.AbstractRecordReader

DEFAULT_TEXT_COLS_TO_READ

Fields inherited from interface org.apache.drill.exec.store.RecordReader

ALLOCATOR_INITIAL_RESERVATION, ALLOCATOR_MAX_RESERVATION

Constructor Summary

Constructors

Constructor and Description
JSONRecordReader(FragmentContext fragmentContext, com.fasterxml.jackson.databind.JsonNode embeddedContent, DrillFileSystem fileSystem, List<SchemaPath> columns) Create a new JSON Record Reader that uses a in memory materialized JSON stream.
JSONRecordReader(FragmentContext fragmentContext, List<SchemaPath> columns) Create a JSON Record Reader that uses an InputStream directly
JSONRecordReader(FragmentContext fragmentContext, org.apache.hadoop.fs.Path inputPath, DrillFileSystem fileSystem, List<SchemaPath> columns) Create a JSON Record Reader that uses a file based input stream.

Method Summary

Modifier and Type	Method and Description
void	close()
protected List<SchemaPath>	getDefaultColumnsToRead()
protected void	handleAndRaise(String suffix, Exception e)
int	next() Increments this record reader forward, writing via the provided output mutator into the output batch.
void	setInputStream(InputStream in)
void	setup(OperatorContext context, OutputMutator output) Configure the RecordReader with the provided schema and the record batch that should be written to.
String	toString()

Methods inherited from class org.apache.drill.exec.store.AbstractRecordReader

allocate, getColumns, hasNext, isSkipQuery, isStarQuery, setColumns, transformColumns

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

DEFAULT_ROWS_PER_BATCH

public static final long DEFAULT_ROWS_PER_BATCH

See Also:

Constant Field Values

Constructor Detail

JSONRecordReader

public JSONRecordReader(FragmentContext fragmentContext,
                        org.apache.hadoop.fs.Path inputPath,
                        DrillFileSystem fileSystem,
                        List<SchemaPath> columns)
                 throws OutOfMemoryException

Create a JSON Record Reader that uses a file based input stream.

Parameters:

fragmentContext - the Drill fragment

inputPath - the input path

fileSystem - a Drill file system wrapper around the file system implementation

columns - path names of columns/subfields to read

Throws:

OutOfMemoryException

JSONRecordReader

public JSONRecordReader(FragmentContext fragmentContext,
                        com.fasterxml.jackson.databind.JsonNode embeddedContent,
                        DrillFileSystem fileSystem,
                        List<SchemaPath> columns)
                 throws OutOfMemoryException

Create a new JSON Record Reader that uses a in memory materialized JSON stream.

Parameters:

fragmentContext - the Drill fragment

embeddedContent - embedded content

fileSystem - a Drill file system wrapper around the file system implementation

columns - path names of columns/subfields to read

Throws:

OutOfMemoryException

JSONRecordReader

public JSONRecordReader(FragmentContext fragmentContext,
                        List<SchemaPath> columns)
                 throws OutOfMemoryException

Create a JSON Record Reader that uses an InputStream directly

Parameters:

fragmentContext - the Drill fragment

columns - path names of columns/subfields to read

Throws:

OutOfMemoryException

Method Detail

toString

public String toString()

Overrides:

toString in class AbstractRecordReader

setup

public void setup(OperatorContext context,
                  OutputMutator output)
           throws ExecutionSetupException

Description copied from interface: RecordReader

Configure the RecordReader with the provided schema and the record batch that should be written to.

Parameters:

context - operator context for the reader

output - The place where output for a particular scan should be written. The record reader is responsible for mutating the set of schema values for that particular record.

Throws:

ExecutionSetupException

getDefaultColumnsToRead

protected List<SchemaPath> getDefaultColumnsToRead()

Overrides:

getDefaultColumnsToRead in class AbstractRecordReader

handleAndRaise

protected void handleAndRaise(String suffix,
                              Exception e)
                       throws UserException

Throws:

UserException

next

public int next()

Description copied from interface: RecordReader

Increments this record reader forward, writing via the provided output mutator into the output batch.

Returns:

The number of additional records added to the output.

setInputStream

public void setInputStream(InputStream in)

close

public void close()
           throws Exception

Throws:

Exception