Uses of Class
org.apache.drill.exec.store.easy.json.parser.TokenIterator

Packages that use TokenIterator

Package	Description
org.apache.drill.exec.store.easy.json.extended	Provides parsing for Mongo extended types which are generally of the form { "$type": value }.
org.apache.drill.exec.store.easy.json.loader
org.apache.drill.exec.store.easy.json.parser
org.apache.drill.exec.store.easy.json.values

Uses of TokenIterator in org.apache.drill.exec.store.easy.json.extended

Methods in org.apache.drill.exec.store.easy.json.extended with parameters of type TokenIterator

Modifier and Type	Method and Description
void	MongoBinaryValueParser.parse(TokenIterator tokenizer)
void	MongoDateValueParser.parse(TokenIterator tokenizer)
void	SimpleExtendedValueParser.parse(TokenIterator tokenizer)
protected void	BaseExtendedValueParser.parseExtended(TokenIterator tokenizer, String typeName) Parse a value in extended form:
protected void	BaseExtendedValueParser.requireField(TokenIterator tokenizer, String fieldName)
protected com.fasterxml.jackson.core.JsonToken	BaseExtendedValueParser.requireScalar(TokenIterator tokenizer)
protected void	BaseExtendedValueParser.requireToken(TokenIterator tokenizer, com.fasterxml.jackson.core.JsonToken expected)

Uses of TokenIterator in org.apache.drill.exec.store.easy.json.loader

Methods in org.apache.drill.exec.store.easy.json.loader that return TokenIterator

Modifier and Type	Method and Description
TokenIterator	FieldDefn.tokenizer() Token stream which allows a custom parser to look ahead as needed.

Methods in org.apache.drill.exec.store.easy.json.loader with parameters of type TokenIterator

Modifier and Type	Method and Description
protected ArrayParser	VariantParser.buildArrayParser(TokenIterator tokenizer)
protected ObjectParser	VariantParser.buildObjectParser(TokenIterator tokenizer)
ElementParser	TupleParser.onField(String key, TokenIterator tokenizer)
protected void	VariantParser.onValue(com.fasterxml.jackson.core.JsonToken token, TokenIterator tokenizer)
protected ElementParser	EmptyArrayFieldParser.resolve(TokenIterator tokenizer) The column type is now known from context.
protected ElementParser	NullFieldParser.resolve(TokenIterator tokenizer) The column type is now known from context.
ElementParser	TupleParser.resolveArray(String key, TokenIterator tokenizer)
ElementParser	TupleParser.resolveField(String key, TokenIterator tokenizer)

Constructors in org.apache.drill.exec.store.easy.json.loader with parameters of type TokenIterator

Constructor and Description
FieldDefn(TupleParser tupleParser, String key, TokenIterator tokenizer)
FieldDefn(TupleParser tupleParser, String key, TokenIterator tokenizer, boolean isArray)

Uses of TokenIterator in org.apache.drill.exec.store.easy.json.parser

Methods in org.apache.drill.exec.store.easy.json.parser with parameters of type TokenIterator

Modifier and Type	Method and Description
static ValueDef	ValueDefFactory.arrayLookAhead(TokenIterator tokenizer)
protected abstract ArrayParser	FullValueParser.buildArrayParser(TokenIterator tokenizer)
protected abstract ObjectParser	FullValueParser.buildObjectParser(TokenIterator tokenizer)
static ValueDef	ValueDefFactory.lookAhead(TokenIterator tokenizer)
protected abstract ElementParser	ObjectParser.onField(String key, TokenIterator tokenizer) The structure parser has just encountered a new field for this object.
protected abstract void	FullValueParser.onValue(com.fasterxml.jackson.core.JsonToken token, TokenIterator tokenizer)
void	ValueListener.onValue(com.fasterxml.jackson.core.JsonToken token, TokenIterator tokenizer) Called for a JSON scalar token.
void	ArrayParser.parse(TokenIterator tokenizer) Parses [ ^ ((value)(, (value)* )? ]
void	ArrayValueParser.parse(TokenIterator tokenizer) Parses true | false | null | integer | float | string| embedded-object | [ ...
void	ElementParser.parse(TokenIterator tokenizer)
void	EmptyArrayParser.parse(TokenIterator tokenizer)
void	FullValueParser.parse(TokenIterator tokenizer) Parses true | false | null | integer | float | string| embedded-object | { ...
void	NullValueParser.parse(TokenIterator tokenizer) Parses nulls.
void	ScalarValueParser.parse(TokenIterator tokenizer) Parses true | false | null | integer | float | string| embedded-object
void	ObjectParser.parse(TokenIterator tokenizer) Parses { ^ ...
void	DummyValueParser.parse(TokenIterator tokenizer)
void	JsonValueParser.parse(TokenIterator tokenizer)
void	ObjectValueParser.parse(TokenIterator tokenizer) Parses { ...
void	JsonValueParser.parseArrayTail(TokenIterator tokenizer)
void	JsonValueParser.parseObjectTail(TokenIterator tokenizer)
boolean	MessageParser.parsePrefix(TokenIterator tokenizer)
boolean	SimpleMessageParser.parsePrefix(TokenIterator tokenizer)
abstract boolean	RootParser.parseRoot(TokenIterator tokenizer) Parse one data object.
boolean	RootParser.RootObjectParser.parseRoot(TokenIterator tokenizer)
boolean	RootParser.RootArrayParser.parseRoot(TokenIterator tokenizer)
boolean	RootParser.EmbeddedArrayParser.parseRoot(TokenIterator tokenizer)
boolean	RootParser.EmbeddedObjectParser.parseRoot(TokenIterator tokenizer)
protected boolean	RootParser.parseRootObject(com.fasterxml.jackson.core.JsonToken token, TokenIterator tokenizer) Parse one data object.
void	MessageParser.parseSuffix(TokenIterator tokenizer)
void	SimpleMessageParser.parseSuffix(TokenIterator tokenizer)
protected void	ArrayValueParser.parseValue(TokenIterator tokenizer)
protected void	ArrayValueParser.LenientArrayValueParser.parseValue(TokenIterator tokenizer)
protected abstract void	ScalarValueParser.parseValue(TokenIterator tokenizer, com.fasterxml.jackson.core.JsonToken token)
void	ScalarValueParser.SimpleValueParser.parseValue(TokenIterator tokenizer, com.fasterxml.jackson.core.JsonToken token)
void	ScalarValueParser.TextValueParser.parseValue(TokenIterator tokenizer, com.fasterxml.jackson.core.JsonToken token)
protected abstract ElementParser	EmptyArrayParser.resolve(TokenIterator tokenizer) Replace this parser with a new parser based on the current parse context.
protected abstract ElementParser	NullValueParser.resolve(TokenIterator tokenizer) Replace this parser with a new parser based on the current parse context.

Constructors in org.apache.drill.exec.store.easy.json.parser with parameters of type TokenIterator

Constructor and Description
ValueDefFactory(TokenIterator tokenizer)

Uses of TokenIterator in org.apache.drill.exec.store.easy.json.values

Methods in org.apache.drill.exec.store.easy.json.values with parameters of type TokenIterator

Modifier and Type	Method and Description
void	BinaryValueListener.onValue(com.fasterxml.jackson.core.JsonToken token, TokenIterator tokenizer)
void	BigIntListener.onValue(com.fasterxml.jackson.core.JsonToken token, TokenIterator tokenizer)
void	BooleanListener.onValue(com.fasterxml.jackson.core.JsonToken token, TokenIterator tokenizer)
void	DateValueListener.onValue(com.fasterxml.jackson.core.JsonToken token, TokenIterator tokenizer)
void	DecimalValueListener.onValue(com.fasterxml.jackson.core.JsonToken token, TokenIterator tokenizer)
void	DoubleListener.onValue(com.fasterxml.jackson.core.JsonToken token, TokenIterator tokenizer)
void	IntervalValueListener.onValue(com.fasterxml.jackson.core.JsonToken token, TokenIterator tokenizer)
void	ScalarListener.onValue(com.fasterxml.jackson.core.JsonToken token, TokenIterator tokenizer)
void	StrictBigIntValueListener.onValue(com.fasterxml.jackson.core.JsonToken token, TokenIterator tokenizer)
void	StrictDoubleValueListener.onValue(com.fasterxml.jackson.core.JsonToken token, TokenIterator tokenizer)
void	StrictIntValueListener.onValue(com.fasterxml.jackson.core.JsonToken token, TokenIterator tokenizer)
void	StrictStringValueListener.onValue(com.fasterxml.jackson.core.JsonToken token, TokenIterator tokenizer)
void	TimeValueListener.onValue(com.fasterxml.jackson.core.JsonToken token, TokenIterator tokenizer)
void	TimestampValueListener.onValue(com.fasterxml.jackson.core.JsonToken token, TokenIterator tokenizer)
void	UtcDateValueListener.onValue(com.fasterxml.jackson.core.JsonToken token, TokenIterator tokenizer)
void	UtcTimestampValueListener.onValue(com.fasterxml.jackson.core.JsonToken token, TokenIterator tokenizer)
void	VarCharListener.onValue(com.fasterxml.jackson.core.JsonToken token, TokenIterator tokenizer)