Uses of Class
org.apache.flex.compiler.internal.parsing.TokenBase

Packages that use TokenBase

Package	Description
org.apache.flex.compiler.internal.parsing	This package is the internal counterpart of the external org.apache.flex.compiler.parsing package.
org.apache.flex.compiler.internal.parsing.as
org.apache.flex.compiler.internal.parsing.mxml
org.apache.flex.compiler.parsing	This package contains classes and interfaces involved in parsing AS and MXML.
org.apache.flex.compiler.problems	This package contains classes representing various problems that can be encountered during compilation.
org.apache.flex.compiler.workspaces	This package contains classes and interface related to workspaces, which cache project-independent information.

Uses of TokenBase in org.apache.flex.compiler.internal.parsing

Methods in org.apache.flex.compiler.internal.parsing with parameters of type TokenBase

Modifier and Type	Method and Description
void	SourceFragmentsReader.adjustLocation(TokenBase token)
boolean	TokenBase.matchesLine(TokenBase other)

Constructors in org.apache.flex.compiler.internal.parsing with parameters of type TokenBase

Constructor and Description
TokenBase(TokenBase o) Copy constructor

Uses of TokenBase in org.apache.flex.compiler.internal.parsing.as

Classes in org.apache.flex.compiler.internal.parsing.as with type parameters of type TokenBase

Modifier and Type	Class and Description
class	BaseRawTokenizer<T extends TokenBase> Base class for JFlex-based tokenizers (RawScriptTokenizer, RawTagTokenizer, RawCSSTokenizer, RawMetadataTokenizer).

Subclasses of TokenBase in org.apache.flex.compiler.internal.parsing.as

Modifier and Type	Class and Description
class	ASDocToken
class	ASToken ActionScript token (output unit of ASTokenizer/ASTokenFixer, input unit of ASTreeAssembler).
class	MetaDataPayloadToken This token represents a valid set of metadata, and includes all of the indivdual tokens that make up that set
class	MetadataToken Metadata token (output unit of MetadataTokenizer, input unit of MetadataParser)

Methods in org.apache.flex.compiler.internal.parsing.as that return TokenBase

Modifier and Type	Method and Description
protected abstract TokenBase	BaseTokenizerWithFakeCharacters.buildToken(int tokenType, int start, int end, int line, int column, String tokenText) Build a token of the appropriate type (used when we need to truncate a token to strip out fake characters in removeFakeTokens)
protected abstract T[]	BaseRawTokenizer.initTokenPool()

Method parameters in org.apache.flex.compiler.internal.parsing.as with type arguments of type TokenBase

Modifier and Type	Method and Description
protected void	BaseTokenizerWithFakeCharacters.removeFakeTokens(int lastRealIndex, List<TokenBase> tokenList) Remove any dummy tokens that we created using the fake characters we appended to the end of the stream.

Constructors in org.apache.flex.compiler.internal.parsing.as with parameters of type TokenBase

Constructor and Description
MetadataToken(TokenBase other)

Uses of TokenBase in org.apache.flex.compiler.internal.parsing.mxml

Subclasses of TokenBase in org.apache.flex.compiler.internal.parsing.mxml

Modifier and Type	Class and Description
class	MXMLToken MXML token (output unit of MXMLTokenizer, input unit of MXMLData constructor).

Uses of TokenBase in org.apache.flex.compiler.parsing

Constructors in org.apache.flex.compiler.parsing with parameters of type TokenBase

Constructor and Description
GenericTokenStream(TokenBase[] tokens) Constructor

Uses of TokenBase in org.apache.flex.compiler.problems

Constructors in org.apache.flex.compiler.problems with parameters of type TokenBase

Constructor and Description
ParserProblem(TokenBase site)
UnboundMetadataProblem(TokenBase site)

Uses of TokenBase in org.apache.flex.compiler.workspaces

Methods in org.apache.flex.compiler.workspaces that return TokenBase

Modifier and Type	Method and Description
TokenBase	IIndexingReader.next() Returns the next TokenBase found by this reader, or null if no more identifiers can be produced