org.apache.flex.compiler.internal.parsing.as

Class StreamingTokenBuffer

java.lang.Object

org.apache.flex.compiler.internal.parsing.as.BaseRepairingTokenBuffer

org.apache.flex.compiler.internal.parsing.as.StreamingTokenBuffer

All Implemented Interfaces:

IRepairingTokenBuffer

public final class StreamingTokenBuffer
extends BaseRepairingTokenBuffer
implements IRepairingTokenBuffer

Buffer used that supports streaming of tokens, instead of a pre-computed list. This token buffer is used by the ActionScript compiler.

Field Summary

Fields inherited from class org.apache.flex.compiler.internal.parsing.as.BaseRepairingTokenBuffer

eofToken, errors, insertSemis, nextIsSemicolon, position, SEMICOLON

Constructor Summary

Constructors

Constructor and Description
StreamingTokenBuffer(StreamingASTokenizer tokens)

Method Summary

Methods

Modifier and Type	Method and Description
void	consume() Consumes the current token in the buffer
String	getSourcePath()
IASToken[]	getTokens(boolean includeInserted)
boolean	insertSemicolon(boolean isNextToken) Inserts a semicolon into the token stream
protected ASToken	lookAheadSkipInsertedSemicolon(int i) Look-ahead "i" tokens and ignore BaseRepairingTokenBuffer.insertSemis flag.
boolean	matchOptionalSemicolon() Match optional semicolon.
ASToken	previous() Returns the previous token the buffer was looking at
void	rewind(int position) Rewinds the token buffer to the given position.

Methods inherited from class org.apache.flex.compiler.internal.parsing.as.BaseRepairingTokenBuffer

addError, LA, lookAheadSkipInsertedSemicolon, LT, mark, onSemicolonInserted, setEnableSemicolonInsertion

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flex.compiler.internal.parsing.as.IRepairingTokenBuffer

addError, LA, lookAheadSkipInsertedSemicolon, LT, mark, setEnableSemicolonInsertion

Constructor Detail

StreamingTokenBuffer

public StreamingTokenBuffer(StreamingASTokenizer tokens)

Method Detail

getSourcePath

public String getSourcePath()

Returns:

Path of the token source.

insertSemicolon

public final boolean insertSemicolon(boolean isNextToken)

Description copied from interface: IRepairingTokenBuffer

Inserts a semicolon into the token stream

Specified by:

insertSemicolon in interface IRepairingTokenBuffer

Parameters:

isNextToken - true if the semicolon should be the next token

Returns:

true if the semicolon was successfully inserted.

rewind

public void rewind(int position)

Description copied from interface: IRepairingTokenBuffer

Rewinds the token buffer to the given position. This is optional

Specified by:

rewind in interface IRepairingTokenBuffer

Parameters:

position - the non-negative position

consume

public final void consume()

Description copied from interface: IRepairingTokenBuffer

Consumes the current token in the buffer

Specified by:

consume in interface IRepairingTokenBuffer

lookAheadSkipInsertedSemicolon

protected ASToken lookAheadSkipInsertedSemicolon(int i)

Description copied from class: BaseRepairingTokenBuffer

Look-ahead "i" tokens and ignore BaseRepairingTokenBuffer.insertSemis flag. Subclasses provide implementations specific to how they access the token buffer.

getTokens

public IASToken[] getTokens(boolean includeInserted)

previous

public ASToken previous()

Description copied from interface: IRepairingTokenBuffer

Returns the previous token the buffer was looking at

Specified by:

previous in interface IRepairingTokenBuffer

Returns:

the previous token, or EOF

matchOptionalSemicolon

public boolean matchOptionalSemicolon()

Match optional semicolon.

This function implements the first 2 optional semicolon insertion rules in the ECMA specification.

Specified by:

matchOptionalSemicolon in interface IRepairingTokenBuffer

Returns:

True if either a semicolon token or a virtual semicolon is matched.

See Also:

"ECMA 2.6.2 Chapter 7.9.1 Rules of Automatic Semicolon Insertion"