org.apache.flex.compiler.internal.parsing.as

Interface IRepairingTokenBuffer

All Known Implementing Classes:

BaseRepairingTokenBuffer, RepairingTokenBuffer, StreamingTokenBuffer

public interface IRepairingTokenBuffer

Interface for the stream of tokens that will be passed to the parser. This stream will support optional semicolon instructions from the parser

Method Summary

Methods

Modifier and Type	Method and Description
void	addError(SyntaxProblem error) Adds a syntax error that we encountered during parsing
void	consume() Consumes the current token in the buffer
boolean	insertSemicolon(boolean isNextToken) Inserts a semicolon into the token stream
int	LA(int i) Looks ahead an arbitrary distance and returns back the token type.
ASToken	lookAheadSkipInsertedSemicolon() Get the first non-fix-up-semicolon from the look-ahead.
ASToken	LT(int i) Looks ahead an arbitrary distance and returns back the token.
int	mark() Marks the position in the underlying token buffer.
boolean	matchOptionalSemicolon() Match an optional semicolon.
ASToken	previous() Returns the previous token the buffer was looking at
void	rewind(int position) Rewinds the token buffer to the given position.
void	setEnableSemicolonInsertion(boolean enable) Enables or disables the insertion of semicolons

Method Detail

setEnableSemicolonInsertion

void setEnableSemicolonInsertion(boolean enable)

Enables or disables the insertion of semicolons

Parameters:

enable - true if we should insert semicolons into the token stream

insertSemicolon

boolean insertSemicolon(boolean isNextToken)

Inserts a semicolon into the token stream

Parameters:

isNextToken - true if the semicolon should be the next token

Returns:

true if the semicolon was successfully inserted.

addError

void addError(SyntaxProblem error)

Adds a syntax error that we encountered during parsing

Parameters:

error - the SyntaxProblem to add

mark

int mark()

Marks the position in the underlying token buffer. Token index starts from 0. If we haven't consumed any token from the buffer, the "mark" will be "0". If the first token in the buffer was just consumed, the "mark" will be "1".

Returns:

Index of the LT(1) token in the buffer.

rewind

void rewind(int position)

Rewinds the token buffer to the given position. This is optional

Parameters:

position - the non-negative position

consume

void consume()

Consumes the current token in the buffer

LA

int LA(int i)

Looks ahead an arbitrary distance and returns back the token type. If no token exists, it will return EOF

Parameters:

i - the offset to look ahead

Returns:

the token type, or EOF

LT

ASToken LT(int i)

Looks ahead an arbitrary distance and returns back the token. If no token exists, it will return EOF

Parameters:

i - the offset to look ahead

Returns:

the token, or EOF

lookAheadSkipInsertedSemicolon

ASToken lookAheadSkipInsertedSemicolon()

Get the first non-fix-up-semicolon from the look-ahead. For example, if the buffer.isNextSemicolon=true and the look-ahead buffer is [A, B, C, ...], LA(1) will return the fix-up semicolon, but this method will return "A". This is useful for error reporting, because we don't want to treat invalid fix-up semicolons as source code errors.

Returns:

The first non-fix-up-semicolon from the look-ahead.

previous

ASToken previous()

Returns the previous token the buffer was looking at

Returns:

the previous token, or EOF

matchOptionalSemicolon

boolean matchOptionalSemicolon()

Match an optional semicolon.

Returns:

True if either a semicolon token or a virtual semicolon is matched.