org.apache.flex.compiler.internal.parsing.as

Class BaseRepairingTokenBuffer

java.lang.Object

org.apache.flex.compiler.internal.parsing.as.BaseRepairingTokenBuffer

All Implemented Interfaces:

IRepairingTokenBuffer

Direct Known Subclasses:

RepairingTokenBuffer, StreamingTokenBuffer

public abstract class BaseRepairingTokenBuffer
extends Object
implements IRepairingTokenBuffer

Base class for repairing token buffers. This handles insertion of semicolons, and also tracks errors.

Field Summary

Fields

Modifier and Type	Field and Description
protected ASToken	eofToken
protected List<SyntaxProblem>	errors
protected boolean	insertSemis
protected boolean	nextIsSemicolon
protected int	position
protected static ASToken	SEMICOLON

Constructor Summary

Constructors

Constructor and Description
BaseRepairingTokenBuffer(String sourcePath)

Method Summary

Methods

Modifier and Type	Method and Description
void	addError(SyntaxProblem error) Adds a syntax error that we encountered during parsing
int	LA(int i) Looks ahead an arbitrary distance and returns back the token type.
ASToken	lookAheadSkipInsertedSemicolon() Get the first non-fix-up-semicolon from the look-ahead.
ASToken	LT(int i) Looks ahead an arbitrary distance and returns back the token.
int	mark() Marks the position in the underlying token buffer.
protected void	onSemicolonInserted() This method is called when an optional semicolon is inserted and is going to be returned as the next token.
void	setEnableSemicolonInsertion(boolean enable) Enables or disables the insertion of semicolons

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flex.compiler.internal.parsing.as.IRepairingTokenBuffer

consume, insertSemicolon, matchOptionalSemicolon, previous, rewind

Field Detail

position

protected int position

eofToken

protected ASToken eofToken

errors

protected final List<SyntaxProblem> errors

nextIsSemicolon

protected boolean nextIsSemicolon

insertSemis

protected boolean insertSemis

SEMICOLON

protected static final ASToken SEMICOLON

Constructor Detail

BaseRepairingTokenBuffer

public BaseRepairingTokenBuffer(String sourcePath)

Method Detail

setEnableSemicolonInsertion

public void setEnableSemicolonInsertion(boolean enable)

Description copied from interface: IRepairingTokenBuffer

Enables or disables the insertion of semicolons

Specified by:

setEnableSemicolonInsertion in interface IRepairingTokenBuffer

Parameters:

enable - true if we should insert semicolons into the token stream

onSemicolonInserted

protected final void onSemicolonInserted()

This method is called when an optional semicolon is inserted and is going to be returned as the next token. It is triggered in IRepairingTokenBuffer.insertSemicolon(boolean).

addError

public void addError(SyntaxProblem error)

Description copied from interface: IRepairingTokenBuffer

Adds a syntax error that we encountered during parsing

Specified by:

addError in interface IRepairingTokenBuffer

Parameters:

error - the SyntaxProblem to add

mark

public final int mark()

Description copied from interface: IRepairingTokenBuffer

Marks the position in the underlying token buffer. Token index starts from 0. If we haven't consumed any token from the buffer, the "mark" will be "0". If the first token in the buffer was just consumed, the "mark" will be "1".

Specified by:

mark in interface IRepairingTokenBuffer

Returns:

Index of the LT(1) token in the buffer.

LT

public ASToken LT(int i)

Description copied from interface: IRepairingTokenBuffer

Looks ahead an arbitrary distance and returns back the token. If no token exists, it will return EOF

Specified by:

LT in interface IRepairingTokenBuffer

Parameters:

i - the offset to look ahead

Returns:

the token, or EOF

lookAheadSkipInsertedSemicolon

public ASToken lookAheadSkipInsertedSemicolon()

Description copied from interface: IRepairingTokenBuffer

Get the first non-fix-up-semicolon from the look-ahead. For example, if the buffer.isNextSemicolon=true and the look-ahead buffer is [A, B, C, ...], LA(1) will return the fix-up semicolon, but this method will return "A". This is useful for error reporting, because we don't want to treat invalid fix-up semicolons as source code errors.

Specified by:

lookAheadSkipInsertedSemicolon in interface IRepairingTokenBuffer

Returns:

The first non-fix-up-semicolon from the look-ahead.

LA

public final int LA(int i)

Description copied from interface: IRepairingTokenBuffer

Looks ahead an arbitrary distance and returns back the token type. If no token exists, it will return EOF

Specified by:

LA in interface IRepairingTokenBuffer

Parameters:

i - the offset to look ahead

Returns:

the token type, or EOF