Package antlr.preprocessor
Class PreprocessorLexer
- java.lang.Object
-
- antlr.CharScanner
-
- antlr.preprocessor.PreprocessorLexer
-
- All Implemented Interfaces:
PreprocessorTokenTypes
,TokenStream
public class PreprocessorLexer extends CharScanner implements PreprocessorTokenTypes, TokenStream
-
-
Field Summary
Fields Modifier and Type Field Description static BitSet
_tokenSet_0
static BitSet
_tokenSet_1
static BitSet
_tokenSet_10
static BitSet
_tokenSet_2
static BitSet
_tokenSet_3
static BitSet
_tokenSet_4
static BitSet
_tokenSet_5
static BitSet
_tokenSet_6
static BitSet
_tokenSet_7
static BitSet
_tokenSet_8
static BitSet
_tokenSet_9
-
Fields inherited from class antlr.CharScanner
_returnToken, caseSensitive, caseSensitiveLiterals, commitToPath, EOF_CHAR, hashString, inputState, literals, saveConsumedInput, tabsize, text, tokenObjectClass, traceDepth
-
Fields inherited from interface antlr.preprocessor.PreprocessorTokenTypes
ACTION, ALT, ARG_ACTION, ASSIGN_RHS, BANG, CHAR_LITERAL, COMMA, COMMENT, CURLY_BLOCK_SCARF, DIGIT, ELEMENT, EOF, ESC, HEADER_ACTION, ID, ID_OR_KEYWORD, LITERAL_catch, LITERAL_class, LITERAL_exception, LITERAL_extends, LITERAL_private, LITERAL_protected, LITERAL_public, LITERAL_returns, LITERAL_throws, LITERAL_tokens, LPAREN, ML_COMMENT, NEWLINE, NULL_TREE_LOOKAHEAD, OPTIONS_START, RCURLY, RPAREN, RULE_BLOCK, SEMI, SL_COMMENT, STRING_LITERAL, SUBRULE_BLOCK, TOKENS_SPEC, WS, XDIGIT
-
-
Constructor Summary
Constructors Constructor Description PreprocessorLexer(InputBuffer ib)
PreprocessorLexer(LexerSharedInputState state)
PreprocessorLexer(java.io.InputStream in)
PreprocessorLexer(java.io.Reader in)
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description void
mACTION(boolean _createToken)
protected void
mALT(boolean _createToken)
void
mARG_ACTION(boolean _createToken)
void
mASSIGN_RHS(boolean _createToken)
void
mBANG(boolean _createToken)
void
mCHAR_LITERAL(boolean _createToken)
void
mCOMMA(boolean _createToken)
void
mCOMMENT(boolean _createToken)
protected void
mCURLY_BLOCK_SCARF(boolean _createToken)
protected void
mDIGIT(boolean _createToken)
protected void
mELEMENT(boolean _createToken)
protected void
mESC(boolean _createToken)
protected void
mID(boolean _createToken)
void
mID_OR_KEYWORD(boolean _createToken)
This rule picks off keywords in the lexer that need to be handled specially.void
mLPAREN(boolean _createToken)
protected void
mML_COMMENT(boolean _createToken)
protected void
mNEWLINE(boolean _createToken)
void
mRCURLY(boolean _createToken)
void
mRPAREN(boolean _createToken)
void
mRULE_BLOCK(boolean _createToken)
void
mSEMI(boolean _createToken)
protected void
mSL_COMMENT(boolean _createToken)
void
mSTRING_LITERAL(boolean _createToken)
void
mSUBRULE_BLOCK(boolean _createToken)
void
mWS(boolean _createToken)
protected void
mXDIGIT(boolean _createToken)
Token
nextToken()
-
Methods inherited from class antlr.CharScanner
append, append, commit, consume, consumeUntil, consumeUntil, getCaseSensitive, getCaseSensitiveLiterals, getColumn, getCommitToPath, getFilename, getInputBuffer, getInputState, getLine, getTabSize, getText, getTokenObject, LA, makeToken, mark, match, match, match, matchNot, matchRange, newline, panic, panic, reportError, reportError, reportWarning, resetText, rewind, setCaseSensitive, setColumn, setCommitToPath, setFilename, setInputState, setLine, setTabSize, setText, setTokenObjectClass, tab, testLiteralsTable, testLiteralsTable, toLower, traceIn, traceIndent, traceOut, uponEOF
-
-
-
-
Field Detail
-
_tokenSet_0
public static final BitSet _tokenSet_0
-
_tokenSet_1
public static final BitSet _tokenSet_1
-
_tokenSet_2
public static final BitSet _tokenSet_2
-
_tokenSet_3
public static final BitSet _tokenSet_3
-
_tokenSet_4
public static final BitSet _tokenSet_4
-
_tokenSet_5
public static final BitSet _tokenSet_5
-
_tokenSet_6
public static final BitSet _tokenSet_6
-
_tokenSet_7
public static final BitSet _tokenSet_7
-
_tokenSet_8
public static final BitSet _tokenSet_8
-
_tokenSet_9
public static final BitSet _tokenSet_9
-
_tokenSet_10
public static final BitSet _tokenSet_10
-
-
Constructor Detail
-
PreprocessorLexer
public PreprocessorLexer(java.io.InputStream in)
-
PreprocessorLexer
public PreprocessorLexer(java.io.Reader in)
-
PreprocessorLexer
public PreprocessorLexer(InputBuffer ib)
-
PreprocessorLexer
public PreprocessorLexer(LexerSharedInputState state)
-
-
Method Detail
-
nextToken
public Token nextToken() throws TokenStreamException
- Specified by:
nextToken
in interfaceTokenStream
- Throws:
TokenStreamException
-
mRULE_BLOCK
public final void mRULE_BLOCK(boolean _createToken) throws RecognitionException, CharStreamException, TokenStreamException
-
mWS
public final void mWS(boolean _createToken) throws RecognitionException, CharStreamException, TokenStreamException
-
mALT
protected final void mALT(boolean _createToken) throws RecognitionException, CharStreamException, TokenStreamException
-
mSUBRULE_BLOCK
public final void mSUBRULE_BLOCK(boolean _createToken) throws RecognitionException, CharStreamException, TokenStreamException
-
mELEMENT
protected final void mELEMENT(boolean _createToken) throws RecognitionException, CharStreamException, TokenStreamException
-
mCOMMENT
public final void mCOMMENT(boolean _createToken) throws RecognitionException, CharStreamException, TokenStreamException
-
mACTION
public final void mACTION(boolean _createToken) throws RecognitionException, CharStreamException, TokenStreamException
-
mSTRING_LITERAL
public final void mSTRING_LITERAL(boolean _createToken) throws RecognitionException, CharStreamException, TokenStreamException
-
mCHAR_LITERAL
public final void mCHAR_LITERAL(boolean _createToken) throws RecognitionException, CharStreamException, TokenStreamException
-
mNEWLINE
protected final void mNEWLINE(boolean _createToken) throws RecognitionException, CharStreamException, TokenStreamException
-
mBANG
public final void mBANG(boolean _createToken) throws RecognitionException, CharStreamException, TokenStreamException
-
mSEMI
public final void mSEMI(boolean _createToken) throws RecognitionException, CharStreamException, TokenStreamException
-
mCOMMA
public final void mCOMMA(boolean _createToken) throws RecognitionException, CharStreamException, TokenStreamException
-
mRCURLY
public final void mRCURLY(boolean _createToken) throws RecognitionException, CharStreamException, TokenStreamException
-
mLPAREN
public final void mLPAREN(boolean _createToken) throws RecognitionException, CharStreamException, TokenStreamException
-
mRPAREN
public final void mRPAREN(boolean _createToken) throws RecognitionException, CharStreamException, TokenStreamException
-
mID_OR_KEYWORD
public final void mID_OR_KEYWORD(boolean _createToken) throws RecognitionException, CharStreamException, TokenStreamException
This rule picks off keywords in the lexer that need to be handled specially. For example, "header" is the start of the header action (used to distinguish between options block and an action). We do not want "header" to go back to the parser as a simple keyword...it must pick off the action afterwards.
-
mID
protected final void mID(boolean _createToken) throws RecognitionException, CharStreamException, TokenStreamException
-
mCURLY_BLOCK_SCARF
protected final void mCURLY_BLOCK_SCARF(boolean _createToken) throws RecognitionException, CharStreamException, TokenStreamException
-
mASSIGN_RHS
public final void mASSIGN_RHS(boolean _createToken) throws RecognitionException, CharStreamException, TokenStreamException
-
mSL_COMMENT
protected final void mSL_COMMENT(boolean _createToken) throws RecognitionException, CharStreamException, TokenStreamException
-
mML_COMMENT
protected final void mML_COMMENT(boolean _createToken) throws RecognitionException, CharStreamException, TokenStreamException
-
mESC
protected final void mESC(boolean _createToken) throws RecognitionException, CharStreamException, TokenStreamException
-
mDIGIT
protected final void mDIGIT(boolean _createToken) throws RecognitionException, CharStreamException, TokenStreamException
-
mXDIGIT
protected final void mXDIGIT(boolean _createToken) throws RecognitionException, CharStreamException, TokenStreamException
-
mARG_ACTION
public final void mARG_ACTION(boolean _createToken) throws RecognitionException, CharStreamException, TokenStreamException
-
-