Package org.nineml.coffeegrinder.tokens
The token classes.
Tokens are what the parser consumes. Often this is a sequence of characters, but it can also be a sequence of strings or, in fact, arbitrary items.
-
Class Summary Class Description CharacterSet A class that represents a range of Unicode characters.Token An input token.TokenCharacter A single characterToken.TokenCharacterSet A token character set.TokenEOF A token that matches end of file.TokenEPSILON A single characterToken.TokenRegex A regular expression tokenToken.TokenString A stringToken.TokenUndefined A token that can match nothing.