Package org.nineml.coffeegrinder.tokens

package org.nineml.coffeegrinder.tokens

The token classes.

Tokens are what the parser consumes. Often this is a sequence of characters, but it can also be a sequence of strings or, in fact, arbitrary items.

Classes

Class	Description
CharacterSet	A class that represents a range of Unicode characters.
Token	An input token.
TokenCharacter	A single character Token.
TokenCharacterSet	A token character set.
TokenEOF	A token that matches end of file.
TokenEPSILON	A single character Token.
TokenRegex	A regular expression token Token.
TokenString	A string Token.
TokenUndefined	A token that can match nothing.