A class of error tokens.
A class of error tokens. Error tokens are used to communicate errors detected during lexical analysis
Objects of this type are produced by a lexical parser or scanner, and consumed by a parser.
Objects of this type are produced by a lexical parser or scanner, and consumed by a parser.
A class for end-of-file tokens
This token is produced by a scanner Scanner
when scanning failed.
This component provides the notion of
Token
, the unit of information that is passed from lexical parsers in theLexical
component to the parsers in theTokenParsers
component.