Token Syntax
Here is the modified BNF syntax for tokens. Tokens (except for <string>) may not contain embedded whitespace.
- alpha-char
- digit
- exponent-char
- guid
- hex-digit
- mantissa
- named-char
- non-negative-integer
- number
- octal-digit
- sign
- string
- string-char
- symbol
- symbol-char
- token