Expand description
CRUDUI expression lexer (expressions.md §1, JS/PHP Lexer parity).
Turns a condition string into a Vec<Token> ending in EOF. WHITESPACE is
consumed but never emitted. The token order, multi-char operator precedence,
multi-dot handling, string escapes, and number rules mirror validator-ts
Lexer exactly, because the shared fixture’s tokens array is byte-compared
across 4 languages.
NO regex-split / no string-split evaluation anywhere (GRAMMAR §10): a single
forward byte scan. Identifiers are ASCII ([A-Za-z_][A-Za-z0-9_]*), so
byte-wise scanning is exact.
Structs§
- Lexer
- Forward-scanning tokenizer over a single expression string.