Commit graph

6 commits

Author SHA1 Message Date
a258802945 Begun parser design + typo fixes + improved lexer modularity 2025-06-18 13:35:07 +10:00
90ca138904 Fixed build tokens not unwrapping when both EOL and EOF occur 2025-06-18 02:35:51 +10:00
3ce9390be4 Simple (shit) working lexer via nlTokStream
Currently only tested on strings but its highly extendable if you modify the getTokType mapping of chars to their nlTokType
2025-06-18 01:25:20 +10:00
f3c604631b Moved all lexer functionality to src/noether/lexer 2025-06-17 13:20:33 +10:00
dff40e6b27 Added support for various nlTokTypes and added multiple demos 2025-06-17 13:08:21 +10:00
9109c4d680 Tokenisation now accessible via the nlTokStream interface
nlTokStream relies on the functionality of nlLStream
2025-06-17 11:29:31 +10:00