4 commits

Author	SHA1	Message	Date
Emile Clark-Boman	3ce9390be4	Simple (shit) working lexer via nlTokStream ... Currently only tested on strings but its highly extendable if you modify the getTokType mapping of chars to their nlTokType	2025-06-18 01:25:20 +10:00
Emile Clark-Boman	f3c604631b	Moved all lexer functionality to src/noether/lexer	2025-06-17 13:20:33 +10:00
Emile Clark-Boman	dff40e6b27	Added support for various nlTokTypes and added multiple demos	2025-06-17 13:08:21 +10:00
Emile Clark-Boman	9109c4d680	Tokenisation now accessible via the nlTokStream interface ... nlTokStream relies on the functionality of nlLStream	2025-06-17 11:29:31 +10:00