Currently only tested on strings but its highly extendable if you modify the getTokType mapping of chars to their nlTokType