Tokenizer upgrade

[Zaenalos]

The tokenizer needs a heavy upgrade or full rewrite atleast.

The parser is perfectly fine.

I might push a commit if possible.

I made an optimization of the parser using a lookup table with the names of stuff and functions but like yeah the tokenizer is slowwwwwwwww

[Zaenalos]

I made an optimization of the parser using a lookup table with the names of stuff and functions but like yeah the tokenizer is slowwwwwwwww

Rewrite coming in next 2-5 days.

[ericplane]

@Zaenalos Have you made one which can be implemented into this Obfuscator yet? I've been struggling with implementing this version as this Tokenizer weirdly doesn't accept when I use strict types (local int: number = 2) doesn't work for example (With LuaU). Also a lot of the steps in this Obfuscator don't work for LuaU anymore (at least the roblox variant of it)