Lexer - o2bblockbusting/cs421_project GitHub Wiki
How does the Lexer work?
The lexer is written in Java and is able to convert the input program into a list of tokens. The full token list can be found here. Since most tokens are only a single character, the lexer can convert characters into tokens using a hashmap. For longer tokens, a series of regular expressions are used to match and remove those characters.