~thon/thon

thon/lex.sml -rw-r--r-- 8.5 KiB
Parse SUCC | LET | CASE | FN
Parse and lex data decl, two param func calls, prod types, unit
Handle consecutive dedents
Refactor getIndentDedentTokens
Handle lexing name at eof
Refactor lexing dedent/indent still doesn't handle empty lines correctly
Print lexing error msg, don't allow indentifiers starting with numberic character
Lex explicit newline tokens
Lex IF | THEN | ELSE | DATA | BAR | CASE | COMMA
Lex let and anon funcs
First lexing regression test and eatKeywordOrName
Fix onKeyword
Lex indent and dedents
Two bugs - getName use isAlphaNum not isWhitespace and handle EOF
eatWord and we're not handling parens in names correctly
lookaheadOnlyN, onKeyword, eatKeyword
Some messy imperative lexing code I'm about to throw away

And also the nice onKeyword func which might be buggy
Next