oedipus_lex version 2.1.0 has been released!
Published 2014-01-22 @ 14:49
Oedipus Lex is a lexer generator in the same family as Rexical and Rex. Oedipus Lex is my independent lexer fork of Rexical. Rexical was in turn a fork of Rex. We’ve been unable to contact the author of rex in order to take it over, fix it up, extend it, and relicense it to MIT. So, Oedipus was written clean-room in order to bypass licensing constraints (and because bootstrapping is fun).
Oedipus brings a lot of extras to the table and at this point is only historically related to rexical. The syntax has changed enough that any rexical lexer will have to be tweaked to work inside of oedipus. At the very least, you need to add slashes to all your regexps.
Oedipus, like rexical, is based primarily on generating code much like you would a hand-written lexer. It is not a table or hash driven lexer. It use StrScanner within a multi-level case statement. As such, Oedipus matches on the first match, not the longest (like lex and its ilk).
This documentation is not meant to bypass any prerequisite knowledge on lexing or parsing. If you’d like to study the subject in further detail, please try [TIN321] or the [LLVM Tutorial] or some other good resource for CS learning. Books… books are good. I like books.
2.1.0 / 2014-01-22
3 minor enhancements:
- Added lineno and do_parse as options via grammar.
- All options are now opt-in. You might want to add do_parse and lineno to your grammar.
- New option lineno will turn on automatic line number handling at the top of next_token.
- home: http://github.com/seattlerb/oedipus_lex
- rdoc: http://docs.seattlerb.org/oedipus_lex