Conversation

Looks ok I think! Tbh I do prefer separating out the lexing stage, from parsing, even though in PEG you can sometimes get away with smooshing it all together. Not sure if pest supports separate lexers though... 🤔

CAD97

@CAD97_

Oct 5, 2018

Food for thought: A lexerless parser with a discrete set of terminal productions is isomorphic to a pull-lexer parser where you don't tokenize the whole thing first. It's for this reason that I'm less vocal about preferring a separate lexer now. What I want requires pull lexing

Replying to

and

Yeah, I know they are the same, I just prefer the separation of concerns… I'm cool with both phases being pegs though.

5:56 AM · Oct 5, 2018Twitter Web Client