Realized for the first time tonight that C++ keywords aren't actually "tokens" in the same way that all the rest of the tokens are...
They aren't matched prior to identifier maximum munch. Which I guess you could say is still "the same"...
-
-
... but, eg., the string "<<9" is the same as "<< 9", but "do9" is not the same as "do 9".
-
well, that seems to be pretty normal behavior. '<<' is a token in its own right and do9 is an identifier ([a-zA-Z0-9...])
- Show replies
New conversation -
-
-
tokenisation step is normally before parsing. Some tokens are reserved as keywords only some can be used as identifiers.
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.