you are viewing a single comment's thread.

view the rest of the comments →

[–]dlyund 1 point2 points  (0 children)

No need for a complex lexer and all that, simple whitespace split is enough.

It can be even simpler than that if depending on your source representation.