Commit Graph
3 Commits
Author SHA1 Message Date
Aleksander ef9aca7d42 test: add whitespace tolerance tests for spaces and tabs within code expressions 2015-01-03 14:10:04 +00:00
Aleksander d67036b95d fix: extend whitespace skipping in nextToken to handle tabs and add test coverage 2015-01-03 13:57:34 +00:00
Aleksander 4236d1e2de fix: treat tab character as valid whitespace in tokenizer
Add explicit case for '\t' alongside space character in the nextToken function's whitespace-skipping logic. Previously, only spaces were consumed during whitespace skipping, causing tab characters to be incorrectly treated as unexpected tokens. The fix ensures tabs are properly skipped by first matching the tab case and then falling through to the existing space-handling loop.
2015-01-02 22:22:09 +00:00