retoor/wren - wren - Reinvent the wheel Inc.

1,561 Commits 1 Branch 0 Tags

3 Commits

Author	SHA1	Message	Date
Aleksander	ef9aca7d42	test: add whitespace tolerance tests for spaces and tabs within code expressions	2015-01-03 14:10:04 +00:00
Aleksander	d67036b95d	fix: extend whitespace skipping in nextToken to handle tabs and add test coverage	2015-01-03 13:57:34 +00:00
Aleksander	4236d1e2de	fix: treat tab character as valid whitespace in tokenizer Add explicit case for '\t' alongside space character in the nextToken function's whitespace-skipping logic. Previously, only spaces were consumed during whitespace skipping, causing tab characters to be incorrectly treated as unexpected tokens. The fix ensures tabs are properly skipped by first matching the tab case and then falling through to the existing space-handling loop.	2015-01-02 22:22:09 +00:00

Author

SHA1

Message

Date

Aleksander

ef9aca7d42

test: add whitespace tolerance tests for spaces and tabs within code expressions

2015-01-03 14:10:04 +00:00

Aleksander

d67036b95d

fix: extend whitespace skipping in nextToken to handle tabs and add test coverage

2015-01-03 13:57:34 +00:00

Aleksander

4236d1e2de

fix: treat tab character as valid whitespace in tokenizer

Add explicit case for '\t' alongside space character in the nextToken function's whitespace-skipping logic. Previously, only spaces were consumed during whitespace skipping, causing tab characters to be incorrectly treated as unexpected tokens. The fix ensures tabs are properly skipped by first matching the tab case and then falling through to the existing space-handling loop.

2015-01-02 22:22:09 +00:00