retoor/wren
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

feat: remove semicolon token from lexer and treat it as invalid syntax

Browse Source 
Remove the `;` case from the `nextToken` function in `wren_compiler.c` so that semicolons are no longer lexed as `TOKEN_LINE`. Update the documentation in `doc/site/syntax.markdown` to describe newlines as the sole statement separator, and adjust all test files (`test/limit/many_constants.wren`, `test/limit/many_globals.wren`, `test/limit/too_many_constants.wren`, `test/semicolon.wren`) to reflect that semicolons now produce an error instead of being treated as line breaks.
This commit is contained in:
Bob Nystrom
2015-01-03 18:02:45 +00:00
parent 3b63f25690
commit 1951059c8f
6 changed files with 196557 additions and 24585 deletions
Download Patch File Download Diff File Expand all files Collapse all files
test/limit/many_constants.wren
+65535 -8192
View File
File diff suppressed because it is too large Load Diff
test/limit/many_globals.wren
+65472 -8184
View File
File diff suppressed because it is too large Load Diff
test/limit/too_many_constants.wren
+65536 -8192
View File
File diff suppressed because it is too large Load Diff
test/semicolon.wren
+2 -1
View File
@@ -1 +1,2 @@
var a = "ok"; IO.print(a) // expect: ok
// Semicolons are not valid separators.
var a = "ok"; IO.print(a) // expect error