Bob Nystrom a2c7499e0a fix: add tab character to whitespace skipping in nextToken parser ...

The nextToken function in wren_compiler.c previously only skipped spaces and carriage returns when advancing past whitespace, causing tab characters to be treated as non-whitespace tokens. This change adds '\t' to the whitespace check in both the initial case statement and the peekChar loop, ensuring tabs are properly skipped like other whitespace characters. A new test file test/whitespace.wren is added to verify correct handling of tabs in various indentation patterns and inline code positions.

2015-01-12 04:01:30 +00:00

..

assignment

feat: migrate all function literals from fn syntax to new Fn block syntax

2014-04-03 02:41:53 +00:00

bool

feat: rename IO.write to IO.print and add Unicode escape support in strings

2014-01-05 20:27:12 +00:00

break

feat: add overloaded IO.print methods accepting 2-16 arguments and printList_ helper

2014-04-09 14:48:35 +00:00

class

feat: add overloaded IO.print methods accepting 2-16 arguments and printList_ helper

2014-04-09 14:48:35 +00:00

closure

fix: add null check when walking upvalue list in captureUpvalue

2014-04-25 00:52:53 +00:00

comments

fix: handle empty and comment-only files by removing early skip in repl and compiler

2015-01-04 21:00:53 +00:00

conditional

refactor: move newline handling from lexer into parser grammar rules

2014-04-04 14:51:18 +00:00

constructor

feat: add overloaded IO.print methods accepting 2-16 arguments and printList_ helper

2014-04-09 14:48:35 +00:00

fiber

feat: include method arity in missing method runtime error messages

2015-01-04 19:42:11 +00:00

field

feat: migrate all function literals from fn syntax to new Fn block syntax

2014-04-03 02:41:53 +00:00

for

chore: move truthiness tests from if/ to for/ directory with Iter class

2014-04-19 18:41:21 +00:00

function

feat: add overloaded IO.print methods accepting 2-16 arguments and printList_ helper

2014-04-09 14:48:35 +00:00

if

chore: move truthiness tests from if/ to for/ directory with Iter class

2014-04-19 18:41:21 +00:00

implicit_receiver

feat: require parentheses around operator and setter method parameters in Wren

2014-04-09 00:54:37 +00:00

inheritance

feat: include method arity in missing method runtime error messages

2015-01-04 19:42:11 +00:00

io

fix: guard against non-string toString in IO.print and IO.write

2015-01-08 15:53:37 +00:00

is

refactor: move newline handling from lexer into parser grammar rules

2014-04-04 14:51:18 +00:00

limit

feat: remove semicolon token from lexer and treat it as invalid syntax

2015-01-03 18:02:45 +00:00

list

feat: implement List instantiation via "new" and fix inline functions to static

2014-04-08 14:31:23 +00:00

logical_operator

feat: treat null as falsey in conditional and logical operator branches

2014-01-21 02:12:55 +00:00

method

feat: include method arity in missing method runtime error messages

2015-01-04 19:42:11 +00:00

new

refactor: move newline handling from lexer into parser grammar rules

2014-04-04 14:51:18 +00:00

number

fix: stop lexing negative numbers as single tokens to fix parsing of subtraction

2015-01-09 07:06:50 +00:00

object

feat: add class name storage and expose via name method on class objects

2014-01-28 23:31:11 +00:00

range

feat: migrate all function literals from fn syntax to new Fn block syntax

2014-04-03 02:41:53 +00:00

return

feat: unify block, function, and method body parsing to support single-expression implicit returns

2014-04-03 14:48:19 +00:00

setter

feat: require parentheses around operator and setter method parameters in Wren

2014-04-09 00:54:37 +00:00

shebang

chore: rename test case for invalid shebang to clarify its purpose

2015-01-04 19:09:33 +00:00

static_field

feat: migrate all function literals from fn syntax to new Fn block syntax

2014-04-03 02:41:53 +00:00

string

chore: rename test files to snake_case and update string class docs

2015-01-12 03:13:15 +00:00

super

fix: allow compiler to continue after super used outside method body

2015-01-11 23:43:51 +00:00

this

feat: unify block, function, and method body parsing to support single-expression implicit returns

2014-04-03 14:48:19 +00:00

variable

refactor: move newline handling from lexer into parser grammar rules

2014-04-04 14:51:18 +00:00

while

refactor: move newline handling from lexer into parser grammar rules

2014-04-04 14:51:18 +00:00

empty_block.wren

feat: rename IO.write to IO.print and add Unicode escape support in strings

2014-01-05 20:27:12 +00:00

empty_file.wren

fix: handle empty and comment-only files by removing early skip in repl and compiler

2015-01-04 21:00:53 +00:00

grammar.wren

fix: stop lexing negative numbers as single tokens to fix parsing of subtraction

2015-01-09 07:06:50 +00:00

ignore_carriage_returns.wren

feat: add test verifying carriage returns are treated as whitespace in parser

2015-01-12 03:58:30 +00:00

no_trailing_newline.wren

feat: rename IO.write to IO.print and add Unicode escape support in strings

2014-01-05 20:27:12 +00:00

null_type.wren

feat: rename IO.write to IO.print and add Unicode escape support in strings

2014-01-05 20:27:12 +00:00

null.wren

feat: rename IO.write to IO.print and add Unicode escape support in strings

2014-01-05 20:27:12 +00:00

semicolon.wren

feat: remove semicolon token from lexer and treat it as invalid syntax

2015-01-03 18:02:45 +00:00

unexpected_character.wren

feat: rename IO.write to IO.print and add Unicode escape support in strings

2014-01-05 20:27:12 +00:00

whitespace.wren

test: add whitespace tolerance tests for spaces and tabs within code expressions

2015-01-03 14:10:04 +00:00