Implement tokenizer.c containing is_valid_char helper and main function for reading text files, extracting alphanumeric words with dash/underscore support, and tracking word positions, line numbers, and paragraph counts across the input stream.
