Implement a new tokenizer.py file that provides core tokenization functionality including whitespace splitting, punctuation handling, and vocabulary construction from input text.
