feat: Implement the Wings tokenizer #4

Merged
glen merged 1 commits from tokenizer into main 2023-09-02 18:13:15 +00:00

1 Commits

Author SHA1 Message Date
252ed45cab feat: Implement the Wings tokenizer
Produces essentially the same token stream as the that found in
   x3d_import, except includes comment and whitespace tokens, which
   can be ignored in the parser.
   Resolves #3.
2023-09-02 11:06:25 -07:00