feat: Implement the Wings tokenizer #4

Merged
glen merged 1 commits from tokenizer into main 2023-09-02 18:13:15 +00:00
Owner

Produces essentially the same token stream as the that found in
x3d_import, except includes comment and whitespace tokens, which
can be ignored in the parser.
Resolves #3.

Produces essentially the same token stream as the that found in x3d_import, except includes comment and whitespace tokens, which can be ignored in the parser. Resolves #3.
glen added 1 commit 2023-09-02 18:13:00 +00:00
Produces essentially the same token stream as the that found in
   x3d_import, except includes comment and whitespace tokens, which
   can be ignored in the parser.
   Resolves #3.
glen merged commit 8186038efb into main 2023-09-02 18:13:15 +00:00
glen deleted branch tokenizer 2023-09-02 18:13:20 +00:00
Sign in to join this conversation.
No description provided.