tokenizeAll
Tokenizes the input and eagerly collects all tokens into an array.
This is useful for testing and debugging. The returned array includes all tokens including comments and the final EOF token.
Parameters
input | The CF source text to tokenize |
filename | Optional filename for error reporting |
Returns
An array of all tokens from the input.