tokenize

fnCfLexer tokenize(string input, string filename = "") @safe pure

Creates a lexer as an input range for the given CF source.

Parameters

inputThe CF source text to tokenize
filenameOptional filename for error reporting

Returns

A CfLexer for the input.