byToken

fnauto byToken(R)(R range) if (is(Unqual!(ElementEncodingType!R) : ubyte) && isDynamicArray!R)

Creates a token range from the given source code. Creates a default lexer configuration and a GC-managed string cache.

fnauto byToken(R)(R range, StringCache * cache) if (is(Unqual!(ElementEncodingType!R) : ubyte) && isDynamicArray!R)

Creates a token range from the given source code. Uses the given string cache.

fnauto byToken(R)(R range, const LexerConfig config, StringCache * cache) if (is(Unqual!(ElementEncodingType!R) : ubyte) && isDynamicArray!R)

Creates a token range from the given source code. Uses the provided lexer configuration and string cache.