Tokenizes a chunk and returns a new list of tokens.
public List<AnsiToken> Tokenize(ReadOnlySpan<char> chunk, bool isFinalChunk = true)
The input chunk.
true to flush any unterminated sequence as UnknownEscapeToken;
false to keep the internal state for the next chunk.