Same as tokenizeText, but doesn't call the potential custom tokenizer of the grammar. This is useful inside a custom tokenizer where tokenizeText can cause infinite recursion.
A string with the code to be highlighted.
An object containing the tokens to use.
tokenize for more info on custom tokenizers.
Generated using TypeDoc
Same as tokenizeText, but doesn't call the potential custom tokenizer of the grammar. This is useful inside a custom tokenizer where tokenizeText can cause infinite recursion.