Function withoutTokenizer

  • Same as tokenizeText, but doesn't call the potential custom tokenizer of the grammar. This is useful inside a custom tokenizer where tokenizeText can cause infinite recursion.

    Parameters

    • text: string

      A string with the code to be highlighted.

    • grammar: Grammar

      An object containing the tokens to use.

    Returns TokenStream

    See

    tokenize for more info on custom tokenizers.

Generated using TypeDoc