Skip to content

tokenizeStrings

tokenizeStrings(tokens, tokenize): void

Defined in: prism/utils/tokenize-strings.js:11

Tokenizes all strings in the token stream with the given tokenization function.

TokenStream

Tokens to mutate.

(code) => TokenStream

Function applied to all strings in the token stream. The token stream returned must have the same text content as the given text.

void