Type alias CustomTokenizer

CustomTokenizer: ((code, grammar) => TokenStream)

Type declaration

- (code, grammar): TokenStream
- A custom tokenizer for a grammar.
  Parameters
  - code: string
    
    A string with the code this grammar needs to tokenize.
  - grammar: Grammar
    
    The grammar with the custom tokenizer
  Returns TokenStream
  A token stream representing the matched code.
  
  See
  tokenize symbol for more info.

Generated using TypeDoc