Interface GrammarToken

An optional alias. Multiple aliases are separated by spaces.

A property to make the types GrammarToken and RegExp non-overlapping.

Since GrammarToken requires exec to be undefined and RegExp requires it to be a function, there can be no object that is both a GrammarToken and a RegExp.

Whether the token is greedy.

Default

false
Copy

The nested grammar of this token.

The inside grammar will be used to tokenize the text value of each token of this kind.

This can be used to make nested and even recursive language definitions.

Note: This can cause infinite recursion. Be careful when you embed different languages or even the same language into each another.

If true, then the first capturing group of pattern will (effectively) behave as a lookbehind group meaning that the captured text will not be part of the matched text of the new token.

Default

false
Copy

The regular expression of the token.