Standard
|
| Name | Description | |
|---|---|---|
|
|
StandardTokenizer(Version, TextReader) | Creates a new instance of the StandardTokenizer. Attaches the input to the newly created JFlex scanner. |
|
|
StandardTokenizer(Version, AttributeSource, TextReader) | Creates a new StandardTokenizer with a given AttributeSource. |
|
|
StandardTokenizer(Version, AttributeFactory, TextReader) | Creates a new StandardTokenizer with a given AttributeFactory |