StandardTokenizer Constructor |
Overload List| Name | Description | |
|---|---|---|
 | StandardTokenizer(Version, TextReader) | Creates a new instance of the
StandardTokenizer. Attaches
the input to the newly created JFlex scanner.
|
| StandardTokenizer(Version, AttributeSource, TextReader) | Creates a new StandardTokenizer with a given AttributeSource. |
| StandardTokenizer(Version, AttributeFactory, TextReader) | Creates a new StandardTokenizer with a given
AttributeFactory |
See Also