org.apache.lucene.analysis
public abstract class TokenStream extends Object
This is an abstract class. Concrete subclasses are:
Tokenizer
, a TokenStream
whose input is a Reader; and
TokenFilter
, a TokenStream
whose input is another TokenStream.
next()
or next(Token)
.Constructor and Description |
---|
TokenStream() |
Modifier and Type | Method and Description |
---|---|
void |
close()
Releases resources associated with this stream.
|
Token |
next()
Returns the next token in the stream, or null at EOS.
|
Token |
next(Token result)
Returns the next token in the stream, or null at EOS.
|
void |
reset()
Resets this stream to the beginning.
|
public Token next() throws IOException
next(Token)
instead..IOException
public Token next(Token result) throws IOException
This implicitly defines a "contract" between consumers (callers of this method) and producers (implementations of this method that are the source for tokens):
Token.clear()
before setting the fields in it & returning itTokenFilter
is considered a consumer.result
- a Token that may or may not be used to returnIOException
public void reset() throws IOException
IOException
public void close() throws IOException
IOException
Copyright © 2000-2014 Apache Software Foundation. All Rights Reserved.