org.apache.lucene.analysis.cn
public final class ChineseTokenizer extends Tokenizer
Constructor and Description |
---|
ChineseTokenizer(Reader in) |
Modifier and Type | Method and Description |
---|---|
Token |
next()
Returns the next token in the stream, or null at EOS.
|
next, reset
public ChineseTokenizer(Reader in)
public final Token next() throws IOException
TokenStream
TokenStream.next(Token)
instead..next
in class TokenStream
IOException
Copyright © 2000-2014 Apache Software Foundation. All Rights Reserved.