org.apache.lucene.analysis.cjk
public final class CJKTokenizer extends Tokenizer
Constructor and Description |
---|
CJKTokenizer(Reader in)
Construct a token stream processing the given input.
|
Modifier and Type | Method and Description |
---|---|
Token |
next()
Returns the next token in the stream, or null at EOS.
|
next, reset
public CJKTokenizer(Reader in)
in
- I/O readerpublic final Token next() throws IOException
next
in class TokenStream
IOException
- - throw IOException when read error Copyright © 2000-2014 Apache Software Foundation. All Rights Reserved.