Uses of Class
org.apache.lucene.analysis.Token

Packages that use Token
org.apache.lucene.analysis API and code to convert text into indexable/searchable tokens. 
org.apache.lucene.analysis.standard A fast grammar-based tokenizer constructed with JFlex. 
 

Uses of Token in org.apache.lucene.analysis
 

Methods in org.apache.lucene.analysis that return Token
 Token Token.clone(char[] newTermBuffer, int newTermOffset, int newTermLength, int newStartOffset, int newEndOffset)
          Makes a clone, but replaces the term buffer & start/end offset in the process.
 Token TokenStream.next()
          Deprecated. The returned Token is a "full private copy" (not re-used across calls to next()) but will be slower than calling TokenStream.next(Token) instead..
 Token CharTokenizer.next(Token reusableToken)
           
 Token CachingTokenFilter.next(Token reusableToken)
           
 Token TeeTokenFilter.next(Token reusableToken)
           
 Token StopFilter.next(Token reusableToken)
          Returns the next input Token whose term() is not a stop word.
 Token SinkTokenizer.next(Token reusableToken)
          Returns the next token out of the list of cached tokens
 Token PorterStemFilter.next(Token reusableToken)
           
 Token LowerCaseFilter.next(Token reusableToken)
           
 Token LengthFilter.next(Token reusableToken)
          Returns the next input Token whose term() is the right len
 Token KeywordTokenizer.next(Token reusableToken)
           
 Token ISOLatin1AccentFilter.next(Token reusableToken)
           
 Token TokenStream.next(Token reusableToken)
          Returns the next token in the stream, or null at EOS.
 Token Token.reinit(char[] newTermBuffer, int newTermOffset, int newTermLength, int newStartOffset, int newEndOffset)
          Shorthand for calling clear(), setTermBuffer(char[], int, int), setStartOffset(int), setEndOffset(int) setType(java.lang.String) on Token.DEFAULT_TYPE
 Token Token.reinit(char[] newTermBuffer, int newTermOffset, int newTermLength, int newStartOffset, int newEndOffset, String newType)
          Shorthand for calling clear(), setTermBuffer(char[], int, int), setStartOffset(int), setEndOffset(int), setType(java.lang.String)
 Token Token.reinit(String newTerm, int newStartOffset, int newEndOffset)
          Shorthand for calling clear(), setTermBuffer(String), setStartOffset(int), setEndOffset(int) setType(java.lang.String) on Token.DEFAULT_TYPE
 Token Token.reinit(String newTerm, int newTermOffset, int newTermLength, int newStartOffset, int newEndOffset)
          Shorthand for calling clear(), setTermBuffer(String, int, int), setStartOffset(int), setEndOffset(int) setType(java.lang.String) on Token.DEFAULT_TYPE
 Token Token.reinit(String newTerm, int newTermOffset, int newTermLength, int newStartOffset, int newEndOffset, String newType)
          Shorthand for calling clear(), setTermBuffer(String, int, int), setStartOffset(int), setEndOffset(int) setType(java.lang.String)
 Token Token.reinit(String newTerm, int newStartOffset, int newEndOffset, String newType)
          Shorthand for calling clear(), setTermBuffer(String), setStartOffset(int), setEndOffset(int) setType(java.lang.String)
 

Methods in org.apache.lucene.analysis with parameters of type Token
 void SinkTokenizer.add(Token t)
          Override this method to cache only certain tokens, or new tokens based on the old tokens.
 Token CharTokenizer.next(Token reusableToken)
           
 Token CachingTokenFilter.next(Token reusableToken)
           
 Token TeeTokenFilter.next(Token reusableToken)
           
 Token StopFilter.next(Token reusableToken)
          Returns the next input Token whose term() is not a stop word.
 Token SinkTokenizer.next(Token reusableToken)
          Returns the next token out of the list of cached tokens
 Token PorterStemFilter.next(Token reusableToken)
           
 Token LowerCaseFilter.next(Token reusableToken)
           
 Token LengthFilter.next(Token reusableToken)
          Returns the next input Token whose term() is the right len
 Token KeywordTokenizer.next(Token reusableToken)
           
 Token ISOLatin1AccentFilter.next(Token reusableToken)
           
 Token TokenStream.next(Token reusableToken)
          Returns the next token in the stream, or null at EOS.
 void Token.reinit(Token prototype)
          Copy the prototype token's fields into this one.
 void Token.reinit(Token prototype, char[] newTermBuffer, int offset, int length)
          Copy the prototype token's fields into this one, with a different term.
 void Token.reinit(Token prototype, String newTerm)
          Copy the prototype token's fields into this one, with a different term.
 

Uses of Token in org.apache.lucene.analysis.standard
 

Methods in org.apache.lucene.analysis.standard that return Token
 Token StandardFilter.next(Token reusableToken)
          Returns the next token in the stream, or null at EOS.
 Token StandardTokenizer.next(Token reusableToken)
           
 

Methods in org.apache.lucene.analysis.standard with parameters of type Token
 Token StandardFilter.next(Token reusableToken)
          Returns the next token in the stream, or null at EOS.
 Token StandardTokenizer.next(Token reusableToken)
           
 



Copyright © 2000-2009 Apache Software Foundation. All Rights Reserved.