|
|||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
ObjectTokenStream
TokenFilter
UnicodeNormalizingFilter
public class UnicodeNormalizingFilter
Apply Unicode Normalization to the tokens.
Normalizer
Field Summary | |
---|---|
private FastCache<String,String> |
cache
Keep a cache of lookups performed to-date |
private static int |
CACHE_SIZE
How many recent mappings to maintain |
Fields inherited from class TokenFilter |
---|
input |
Constructor Summary | |
---|---|
UnicodeNormalizingFilter(TokenStream input)
|
Method Summary | |
---|---|
Token |
next()
|
Methods inherited from class TokenFilter |
---|
close |
Methods inherited from class Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Field Detail |
---|
private static final int CACHE_SIZE
private FastCache<String,String> cache
Constructor Detail |
---|
public UnicodeNormalizingFilter(TokenStream input)
Method Detail |
---|
public Token next() throws IOException
next
in class TokenStream
IOException
|
|||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |