|
||||||||||
| PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
| SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD | |||||||||
java.lang.Objectorg.apache.lucene.util.AttributeSource
org.apache.lucene.analysis.TokenStream
org.apache.lucene.analysis.TokenFilter
org.apache.mahout.utils.nlp.collocations.llr.BloomTokenFilter
public final class BloomTokenFilter
Emits tokens based on bloom filter membership.
| Nested Class Summary |
|---|
| Nested classes/interfaces inherited from class org.apache.lucene.util.AttributeSource |
|---|
org.apache.lucene.util.AttributeSource.AttributeFactory, org.apache.lucene.util.AttributeSource.State |
| Field Summary |
|---|
| Fields inherited from class org.apache.lucene.analysis.TokenFilter |
|---|
input |
| Constructor Summary | |
|---|---|
BloomTokenFilter(org.apache.hadoop.util.bloom.Filter filter,
boolean keepMembers,
org.apache.lucene.analysis.TokenStream in)
|
|
| Method Summary | |
|---|---|
boolean |
incrementToken()
|
| Methods inherited from class org.apache.lucene.analysis.TokenFilter |
|---|
close, end, reset |
| Methods inherited from class org.apache.lucene.util.AttributeSource |
|---|
addAttribute, addAttributeImpl, captureState, clearAttributes, cloneAttributes, copyTo, equals, getAttribute, getAttributeClassesIterator, getAttributeFactory, getAttributeImplsIterator, hasAttribute, hasAttributes, hashCode, reflectAsString, reflectWith, restoreState, toString |
| Methods inherited from class java.lang.Object |
|---|
clone, finalize, getClass, notify, notifyAll, wait, wait, wait |
| Constructor Detail |
|---|
public BloomTokenFilter(org.apache.hadoop.util.bloom.Filter filter,
boolean keepMembers,
org.apache.lucene.analysis.TokenStream in)
filter - tokens will be checked for membership in this bloom filterin - the tokenstream to read.keepMembers - keep memoers of the bloom filter? If true works like
a whitelist and members found in the list are kept and all others are
dropped. If false works like a stoplist and members found in the
filter are dropped all others are kept.| Method Detail |
|---|
public boolean incrementToken()
throws IOException
incrementToken in class org.apache.lucene.analysis.TokenStreamIOException
|
||||||||||
| PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
| SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD | |||||||||