org.cdlib.xtf.textIndexer
Class StartEndFilter

Object
  extended by TokenStream
      extended by TokenFilter
          extended by StartEndFilter

public class StartEndFilter
extends TokenFilter

Ensures that the tokens at the start and end of the stream are indexed both with and without the special start-of-field/end-of-field markers.

Author:
Martin Haye

Field Summary
private  Token queuedToken
          Token queued for next()
 
Fields inherited from class TokenFilter
input
 
Constructor Summary
StartEndFilter(TokenStream input)
          Construct a token stream that fixes the start/end markers.
 
Method Summary
 Token next()
          Retrieve the next token in the stream.
 
Methods inherited from class TokenFilter
close
 
Methods inherited from class Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Field Detail

queuedToken

private Token queuedToken
Token queued for next()

Constructor Detail

StartEndFilter

public StartEndFilter(TokenStream input)
Construct a token stream that fixes the start/end markers.

Parameters:
input - Input stream of tokens to process
Method Detail

next

public Token next()
           throws IOException
Retrieve the next token in the stream.

Specified by:
next in class TokenStream
Throws:
IOException