CLucene - a full-featured, c++ search engine
API Documentation
#include <AnalysisHeader.h>
Public Member Functions | |
Tokenizer () | |
Construct a tokenizer with null input. | |
Tokenizer (lucene::util::Reader *_input) | |
Construct a token stream processing the given input. | |
virtual void | close () |
Releases resources associated with this stream. | |
virtual | ~Tokenizer () |
Protected Attributes | |
lucene::util::Reader * | input |
The text source for this Tokenizer. |
This is an abstract class.
lucene::analysis::Tokenizer::Tokenizer | ( | ) |
Construct a tokenizer with null input.
lucene::analysis::Tokenizer::Tokenizer | ( | lucene::util::Reader * | _input | ) |
Construct a token stream processing the given input.
virtual lucene::analysis::Tokenizer::~Tokenizer | ( | ) | [virtual] |
virtual void lucene::analysis::Tokenizer::close | ( | ) | [virtual] |
lucene:: util ::Reader* lucene::analysis::Tokenizer::input [protected] |
The text source for this Tokenizer.