CLucene - a full-featured, c++ search engine
API Documentation


lucene::analysis::Tokenizer Class Reference

A Tokenizer is a TokenStream whose input is a Reader. More...

#include <AnalysisHeader.h>

Inheritance diagram for lucene::analysis::Tokenizer:

lucene::analysis::TokenStream lucene::analysis::CharTokenizer lucene::analysis::KeywordTokenizer lucene::analysis::standard::StandardTokenizer lucene::analysis::LetterTokenizer lucene::analysis::WhitespaceTokenizer lucene::analysis::LowerCaseTokenizer

Public Member Functions

 Tokenizer ()
 Construct a tokenizer with null input.
 Tokenizer (lucene::util::Reader *_input)
 Construct a token stream processing the given input.
virtual void close ()
 Releases resources associated with this stream.
virtual ~Tokenizer ()

Protected Attributes

lucene::util::Readerinput
 The text source for this Tokenizer.

Detailed Description

A Tokenizer is a TokenStream whose input is a Reader.

This is an abstract class.


Constructor & Destructor Documentation

lucene::analysis::Tokenizer::Tokenizer (  ) 

Construct a tokenizer with null input.

lucene::analysis::Tokenizer::Tokenizer ( lucene::util::Reader _input  ) 

Construct a token stream processing the given input.

virtual lucene::analysis::Tokenizer::~Tokenizer (  )  [virtual]


Member Function Documentation

virtual void lucene::analysis::Tokenizer::close (  )  [virtual]

Releases resources associated with this stream.

Implements lucene::analysis::TokenStream.


Field Documentation

lucene:: util ::Reader* lucene::analysis::Tokenizer::input [protected]

The text source for this Tokenizer.


The documentation for this class was generated from the following file:

clucene.sourceforge.net