CLucene - a full-featured, c++ search engine
API Documentation
#include <Analyzers.h>
Public Member Functions | |
WhitespaceAnalyzer () | |
TokenStream * | tokenStream (const TCHAR *fieldName, lucene::util::Reader *reader) |
Creates a TokenStream which tokenizes all the text in the provided Reader. | |
virtual | ~WhitespaceAnalyzer () |
lucene::analysis::WhitespaceAnalyzer::WhitespaceAnalyzer | ( | ) |
virtual lucene::analysis::WhitespaceAnalyzer::~WhitespaceAnalyzer | ( | ) | [virtual] |
TokenStream* lucene::analysis::WhitespaceAnalyzer::tokenStream | ( | const TCHAR * | fieldName, | |
lucene::util::Reader * | reader | |||
) | [virtual] |
Creates a TokenStream which tokenizes all the text in the provided Reader.
Default implementation forwards to tokenStream(Reader) for compatibility with older version. Override to allow Analyzer to choose strategy based on document and/or field. Must be able to handle null field name for backward compatibility.
Implements lucene::analysis::Analyzer.