Zend Framework
LICENSE
This source file is subject to the new BSD license that is bundled with this package in the file LICENSE.txt. It is also available through the world-wide-web at this URL: http://framework.zend.com/license/new-bsd If you did not receive a copy of the license and are unable to obtain it through the world-wide-web, please send an email to license@zend.com so we can send you a copy immediately.
Common implementation of the Zend_Search_Lucene_Analysis_Analyzer interface.
There are several standard standard subclasses provided by Zend_Search_Lucene/Analysis subpackage: Zend_Search_Lucene_Analysis_Analyzer_Common_Text, ZSearchHTMLAnalyzer, ZSearchXMLAnalyzer.

addFilter(
\Zend_Search_Lucene_Analysis_TokenFilter $filter
)
:
void
Add Token filter to the Analyzer
Inherited from: \Zend_Search_Lucene_Analysis_Analyzer_Common::addFilter()Name | Type | Description |
---|---|---|
$filter | \Zend_Search_Lucene_Analysis_TokenFilter |

getDefault(
)
:
\Zend_Search_Lucene_Analysis_Analyzer
Return the default Analyzer implementation used by indexing code.
Inherited from: \Zend_Search_Lucene_Analysis_Analyzer::getDefault()Type | Description |
---|---|
\Zend_Search_Lucene_Analysis_Analyzer |

nextToken(
)
:
\Zend_Search_Lucene_Analysis_Token|null
Tokenization stream API Get next token Returns null at the end of stream
Inherited from: \Zend_Search_Lucene_Analysis_Analyzer_Common_Text::nextToken()Tokens are returned in UTF-8 (internal Zend_Search_Lucene encoding)
Type | Description |
---|---|
\Zend_Search_Lucene_Analysis_Tokennull |

normalize(
\Zend_Search_Lucene_Analysis_Token $token
)
:
\Zend_Search_Lucene_Analysis_Token
Apply filters to the token. Can return null when the token was removed.
Inherited from: \Zend_Search_Lucene_Analysis_Analyzer_Common::normalize()Name | Type | Description |
---|---|---|
$token | \Zend_Search_Lucene_Analysis_Token |
Type | Description |
---|---|
\Zend_Search_Lucene_Analysis_Token |

reset(
)
:
void
Reset token stream
Inherited from: \Zend_Search_Lucene_Analysis_Analyzer_Common_Text::reset()
setDefault(
$analyzer
)
:
void
Set the default Analyzer implementation used by indexing code.
Inherited from: \Zend_Search_Lucene_Analysis_Analyzer::setDefault()Name | Type | Description |
---|---|---|
$analyzer |

setInput(
string $data, $encoding
)
:
void
Tokenization stream API Set input
Inherited from: \Zend_Search_Lucene_Analysis_Analyzer::setInput()Name | Type | Description |
---|---|---|
$data | string | |
$encoding |

tokenize(
string $data, $encoding
)
:
array
Tokenize text to a terms Returns array of Zend_Search_Lucene_Analysis_Token objects
Inherited from: \Zend_Search_Lucene_Analysis_Analyzer::tokenize()Tokens are returned in UTF-8 (internal Zend_Search_Lucene encoding)
Name | Type | Description |
---|---|---|
$data | string | |
$encoding |
Type | Description |
---|---|
array |