Mailing List Archive

Tokenization
Hi All

In Lucene the tokenization of Sentences is happening word wise not
letter wise, So when we search for a letter which contained in a
sentence it will search for a word like the like the letter we entered.
Example : sentence "life is a big stage where we are actors" If I
search for life or any other word lucene seems to be returning correct
results. But if I search for "l" or 's' it will return no results.

I am not sure whether there are any methods which tokenizes the sentence
into letters. If anybody knows please put it in the mailing list

Best wishes
Pradeep



--------------------------------------------------------------
Robosoft Technologies - Partners in Product Development



--
To unsubscribe, e-mail: <mailto:lucene-user-unsubscribe@jakarta.apache.org>
For additional commands, e-mail: <mailto:lucene-user-help@jakarta.apache.org>
Re: Tokenization [ In reply to ]
Using a wildcard search might be useful for you.

So searching for "l*" will find life.

I hope this helps.
--Peter


On 7/8/02 11:39 PM, "Pradeep Kumar K" <pradeepk@robosoftin.com> wrote:

>
> Hi All
>
> In Lucene the tokenization of Sentences is happening word wise not
> letter wise, So when we search for a letter which contained in a
> sentence it will search for a word like the like the letter we entered.
> Example : sentence "life is a big stage where we are actors" If I
> search for life or any other word lucene seems to be returning correct
> results. But if I search for "l" or 's' it will return no results.
>
> I am not sure whether there are any methods which tokenizes the sentence
> into letters. If anybody knows please put it in the mailing list
>
> Best wishes
> Pradeep
>
>
>
> --------------------------------------------------------------
> Robosoft Technologies - Partners in Product Development
>
>
>
> --
> To unsubscribe, e-mail: <mailto:lucene-user-unsubscribe@jakarta.apache.org>
> For additional commands, e-mail: <mailto:lucene-user-help@jakarta.apache.org>
>
>


--
To unsubscribe, e-mail: <mailto:lucene-user-unsubscribe@jakarta.apache.org>
For additional commands, e-mail: <mailto:lucene-user-help@jakarta.apache.org>