Mailing List Archive: Another engine

Another engine

Sep 9, 2002, 4:35 PM

Post #1 of 5 (441 views)

Hi.

I like Lucene (THAT'S RIGHT!), but it doesn't offer me all features I
want. That's why I decided to write another JAVA engine. If the features
(see below) are interested for you, and you are a developer, that would
like to help me with the new engine, PLEASE let me know (use my private
mail, I DO NOT WANT TO START A FLAMEWAR HERE, LARBIN IS COOL. Howgh).
Thank you.

I would like to contribute to Lucene project, but I have chosen
different object model for the new engine... :-(

Demo runs here: http://somis4.ais.dundee.ac.uk/sheeef/index.jsp (the
machine indexes *.ac.uk right now, so the speed may be slower if you try
many concurrent queries).

Features:
- extended Boolean model with p-metrics
- index compression via Golomb, Elias-Gamma, and block coding. Better
than Lucene for more than 20-50%. Each inverted list is stored in the
best coding method. The method is selected by "inverted list metadata"
object - it is not hard-coded.
- highly configurable dynamization algorithm - it guarantees a good
response time for query(), insert(), delete() operations (without
degradation of index structure)
- universal stemming technique for almost any language (not used in demo)
- on distributed architecture, insert() would not lock the index
- the engine would be able to simulate Harvest structure of Brokers
- ...

Speed (indexing 2000 HTML documents, without stemming)
Larbin-latest: 1'17"
the engine: 1'22"
[RH73,IBMJDK131+JIT]

Regards,

Leo

--
To unsubscribe, e-mail: <mailto:lucene-dev-unsubscribe@jakarta.apache.org>
For additional commands, e-mail: <mailto:lucene-dev-help@jakarta.apache.org>

Re: Another engine [ In reply to ]

otis_gospodnetic at yahoo

Sep 10, 2002, 6:53 AM

Post #2 of 5 (438 views)

Permalink

Hello,

I like Larbin, too, but that's a web crawler (apples, oranges, bananas)
The demo doesn't seem to work.
I'd be curious to see it when it becomes available.

Otis

--- Leo Galambos <Leo.G@seznam.cz> wrote:
> Hi.
>
> I like Lucene (THAT'S RIGHT!), but it doesn't offer me all features I
>
> want. That's why I decided to write another JAVA engine. If the
> features
> (see below) are interested for you, and you are a developer, that
> would
> like to help me with the new engine, PLEASE let me know (use my
> private
> mail, I DO NOT WANT TO START A FLAMEWAR HERE, LARBIN IS COOL. Howgh).
>
> Thank you.
>
> I would like to contribute to Lucene project, but I have chosen
> different object model for the new engine... :-(
>
> Demo runs here: http://somis4.ais.dundee.ac.uk/sheeef/index.jsp (the
> machine indexes *.ac.uk right now, so the speed may be slower if you
> try
> many concurrent queries).
>
> Features:
> - extended Boolean model with p-metrics
> - index compression via Golomb, Elias-Gamma, and block coding. Better
>
> than Lucene for more than 20-50%. Each inverted list is stored in the
>
> best coding method. The method is selected by "inverted list
> metadata"
> object - it is not hard-coded.
> - highly configurable dynamization algorithm - it guarantees a good
> response time for query(), insert(), delete() operations (without
> degradation of index structure)
> - universal stemming technique for almost any language (not used in
> demo)
> - on distributed architecture, insert() would not lock the index
> - the engine would be able to simulate Harvest structure of Brokers
> - ...
>
> Speed (indexing 2000 HTML documents, without stemming)
> Larbin-latest: 1'17"
> the engine: 1'22"
> [RH73,IBMJDK131+JIT]
>
> Regards,
>
> Leo

__________________________________________________
Yahoo! - We Remember
9-11: A tribute to the more than 3,000 lives lost
http://dir.remember.yahoo.com/tribute

--
To unsubscribe, e-mail: <mailto:lucene-dev-unsubscribe@jakarta.apache.org>
For additional commands, e-mail: <mailto:lucene-dev-help@jakarta.apache.org>

Re: Another engine [ In reply to ]

carlson at bookandhammer

Sep 10, 2002, 8:48 AM

Post #3 of 5 (436 views)

Permalink

My guess is he has created a form letter to try to get Developer
support and is emailing all the developer groups that might have any
similarity. He screwed up and did replace Lucene with Larbin in the
lower sentence.

--Peter

On Tuesday, September 10, 2002, at 06:53 AM, Otis Gospodnetic wrote:

> Hello,
>
> I like Larbin, too, but that's a web crawler (apples, oranges, bananas)
> The demo doesn't seem to work.
> I'd be curious to see it when it becomes available.
>
> Otis
>
> --- Leo Galambos <Leo.G@seznam.cz> wrote:
>> Hi.
>>
>> I like Lucene (THAT'S RIGHT!), but it doesn't offer me all features I
>>
>> want. That's why I decided to write another JAVA engine. If the
>> features
>> (see below) are interested for you, and you are a developer, that
>> would
>> like to help me with the new engine, PLEASE let me know (use my
>> private
>> mail, I DO NOT WANT TO START A FLAMEWAR HERE, LARBIN IS COOL. Howgh).
>>
>> Thank you.
>>
>> I would like to contribute to Lucene project, but I have chosen
>> different object model for the new engine... :-(
>>
>> Demo runs here: http://somis4.ais.dundee.ac.uk/sheeef/index.jsp (the
>> machine indexes *.ac.uk right now, so the speed may be slower if you
>> try
>> many concurrent queries).
>>
>> Features:
>> - extended Boolean model with p-metrics
>> - index compression via Golomb, Elias-Gamma, and block coding. Better
>>
>> than Lucene for more than 20-50%. Each inverted list is stored in the
>>
>> best coding method. The method is selected by "inverted list
>> metadata"
>> object - it is not hard-coded.
>> - highly configurable dynamization algorithm - it guarantees a good
>> response time for query(), insert(), delete() operations (without
>> degradation of index structure)
>> - universal stemming technique for almost any language (not used in
>> demo)
>> - on distributed architecture, insert() would not lock the index
>> - the engine would be able to simulate Harvest structure of Brokers
>> - ...
>>
>> Speed (indexing 2000 HTML documents, without stemming)
>> Larbin-latest: 1'17"
>> the engine: 1'22"
>> [RH73,IBMJDK131+JIT]
>>
>> Regards,
>>
>> Leo
>
>
>
> __________________________________________________
> Yahoo! - We Remember
> 9-11: A tribute to the more than 3,000 lives lost
> http://dir.remember.yahoo.com/tribute
>
> --
> To unsubscribe, e-mail:
> <mailto:lucene-dev-unsubscribe@jakarta.apache.org>
> For additional commands, e-mail:
> <mailto:lucene-dev-help@jakarta.apache.org>
>
>

--
To unsubscribe, e-mail: <mailto:lucene-dev-unsubscribe@jakarta.apache.org>
For additional commands, e-mail: <mailto:lucene-dev-help@jakarta.apache.org>

Re: Another engine [ In reply to ]

Leo.G at seznam

Sep 10, 2002, 3:21 PM

Post #4 of 5 (438 views)

Permalink

Otis Gospodnetic wrote:

>Hello,
>
>I like Larbin, too, but that's a web crawler (apples, oranges, bananas)
>The demo doesn't seem to work.
>I'd be curious to see it when it becomes available.
>
>Otis
>

Hi Otis,

you are right, the system had problems (bug in Tomcat). It would work
now. Backup instance also runs here:
http://com-os2.ms.mff.cuni.cz/sheeef/index.jsp

THX

Leo

BTW: yes, Larbin is a crawler. I was thinking about the indexing process
of ac.uk when I wrote the message. :-) Much work, you know...

--
To unsubscribe, e-mail: <mailto:lucene-dev-unsubscribe@jakarta.apache.org>
For additional commands, e-mail: <mailto:lucene-dev-help@jakarta.apache.org>

Re: Another engine [ In reply to ]

Leo.G at seznam

Sep 10, 2002, 3:35 PM

Post #5 of 5 (437 views)

Permalink

Peter Carlson wrote:

> My guess is he has created a form letter to try to get Developer
> support and is emailing all the developer groups that might have any
> similarity. He screwed up and did replace Lucene with Larbin in the
> lower sentence.
>
> --Peter

No, it is trivial, Dr. Watson, it is trivial (see the previous message
to Otis)... 2U: NO COMMENT. My motto: Your logic is your logic. I have
many problems too.

Developer support? What the hell is that? See this
http://com-os2.ms.mff.cuni.cz/docs/ :-)

Leo

--
To unsubscribe, e-mail: <mailto:lucene-dev-unsubscribe@jakarta.apache.org>
For additional commands, e-mail: <mailto:lucene-dev-help@jakarta.apache.org>