Mailing List Archive

[Announce] Apache Solr 4.10 with RankingAlgorithm 1.5.4 available now with complex-lsa algorithm (simulates human language acquisition and recognition)
Hi!

I am very excited to announce the availability of Apache Solr 4.10 with
RankingAlgorithm 1.5.4.

Solr 4.10.0 with RankingAlgorithm 1.5.4 includes support for complex-lsa.
complex-lsa simulates human language acquisition and recognition (see demo
<http://solr-ra.tgels.org/rankingsearchlsa.jsp> ) and can retrieve
semantically related/hidden relationships between terms, sentences,
paragraphs, chapters, books, images, etc. Three new similarities,
TERM_SIMILARITY, DOCUMENT_SIMILARITY, TERM_DOCUMENT_SIMILARITY enable these
with improved precision. A query for “holy AND ghost” returns jesus/christ
as the top results for the bible corpus with no effort to introduce this
relationship (see demo <http://solr-ra.tgels.org/rankingsearchlsa.jsp> ).



This version adds support for multiple linear algebra libraries.
complex-lsa does a large amount of this calcs so speeding this up should
speed up the retrieval etc. EJML is the fastest if you are using complex-lsa
for a smaller set of documents, while MTJ is faster as your document
collection becomes bigger. MTJ can also use BLAS/LAPACK, etc installed on
your system to further improve performance with native execution. The
performance is similar to a C/C++ application. It can also make use of GPUs
or Intel's mkl library if you have access to it.

RankingAlgorithm 1.5.4 with complex-lsa supports the entire Lucene Query
Syntax , ± and/or boolean/dismax/glob/regular
expression/wildcard/fuzzy/prefix/suffix queries with boosting, etc. This
version increases performance, with increased accuracy and relevance for
Document similarity, fixes problems with phrase queries, Boolean queries,
etc.


You can get more information about complex-lsa and realtime-search
performance from here:
http://solr-ra.tgels.org/wiki/en/Complex-lsa-demo

You can download Solr 4.10 with RankingAlgorithm 1.5.4 from here:
http://solr-ra.tgels.org

Please download and give the new version a try.

Regards,

Nagendra Nagarajayya
http://solr-ra.tgels.org
http://elasticsearch-ra.tgels.org
http://rankingalgorithm.tgels.org

Note:
1. Apache Solr 4.10 with RankingAlgorithm 1.5.4 is an external project.
Re: [Announce] Apache Solr 4.10 with RankingAlgorithm 1.5.4 available now with complex-lsa algorithm (simulates human language acquisition and recognition) [ In reply to ]
Interesting. Does anyone know how that compares to this http://www.searchbox.com/products/searchbox-plugins/solr-sense/?

Diego Fernandez - 爱国
Software Engineer
US GSS Supportability - Diagnostics


----- Original Message -----
> Hi!
>
> I am very excited to announce the availability of Apache Solr 4.10 with
> RankingAlgorithm 1.5.4.
>
> Solr 4.10.0 with RankingAlgorithm 1.5.4 includes support for complex-lsa.
> complex-lsa simulates human language acquisition and recognition (see demo
> <http://solr-ra.tgels.org/rankingsearchlsa.jsp> ) and can retrieve
> semantically related/hidden relationships between terms, sentences,
> paragraphs, chapters, books, images, etc. Three new similarities,
> TERM_SIMILARITY, DOCUMENT_SIMILARITY, TERM_DOCUMENT_SIMILARITY enable these
> with improved precision. A query for “holy AND ghost” returns jesus/christ
> as the top results for the bible corpus with no effort to introduce this
> relationship (see demo <http://solr-ra.tgels.org/rankingsearchlsa.jsp> ).
>
>
>
> This version adds support for multiple linear algebra libraries.
> complex-lsa does a large amount of this calcs so speeding this up should
> speed up the retrieval etc. EJML is the fastest if you are using complex-lsa
> for a smaller set of documents, while MTJ is faster as your document
> collection becomes bigger. MTJ can also use BLAS/LAPACK, etc installed on
> your system to further improve performance with native execution. The
> performance is similar to a C/C++ application. It can also make use of GPUs
> or Intel's mkl library if you have access to it.
>
> RankingAlgorithm 1.5.4 with complex-lsa supports the entire Lucene Query
> Syntax , ± and/or boolean/dismax/glob/regular
> expression/wildcard/fuzzy/prefix/suffix queries with boosting, etc. This
> version increases performance, with increased accuracy and relevance for
> Document similarity, fixes problems with phrase queries, Boolean queries,
> etc.
>
>
> You can get more information about complex-lsa and realtime-search
> performance from here:
> http://solr-ra.tgels.org/wiki/en/Complex-lsa-demo
>
> You can download Solr 4.10 with RankingAlgorithm 1.5.4 from here:
> http://solr-ra.tgels.org
>
> Please download and give the new version a try.
>
> Regards,
>
> Nagendra Nagarajayya
> http://solr-ra.tgels.org
> http://elasticsearch-ra.tgels.org
> http://rankingalgorithm.tgels.org
>
> Note:
> 1. Apache Solr 4.10 with RankingAlgorithm 1.5.4 is an external project.
>
>
>
>
RE: [Announce] Apache Solr 4.10 with RankingAlgorithm 1.5.4 available now with complex-lsa algorithm (simulates human language acquisition and recognition) [ In reply to ]
Hi Deigo:

Not sure of solr-sense, but complex-lsa is an enhanced lsa implementation with TERM-DOCUMENT Similarity, etc. (not found in lsa). The relevance/ranking is again different and is more accurate as it uses the RankingAlgorithm scoring model. The query performance gain with this version is significant from the last release, a TERM-SIMILARITY query that used to take about 8-9 seconds now takes just 30ms to 80ms. Lot of performance improvements ...

Warm Regards,

Nagendra Nagarajayya
http://solr-ra.tgels.org
http://elasticsearch-ra.tgels.org
http://rankingalgorithm.tgels.org
(accurate and relevant, simulates human language acquisition and recognition)

-----Original Message-----
From: Diego Fernandez [mailto:difernan@redhat.com]
Sent: Tuesday, September 9, 2014 10:38 AM
To: solr-user@lucene.apache.org
Cc: general@lucene.apache.org
Subject: Re: [Announce] Apache Solr 4.10 with RankingAlgorithm 1.5.4 available now with complex-lsa algorithm (simulates human language acquisition and recognition)

Interesting. Does anyone know how that compares to this http://www.searchbox.com/products/searchbox-plugins/solr-sense/?

Diego Fernandez - 爱国
Software Engineer
US GSS Supportability - Diagnostics


----- Original Message -----
> Hi!
>
> I am very excited to announce the availability of Apache Solr 4.10
> with RankingAlgorithm 1.5.4.
>
> Solr 4.10.0 with RankingAlgorithm 1.5.4 includes support for complex-lsa.
> complex-lsa simulates human language acquisition and recognition (see
> demo <http://solr-ra.tgels.org/rankingsearchlsa.jsp> ) and can
> retrieve semantically related/hidden relationships between terms,
> sentences, paragraphs, chapters, books, images, etc. Three new
> similarities, TERM_SIMILARITY, DOCUMENT_SIMILARITY,
> TERM_DOCUMENT_SIMILARITY enable these with improved precision. A
> query for “holy AND ghost” returns jesus/christ as the top results for
> the bible corpus with no effort to introduce this relationship (see demo <http://solr-ra.tgels.org/rankingsearchlsa.jsp> ).
>
>
>
> This version adds support for multiple linear algebra libraries.
> complex-lsa does a large amount of this calcs so speeding this up
> should speed up the retrieval etc. EJML is the fastest if you are
> using complex-lsa for a smaller set of documents, while MTJ is faster
> as your document collection becomes bigger. MTJ can also use
> BLAS/LAPACK, etc installed on your system to further improve
> performance with native execution. The performance is similar to a
> C/C++ application. It can also make use of GPUs or Intel's mkl library if you have access to it.
>
> RankingAlgorithm 1.5.4 with complex-lsa supports the entire Lucene
> Query Syntax , ± and/or boolean/dismax/glob/regular
> expression/wildcard/fuzzy/prefix/suffix queries with boosting, etc.
> This version increases performance, with increased accuracy and
> relevance for Document similarity, fixes problems with phrase queries,
> Boolean queries, etc.
>
>
> You can get more information about complex-lsa and realtime-search
> performance from here:
> http://solr-ra.tgels.org/wiki/en/Complex-lsa-demo
>
> You can download Solr 4.10 with RankingAlgorithm 1.5.4 from here:
> http://solr-ra.tgels.org
>
> Please download and give the new version a try.
>
> Regards,
>
> Nagendra Nagarajayya
> http://solr-ra.tgels.org
> http://elasticsearch-ra.tgels.org
> http://rankingalgorithm.tgels.org
>
> Note:
> 1. Apache Solr 4.10 with RankingAlgorithm 1.5.4 is an external project.
>
>
>
>