Developers,
Is it expected for Spans? Can IntervalsQuery help here?
On Wed, Dec 14, 2022 at 5:41 PM Sjoerd Smeets <ssmeets@gmail.com> wrote:
> Hi,
>
> I've implemented a Span Query parser and when running the below query, I'm
> seeing Heap Size Space messages on certain shards:
>
> o.a.s.s.HttpSolrCall null:java.lang.RuntimeException:
> java.lang.OutOfMemoryError: Java heap space
>
> The span query that I'm running is the following:
>
> ((spanNear([unstemmed_text:charge, unstemmed_text:account], 4, false)
> spanNear([unstemmed_text:pledge, unstemmed_text:account], 4, false))
> spanNear([unstemmed_text:pledge, unstemmed_text:deposit], 4, false))
> spanNear([unstemmed_text:charge, unstemmed_text:deposit], 4, false)
>
> The heap size at the moment is set to 48Gb. We are running 4 shards in 1
> JVM and the 4 shards combined have 24M docs evenly distributed across the
> shards. We do use the collapse feature as well.
>
> This is on Solr 8.6.0
>
> What are the considerations for running Span Queries and heap sizes?
>
> Any suggestions are welcome
>
> Sjoerd
>
--
Sincerely yours
Mikhail Khludnev
Is it expected for Spans? Can IntervalsQuery help here?
On Wed, Dec 14, 2022 at 5:41 PM Sjoerd Smeets <ssmeets@gmail.com> wrote:
> Hi,
>
> I've implemented a Span Query parser and when running the below query, I'm
> seeing Heap Size Space messages on certain shards:
>
> o.a.s.s.HttpSolrCall null:java.lang.RuntimeException:
> java.lang.OutOfMemoryError: Java heap space
>
> The span query that I'm running is the following:
>
> ((spanNear([unstemmed_text:charge, unstemmed_text:account], 4, false)
> spanNear([unstemmed_text:pledge, unstemmed_text:account], 4, false))
> spanNear([unstemmed_text:pledge, unstemmed_text:deposit], 4, false))
> spanNear([unstemmed_text:charge, unstemmed_text:deposit], 4, false)
>
> The heap size at the moment is set to 48Gb. We are running 4 shards in 1
> JVM and the 4 shards combined have 24M docs evenly distributed across the
> shards. We do use the collapse feature as well.
>
> This is on Solr 8.6.0
>
> What are the considerations for running Span Queries and heap sizes?
>
> Any suggestions are welcome
>
> Sjoerd
>
--
Sincerely yours
Mikhail Khludnev