Mailing List Archive

Lucene 9.7 release
Hello all,

There is some good stuff that is scheduled for 9.7 already, I found the
following changes in the changelog that look especially interesting:
- Concurrent query rewrites for vector queries.
- Speedups to vector indexing/search via integration of the Panama vector
API.
- Reduced overhead of soft deletes.
- Support for update by query.

I propose we start the process for a 9.7 release, and I volunteer to be the
release manager. I suggest the following schedule:
- Feature freeze on June 16th, one week from now. This is when the 9.7
branch will be cut.
- Open a vote on June 21st, which we'll possibly delay if blockers get
identified.

--
Adrien
Re: Lucene 9.7 release [ In reply to ]
+1, thank you Adrien!

On Fri, Jun 9, 2023, 09:08 Adrien Grand <jpountz@gmail.com> wrote:

> Hello all,
>
> There is some good stuff that is scheduled for 9.7 already, I found the
> following changes in the changelog that look especially interesting:
> - Concurrent query rewrites for vector queries.
> - Speedups to vector indexing/search via integration of the Panama vector
> API.
> - Reduced overhead of soft deletes.
> - Support for update by query.
>
> I propose we start the process for a 9.7 release, and I volunteer to be
> the release manager. I suggest the following schedule:
> - Feature freeze on June 16th, one week from now. This is when the 9.7
> branch will be cut.
> - Open a vote on June 21st, which we'll possibly delay if blockers get
> identified.
>
> --
> Adrien
>
Re: Lucene 9.7 release [ In reply to ]
+1, thanks Adrien!

Mike McCandless

http://blog.mikemccandless.com


On Fri, Jun 9, 2023 at 12:11?PM Patrick Zhai <zhai7631@gmail.com> wrote:

> +1, thank you Adrien!
>
> On Fri, Jun 9, 2023, 09:08 Adrien Grand <jpountz@gmail.com> wrote:
>
>> Hello all,
>>
>> There is some good stuff that is scheduled for 9.7 already, I found the
>> following changes in the changelog that look especially interesting:
>> - Concurrent query rewrites for vector queries.
>> - Speedups to vector indexing/search via integration of the Panama
>> vector API.
>> - Reduced overhead of soft deletes.
>> - Support for update by query.
>>
>> I propose we start the process for a 9.7 release, and I volunteer to be
>> the release manager. I suggest the following schedule:
>> - Feature freeze on June 16th, one week from now. This is when the 9.7
>> branch will be cut.
>> - Open a vote on June 21st, which we'll possibly delay if blockers get
>> identified.
>>
>> --
>> Adrien
>>
>
Re: Lucene 9.7 release [ In reply to ]
Hi,

if possible I would like to get the Java 21 changes (MemorySegments and
Vector) into the release. I'd like to ask Chris who has better knowledge
how to proceed. If he suggests to wait maybe a week or 2, I'd suggest to
wait that time.

Chris Hegarthy: Do you know if the API of JDK 21 is finalized or not.
From my understanding the final phases have started, so API changes are
unlikely. If there are bug fixes they won't affect public APIs or the
incubator module, right?

The MMapDir changes are already tested all the time, vector API needs
the forward port to 21.

Uwe

Am 09.06.2023 um 18:07 schrieb Adrien Grand:
> Hello all,
>
> There is some good stuff that is scheduled for 9.7 already, I found
> the following changes in the changelog that look especially interesting:
>  - Concurrent query rewrites for vector queries.
>  - Speedups to vector indexing/search via integration of the Panama
> vector API.
>  - Reduced overhead of soft deletes.
>  - Support for update by query.
>
> I propose we start the process for a 9.7 release, and I volunteer to
> be the release manager. I suggest the following schedule:
>  - Feature freeze on June 16th, one week from now. This is when the
> 9.7 branch will be cut.
>  - Open a vote on June 21st, which we'll possibly delay if blockers
> get identified.
>
> --
> Adrien

--
Uwe Schindler
Achterdiek 19, D-28357 Bremen
https://www.thetaphi.de
eMail:uwe@thetaphi.de
Re: Lucene 9.7 release [ In reply to ]
+1
Thanks Adrien

On Fri, Jun 9, 2023 at 9:19?AM Michael McCandless <lucene@mikemccandless.com>
wrote:

> +1, thanks Adrien!
>
> Mike McCandless
>
> http://blog.mikemccandless.com
>
>
> On Fri, Jun 9, 2023 at 12:11?PM Patrick Zhai <zhai7631@gmail.com> wrote:
>
>> +1, thank you Adrien!
>>
>> On Fri, Jun 9, 2023, 09:08 Adrien Grand <jpountz@gmail.com> wrote:
>>
>>> Hello all,
>>>
>>> There is some good stuff that is scheduled for 9.7 already, I found the
>>> following changes in the changelog that look especially interesting:
>>> - Concurrent query rewrites for vector queries.
>>> - Speedups to vector indexing/search via integration of the Panama
>>> vector API.
>>> - Reduced overhead of soft deletes.
>>> - Support for update by query.
>>>
>>> I propose we start the process for a 9.7 release, and I volunteer to be
>>> the release manager. I suggest the following schedule:
>>> - Feature freeze on June 16th, one week from now. This is when the 9.7
>>> branch will be cut.
>>> - Open a vote on June 21st, which we'll possibly delay if blockers get
>>> identified.
>>>
>>> --
>>> Adrien
>>>
>>
Re: Lucene 9.7 release [ In reply to ]
+1

On Fri, Jun 9, 2023 at 6:20?PM Tomás Fernández Löbbe <tomasflobbe@gmail.com>
wrote:

> +1
> Thanks Adrien
>
> On Fri, Jun 9, 2023 at 9:19?AM Michael McCandless <
> lucene@mikemccandless.com> wrote:
>
>> +1, thanks Adrien!
>>
>> Mike McCandless
>>
>> http://blog.mikemccandless.com
>>
>>
>> On Fri, Jun 9, 2023 at 12:11?PM Patrick Zhai <zhai7631@gmail.com> wrote:
>>
>>> +1, thank you Adrien!
>>>
>>> On Fri, Jun 9, 2023, 09:08 Adrien Grand <jpountz@gmail.com> wrote:
>>>
>>>> Hello all,
>>>>
>>>> There is some good stuff that is scheduled for 9.7 already, I found the
>>>> following changes in the changelog that look especially interesting:
>>>> - Concurrent query rewrites for vector queries.
>>>> - Speedups to vector indexing/search via integration of the Panama
>>>> vector API.
>>>> - Reduced overhead of soft deletes.
>>>> - Support for update by query.
>>>>
>>>> I propose we start the process for a 9.7 release, and I volunteer to be
>>>> the release manager. I suggest the following schedule:
>>>> - Feature freeze on June 16th, one week from now. This is when the 9.7
>>>> branch will be cut.
>>>> - Open a vote on June 21st, which we'll possibly delay if blockers get
>>>> identified.
>>>>
>>>> --
>>>> Adrien
>>>>
>>>
Re: Lucene 9.7 release [ In reply to ]
Thank you very much, Adrien!

Am 09.06.23 um 18:20 schrieb Tomás Fernández Löbbe:
> +1
> Thanks Adrien
>
> On Fri, Jun 9, 2023 at 9:19?AM Michael McCandless
> <lucene@mikemccandless.com> wrote:
>
> +1, thanks Adrien!
>
> Mike McCandless
>
> http://blog.mikemccandless.com
>
>
> On Fri, Jun 9, 2023 at 12:11?PM Patrick Zhai <zhai7631@gmail.com>
> wrote:
>
> +1, thank you Adrien!
>
> On Fri, Jun 9, 2023, 09:08 Adrien Grand <jpountz@gmail.com> wrote:
>
> Hello all,
>
> There is some good stuff that is scheduled for 9.7
> already, I found the following changes in the changelog
> that look especially interesting:
>  - Concurrent query rewrites for vector queries.
>  - Speedups to vector indexing/search via integration of
> the Panama vector API.
>  - Reduced overhead of soft deletes.
>  - Support for update by query.
>
> I propose we start the process for a 9.7 release, and I
> volunteer to be the release manager. I suggest the
> following schedule:
>  - Feature freeze on June 16th, one week from now. This is
> when the 9.7 branch will be cut.
>  - Open a vote on June 21st, which we'll possibly delay if
> blockers get identified.
>
> --
> Adrien
>
Re: Lucene 9.7 release [ In reply to ]
Hi,

> On 9 Jun 2023, at 17:19, Uwe Schindler <uwe@thetaphi.de> wrote:
>
> Hi,
>
> if possible I would like to get the Java 21 changes (MemorySegments and Vector) into the release. I'd like to ask Chris who has better knowledge how to proceed. If he suggests to wait maybe a week or 2, I'd suggest to wait that time.
>
> Chris Hegarthy: Do you know if the API of JDK 21 is finalized or not. From my understanding the final phases have started, so API changes are unlikely. If there are bug fixes they won't affect public APIs or the incubator module, right?
>
Your understanding is correct. I do not expect any API changes at this point.
> The MMapDir changes are already tested all the time, vector API needs the forward port to 21.
>
We are also doing some early testing with JDK 21 EA, and it would be great to get the 21-version of Panama VectorUtils in. I can help get this done.

Uwe, what has been done so far? If nothing, as that is still the case tomorrow, I can start on it.

-Chris.

> Uwe
>
> Am 09.06.2023 um 18:07 schrieb Adrien Grand:
>> Hello all,
>>
>> There is some good stuff that is scheduled for 9.7 already, I found the following changes in the changelog that look especially interesting:
>> - Concurrent query rewrites for vector queries.
>> - Speedups to vector indexing/search via integration of the Panama vector API.
>> - Reduced overhead of soft deletes.
>> - Support for update by query.
>>
>> I propose we start the process for a 9.7 release, and I volunteer to be the release manager. I suggest the following schedule:
>> - Feature freeze on June 16th, one week from now. This is when the 9.7 branch will be cut.
>> - Open a vote on June 21st, which we'll possibly delay if blockers get identified.
>>
>> --
>> Adrien
> --
> Uwe Schindler
> Achterdiek 19, D-28357 Bremen
> https://www.thetaphi.de <https://www.thetaphi.de/>
> eMail: uwe@thetaphi.de <mailto:uwe@thetaphi.de>
Re: Lucene 9.7 release [ In reply to ]
Let me merge and backport the java 21 map PR first. It has all new source directories and APIJAR files.

For safety I will regenerate the 21 APIJAR with newest jdk build. Fyi, to regenerate you need to have an environment variable with jdk21 as autoprovisioning doesn't work.

After that we can copy-paste the vector impl to the main/java21 folder and add vector classes to it.

Uwe

Am 9. Juni 2023 22:30:09 MESZ schrieb Chris Hegarty <christopher.hegarty@elastic.co.INVALID>:
>Hi,
>
>> On 9 Jun 2023, at 17:19, Uwe Schindler <uwe@thetaphi.de> wrote:
>>
>> Hi,
>>
>> if possible I would like to get the Java 21 changes (MemorySegments and Vector) into the release. I'd like to ask Chris who has better knowledge how to proceed. If he suggests to wait maybe a week or 2, I'd suggest to wait that time.
>>
>> Chris Hegarthy: Do you know if the API of JDK 21 is finalized or not. From my understanding the final phases have started, so API changes are unlikely. If there are bug fixes they won't affect public APIs or the incubator module, right?
>>
>Your understanding is correct. I do not expect any API changes at this point.
>> The MMapDir changes are already tested all the time, vector API needs the forward port to 21.
>>
>We are also doing some early testing with JDK 21 EA, and it would be great to get the 21-version of Panama VectorUtils in. I can help get this done.
>
>Uwe, what has been done so far? If nothing, as that is still the case tomorrow, I can start on it.
>
>-Chris.
>
>> Uwe
>>
>> Am 09.06.2023 um 18:07 schrieb Adrien Grand:
>>> Hello all,
>>>
>>> There is some good stuff that is scheduled for 9.7 already, I found the following changes in the changelog that look especially interesting:
>>> - Concurrent query rewrites for vector queries.
>>> - Speedups to vector indexing/search via integration of the Panama vector API.
>>> - Reduced overhead of soft deletes.
>>> - Support for update by query.
>>>
>>> I propose we start the process for a 9.7 release, and I volunteer to be the release manager. I suggest the following schedule:
>>> - Feature freeze on June 16th, one week from now. This is when the 9.7 branch will be cut.
>>> - Open a vote on June 21st, which we'll possibly delay if blockers get identified.
>>>
>>> --
>>> Adrien
>> --
>> Uwe Schindler
>> Achterdiek 19, D-28357 Bremen
>> https://www.thetaphi.de <https://www.thetaphi.de/>
>> eMail: uwe@thetaphi.de <mailto:uwe@thetaphi.de>

--
Uwe Schindler
Achterdiek 19, 28357 Bremen
https://www.thetaphi.de
Re: Lucene 9.7 release [ In reply to ]
Hi,

BTW, there was a slight change in APIJARs caused by this API change:
https://github.com/openjdk/jdk/commit/5fc9b5787dc4d7f00d2c59288bc8d840fdf5b495
(this does not affect our code, but it was done 3 weeks ago). I hope
something like this won't happen. I updated the PR, no code changes
needed as those methods were not used by Lucene.

I'd like to update the APIJARS again shortly before the feature branch
is created.

Uwe

Am 09.06.2023 um 23:10 schrieb Uwe Schindler:
> Let me merge and backport the java 21 map PR first. It has all new
> source directories and APIJAR files.
>
> For safety I will regenerate the 21 APIJAR with newest jdk build. Fyi,
> to regenerate you need to have an environment variable with jdk21 as
> autoprovisioning doesn't work.
>
> After that we can copy-paste the vector impl to the main/java21 folder
> and add vector classes to it.
>
> Uwe
>
>
> Am 9. Juni 2023 22:30:09 MESZ schrieb Chris Hegarty
> <christopher.hegarty@elastic.co.INVALID>:
>
> Hi,
>
>> On 9 Jun 2023, at 17:19, Uwe Schindler <uwe@thetaphi.de> wrote:
>>
>> Hi,
>>
>> if possible I would like to get the Java 21 changes
>> (MemorySegments and Vector) into the release. I'd like to ask
>> Chris who has better knowledge how to proceed. If he suggests to
>> wait maybe a week or 2, I'd suggest to wait that time.
>>
>> Chris Hegarthy: Do you know if the API of JDK 21 is finalized or
>> not. From my understanding the final phases have started, so API
>> changes are unlikely. If there are bug fixes they won't affect
>> public APIs or the incubator module, right?
>>
> Your understanding is correct. I do not expect any API changes at
> this point.
>>
>> The MMapDir changes are already tested all the time, vector API
>> needs the forward port to 21.
>>
> We are also doing some early testing with JDK 21 EA, and it would
> be great to get the 21-version of Panama VectorUtils in. I can
> help get this done.
>
> Uwe, what has been done so far? If nothing, as that is still the
> case tomorrow, I can start on it.
>
> -Chris.
>
>> Uwe
>>
>> Am 09.06.2023 um 18:07 schrieb Adrien Grand:
>>> Hello all,
>>>
>>> There is some good stuff that is scheduled for 9.7 already, I
>>> found the following changes in the changelog that look
>>> especially interesting:
>>>  - Concurrent query rewrites for vector queries.
>>>  - Speedups to vector indexing/search via integration of the
>>> Panama vector API.
>>>  - Reduced overhead of soft deletes.
>>>  - Support for update by query.
>>>
>>> I propose we start the process for a 9.7 release, and I
>>> volunteer to be the release manager. I suggest the following
>>> schedule:
>>>  - Feature freeze on June 16th, one week from now. This is when
>>> the 9.7 branch will be cut.
>>>  - Open a vote on June 21st, which we'll possibly delay if
>>> blockers get identified.
>>>
>>> --
>>> Adrien
>> --
>> Uwe Schindler
>> Achterdiek 19, D-28357 Bremen
>> https://www.thetaphi.de
>> eMail:uwe@thetaphi.de
>
> --
> Uwe Schindler
> Achterdiek 19, 28357 Bremen
> https://www.thetaphi.de

--
Uwe Schindler
Achterdiek 19, D-28357 Bremen
https://www.thetaphi.de
eMail:uwe@thetaphi.de
Re: Lucene 9.7 release [ In reply to ]
Hi,
we are finalizing https://github.com/apache/lucene/pull/12253, we got some
last-minute valuable review comments and we would like to apply the
suggestions and bring them in 9.x .
Cheers
--------------------------
*Alessandro Benedetti*
Director @ Sease Ltd.
*Apache Lucene/Solr Committer*
*Apache Solr PMC Member*

e-mail: a.benedetti@sease.io


*Sease* - Information Retrieval Applied
Consulting | Training | Open Source

Website: Sease.io <http://sease.io/>
LinkedIn <https://linkedin.com/company/sease-ltd> | Twitter
<https://twitter.com/seaseltd> | Youtube
<https://www.youtube.com/channel/UCDx86ZKLYNpI3gzMercM7BQ> | Github
<https://github.com/seaseltd>


On Fri, 9 Jun 2023 at 23:53, Uwe Schindler <uwe@thetaphi.de> wrote:

> Hi,
>
> BTW, there was a slight change in APIJARs caused by this API change:
> https://github.com/openjdk/jdk/commit/5fc9b5787dc4d7f00d2c59288bc8d840fdf5b495
> (this does not affect our code, but it was done 3 weeks ago). I hope
> something like this won't happen. I updated the PR, no code changes needed
> as those methods were not used by Lucene.
>
> I'd like to update the APIJARS again shortly before the feature branch is
> created.
>
> Uwe
> Am 09.06.2023 um 23:10 schrieb Uwe Schindler:
>
> Let me merge and backport the java 21 map PR first. It has all new source
> directories and APIJAR files.
>
> For safety I will regenerate the 21 APIJAR with newest jdk build. Fyi, to
> regenerate you need to have an environment variable with jdk21 as
> autoprovisioning doesn't work.
>
> After that we can copy-paste the vector impl to the main/java21 folder and
> add vector classes to it.
>
> Uwe
>
>
> Am 9. Juni 2023 22:30:09 MESZ schrieb Chris Hegarty
> <christopher.hegarty@elastic.co.INVALID>
> <christopher.hegarty@elastic.co.INVALID>:
>
>> Hi,
>>
>> On 9 Jun 2023, at 17:19, Uwe Schindler <uwe@thetaphi.de>
>> <uwe@thetaphi.de> wrote:
>>
>> Hi,
>>
>> if possible I would like to get the Java 21 changes (MemorySegments and
>> Vector) into the release. I'd like to ask Chris who has better knowledge
>> how to proceed. If he suggests to wait maybe a week or 2, I'd suggest to
>> wait that time.
>>
>> Chris Hegarthy: Do you know if the API of JDK 21 is finalized or not.
>> From my understanding the final phases have started, so API changes are
>> unlikely. If there are bug fixes they won't affect public APIs or the
>> incubator module, right?
>>
>> Your understanding is correct. I do not expect any API changes at this
>> point.
>>
>> The MMapDir changes are already tested all the time, vector API needs the
>> forward port to 21.
>>
>> We are also doing some early testing with JDK 21 EA, and it would be
>> great to get the 21-version of Panama VectorUtils in. I can help get this
>> done.
>>
>> Uwe, what has been done so far? If nothing, as that is still the case
>> tomorrow, I can start on it.
>>
>> -Chris.
>>
>> Uwe
>> Am 09.06.2023 um 18:07 schrieb Adrien Grand:
>>
>> Hello all,
>>
>> There is some good stuff that is scheduled for 9.7 already, I found the
>> following changes in the changelog that look especially interesting:
>> - Concurrent query rewrites for vector queries.
>> - Speedups to vector indexing/search via integration of the Panama
>> vector API.
>> - Reduced overhead of soft deletes.
>> - Support for update by query.
>>
>> I propose we start the process for a 9.7 release, and I volunteer to be
>> the release manager. I suggest the following schedule:
>> - Feature freeze on June 16th, one week from now. This is when the 9.7
>> branch will be cut.
>> - Open a vote on June 21st, which we'll possibly delay if blockers get
>> identified.
>>
>> --
>> Adrien
>>
>> --
>> Uwe Schindler
>> Achterdiek 19, D-28357 Bremenhttps://www.thetaphi.de
>> eMail: uwe@thetaphi.de
>>
>>
>> --
> Uwe Schindler
> Achterdiek 19, 28357 Bremen
> https://www.thetaphi.de
>
> --
> Uwe Schindler
> Achterdiek 19, D-28357 Bremenhttps://www.thetaphi.de
> eMail: uwe@thetaphi.de
>
>
Re: Lucene 9.7 release [ In reply to ]
Hi Alessandro,

It's ok to merge changes before feature freeze, currently planned for
Friday. From a quick look, this is a new feature rather than a bug fix, so
if it's not ready by Friday it could wait until the next minor?

On Mon, Jun 12, 2023 at 6:15?PM Alessandro Benedetti <a.benedetti@sease.io>
wrote:

> Hi,
> we are finalizing https://github.com/apache/lucene/pull/12253, we got
> some last-minute valuable review comments and we would like to apply the
> suggestions and bring them in 9.x .
> Cheers
> --------------------------
> *Alessandro Benedetti*
> Director @ Sease Ltd.
> *Apache Lucene/Solr Committer*
> *Apache Solr PMC Member*
>
> e-mail: a.benedetti@sease.io
>
>
> *Sease* - Information Retrieval Applied
> Consulting | Training | Open Source
>
> Website: Sease.io <http://sease.io/>
> LinkedIn <https://linkedin.com/company/sease-ltd> | Twitter
> <https://twitter.com/seaseltd> | Youtube
> <https://www.youtube.com/channel/UCDx86ZKLYNpI3gzMercM7BQ> | Github
> <https://github.com/seaseltd>
>
>
> On Fri, 9 Jun 2023 at 23:53, Uwe Schindler <uwe@thetaphi.de> wrote:
>
>> Hi,
>>
>> BTW, there was a slight change in APIJARs caused by this API change:
>> https://github.com/openjdk/jdk/commit/5fc9b5787dc4d7f00d2c59288bc8d840fdf5b495
>> (this does not affect our code, but it was done 3 weeks ago). I hope
>> something like this won't happen. I updated the PR, no code changes needed
>> as those methods were not used by Lucene.
>>
>> I'd like to update the APIJARS again shortly before the feature branch is
>> created.
>>
>> Uwe
>> Am 09.06.2023 um 23:10 schrieb Uwe Schindler:
>>
>> Let me merge and backport the java 21 map PR first. It has all new source
>> directories and APIJAR files.
>>
>> For safety I will regenerate the 21 APIJAR with newest jdk build. Fyi, to
>> regenerate you need to have an environment variable with jdk21 as
>> autoprovisioning doesn't work.
>>
>> After that we can copy-paste the vector impl to the main/java21 folder
>> and add vector classes to it.
>>
>> Uwe
>>
>>
>> Am 9. Juni 2023 22:30:09 MESZ schrieb Chris Hegarty
>> <christopher.hegarty@elastic.co.INVALID>
>> <christopher.hegarty@elastic.co.INVALID>:
>>
>>> Hi,
>>>
>>> On 9 Jun 2023, at 17:19, Uwe Schindler <uwe@thetaphi.de>
>>> <uwe@thetaphi.de> wrote:
>>>
>>> Hi,
>>>
>>> if possible I would like to get the Java 21 changes (MemorySegments and
>>> Vector) into the release. I'd like to ask Chris who has better knowledge
>>> how to proceed. If he suggests to wait maybe a week or 2, I'd suggest to
>>> wait that time.
>>>
>>> Chris Hegarthy: Do you know if the API of JDK 21 is finalized or not.
>>> From my understanding the final phases have started, so API changes are
>>> unlikely. If there are bug fixes they won't affect public APIs or the
>>> incubator module, right?
>>>
>>> Your understanding is correct. I do not expect any API changes at this
>>> point.
>>>
>>> The MMapDir changes are already tested all the time, vector API needs
>>> the forward port to 21.
>>>
>>> We are also doing some early testing with JDK 21 EA, and it would be
>>> great to get the 21-version of Panama VectorUtils in. I can help get this
>>> done.
>>>
>>> Uwe, what has been done so far? If nothing, as that is still the case
>>> tomorrow, I can start on it.
>>>
>>> -Chris.
>>>
>>> Uwe
>>> Am 09.06.2023 um 18:07 schrieb Adrien Grand:
>>>
>>> Hello all,
>>>
>>> There is some good stuff that is scheduled for 9.7 already, I found the
>>> following changes in the changelog that look especially interesting:
>>> - Concurrent query rewrites for vector queries.
>>> - Speedups to vector indexing/search via integration of the Panama
>>> vector API.
>>> - Reduced overhead of soft deletes.
>>> - Support for update by query.
>>>
>>> I propose we start the process for a 9.7 release, and I volunteer to be
>>> the release manager. I suggest the following schedule:
>>> - Feature freeze on June 16th, one week from now. This is when the 9.7
>>> branch will be cut.
>>> - Open a vote on June 21st, which we'll possibly delay if blockers get
>>> identified.
>>>
>>> --
>>> Adrien
>>>
>>> --
>>> Uwe Schindler
>>> Achterdiek 19, D-28357 Bremenhttps://www.thetaphi.de
>>> eMail: uwe@thetaphi.de
>>>
>>>
>>> --
>> Uwe Schindler
>> Achterdiek 19, 28357 Bremen
>> https://www.thetaphi.de
>>
>> --
>> Uwe Schindler
>> Achterdiek 19, D-28357 Bremenhttps://www.thetaphi.de
>> eMail: uwe@thetaphi.de
>>
>>

--
Adrien
Re: Lucene 9.7 release [ In reply to ]
Friday should be doable, thanks!
it's true it's a new feature, the only reason is "urgent" is because it's
half of the work we needed to bring this to Solr and we wuld prefer to not
lose traction over there (and have to wait much longer).

Not a blocker by any means!
But I hope we bring it in :)
--------------------------
*Alessandro Benedetti*
Director @ Sease Ltd.
*Apache Lucene/Solr Committer*
*Apache Solr PMC Member*

e-mail: a.benedetti@sease.io


*Sease* - Information Retrieval Applied
Consulting | Training | Open Source

Website: Sease.io <http://sease.io/>
LinkedIn <https://linkedin.com/company/sease-ltd> | Twitter
<https://twitter.com/seaseltd> | Youtube
<https://www.youtube.com/channel/UCDx86ZKLYNpI3gzMercM7BQ> | Github
<https://github.com/seaseltd>


On Mon, 12 Jun 2023 at 17:59, Adrien Grand <jpountz@gmail.com> wrote:

> Hi Alessandro,
>
> It's ok to merge changes before feature freeze, currently planned for
> Friday. From a quick look, this is a new feature rather than a bug fix, so
> if it's not ready by Friday it could wait until the next minor?
>
> On Mon, Jun 12, 2023 at 6:15?PM Alessandro Benedetti <a.benedetti@sease.io>
> wrote:
>
>> Hi,
>> we are finalizing https://github.com/apache/lucene/pull/12253, we got
>> some last-minute valuable review comments and we would like to apply the
>> suggestions and bring them in 9.x .
>> Cheers
>> --------------------------
>> *Alessandro Benedetti*
>> Director @ Sease Ltd.
>> *Apache Lucene/Solr Committer*
>> *Apache Solr PMC Member*
>>
>> e-mail: a.benedetti@sease.io
>>
>>
>> *Sease* - Information Retrieval Applied
>> Consulting | Training | Open Source
>>
>> Website: Sease.io <http://sease.io/>
>> LinkedIn <https://linkedin.com/company/sease-ltd> | Twitter
>> <https://twitter.com/seaseltd> | Youtube
>> <https://www.youtube.com/channel/UCDx86ZKLYNpI3gzMercM7BQ> | Github
>> <https://github.com/seaseltd>
>>
>>
>> On Fri, 9 Jun 2023 at 23:53, Uwe Schindler <uwe@thetaphi.de> wrote:
>>
>>> Hi,
>>>
>>> BTW, there was a slight change in APIJARs caused by this API change:
>>> https://github.com/openjdk/jdk/commit/5fc9b5787dc4d7f00d2c59288bc8d840fdf5b495
>>> (this does not affect our code, but it was done 3 weeks ago). I hope
>>> something like this won't happen. I updated the PR, no code changes needed
>>> as those methods were not used by Lucene.
>>>
>>> I'd like to update the APIJARS again shortly before the feature branch
>>> is created.
>>>
>>> Uwe
>>> Am 09.06.2023 um 23:10 schrieb Uwe Schindler:
>>>
>>> Let me merge and backport the java 21 map PR first. It has all new
>>> source directories and APIJAR files.
>>>
>>> For safety I will regenerate the 21 APIJAR with newest jdk build. Fyi,
>>> to regenerate you need to have an environment variable with jdk21 as
>>> autoprovisioning doesn't work.
>>>
>>> After that we can copy-paste the vector impl to the main/java21 folder
>>> and add vector classes to it.
>>>
>>> Uwe
>>>
>>>
>>> Am 9. Juni 2023 22:30:09 MESZ schrieb Chris Hegarty
>>> <christopher.hegarty@elastic.co.INVALID>
>>> <christopher.hegarty@elastic.co.INVALID>:
>>>
>>>> Hi,
>>>>
>>>> On 9 Jun 2023, at 17:19, Uwe Schindler <uwe@thetaphi.de>
>>>> <uwe@thetaphi.de> wrote:
>>>>
>>>> Hi,
>>>>
>>>> if possible I would like to get the Java 21 changes (MemorySegments and
>>>> Vector) into the release. I'd like to ask Chris who has better knowledge
>>>> how to proceed. If he suggests to wait maybe a week or 2, I'd suggest to
>>>> wait that time.
>>>>
>>>> Chris Hegarthy: Do you know if the API of JDK 21 is finalized or not.
>>>> From my understanding the final phases have started, so API changes are
>>>> unlikely. If there are bug fixes they won't affect public APIs or the
>>>> incubator module, right?
>>>>
>>>> Your understanding is correct. I do not expect any API changes at this
>>>> point.
>>>>
>>>> The MMapDir changes are already tested all the time, vector API needs
>>>> the forward port to 21.
>>>>
>>>> We are also doing some early testing with JDK 21 EA, and it would be
>>>> great to get the 21-version of Panama VectorUtils in. I can help get this
>>>> done.
>>>>
>>>> Uwe, what has been done so far? If nothing, as that is still the case
>>>> tomorrow, I can start on it.
>>>>
>>>> -Chris.
>>>>
>>>> Uwe
>>>> Am 09.06.2023 um 18:07 schrieb Adrien Grand:
>>>>
>>>> Hello all,
>>>>
>>>> There is some good stuff that is scheduled for 9.7 already, I found the
>>>> following changes in the changelog that look especially interesting:
>>>> - Concurrent query rewrites for vector queries.
>>>> - Speedups to vector indexing/search via integration of the Panama
>>>> vector API.
>>>> - Reduced overhead of soft deletes.
>>>> - Support for update by query.
>>>>
>>>> I propose we start the process for a 9.7 release, and I volunteer to be
>>>> the release manager. I suggest the following schedule:
>>>> - Feature freeze on June 16th, one week from now. This is when the 9.7
>>>> branch will be cut.
>>>> - Open a vote on June 21st, which we'll possibly delay if blockers get
>>>> identified.
>>>>
>>>> --
>>>> Adrien
>>>>
>>>> --
>>>> Uwe Schindler
>>>> Achterdiek 19, D-28357 Bremenhttps://www.thetaphi.de
>>>> eMail: uwe@thetaphi.de
>>>>
>>>>
>>>> --
>>> Uwe Schindler
>>> Achterdiek 19, 28357 Bremen
>>> https://www.thetaphi.de
>>>
>>> --
>>> Uwe Schindler
>>> Achterdiek 19, D-28357 Bremenhttps://www.thetaphi.de
>>> eMail: uwe@thetaphi.de
>>>
>>>
>
> --
> Adrien
>
Re: Lucene 9.7 release [ In reply to ]
Hi,

we merged Java 21 support for both MMapDirectory and VectorUtil to main
and branch_9x.

As JDK is in Rampdown Phase 1, it is veeeeery unlikely that there will
be hard API changes till release. In fact, the Java 21 version of vector
support was working without code change, we just enabled the support
without compiling explicit Java 21 version.

To be sure: as part of the release testing I will regenerate API JARs
and do explicit testing.

Uwe

P.S.: We should update the Smoketester to accept an arbitrary number of
alternative JDKs to run tests. Currently it is fixed to Java 11 and 17
(I think).

Am 10.06.2023 um 00:53 schrieb Uwe Schindler:
>
> Hi,
>
> BTW, there was a slight change in APIJARs caused by this API change:
> https://github.com/openjdk/jdk/commit/5fc9b5787dc4d7f00d2c59288bc8d840fdf5b495
> (this does not affect our code, but it was done 3 weeks ago). I hope
> something like this won't happen. I updated the PR, no code changes
> needed as those methods were not used by Lucene.
>
> I'd like to update the APIJARS again shortly before the feature branch
> is created.
>
> Uwe
>
> Am 09.06.2023 um 23:10 schrieb Uwe Schindler:
>> Let me merge and backport the java 21 map PR first. It has all new
>> source directories and APIJAR files.
>>
>> For safety I will regenerate the 21 APIJAR with newest jdk build.
>> Fyi, to regenerate you need to have an environment variable with
>> jdk21 as autoprovisioning doesn't work.
>>
>> After that we can copy-paste the vector impl to the main/java21
>> folder and add vector classes to it.
>>
>> Uwe
>>
>>
>> Am 9. Juni 2023 22:30:09 MESZ schrieb Chris Hegarty
>> <christopher.hegarty@elastic.co.INVALID>:
>>
>> Hi,
>>
>>> On 9 Jun 2023, at 17:19, Uwe Schindler <uwe@thetaphi.de> wrote:
>>>
>>> Hi,
>>>
>>> if possible I would like to get the Java 21 changes
>>> (MemorySegments and Vector) into the release. I'd like to ask
>>> Chris who has better knowledge how to proceed. If he suggests to
>>> wait maybe a week or 2, I'd suggest to wait that time.
>>>
>>> Chris Hegarthy: Do you know if the API of JDK 21 is finalized or
>>> not. From my understanding the final phases have started, so API
>>> changes are unlikely. If there are bug fixes they won't affect
>>> public APIs or the incubator module, right?
>>>
>> Your understanding is correct. I do not expect any API changes at
>> this point.
>>>
>>> The MMapDir changes are already tested all the time, vector API
>>> needs the forward port to 21.
>>>
>> We are also doing some early testing with JDK 21 EA, and it would
>> be great to get the 21-version of Panama VectorUtils in. I can
>> help get this done.
>>
>> Uwe, what has been done so far? If nothing, as that is still the
>> case tomorrow, I can start on it.
>>
>> -Chris.
>>
>>> Uwe
>>>
>>> Am 09.06.2023 um 18:07 schrieb Adrien Grand:
>>>> Hello all,
>>>>
>>>> There is some good stuff that is scheduled for 9.7 already, I
>>>> found the following changes in the changelog that look
>>>> especially interesting:
>>>>  - Concurrent query rewrites for vector queries.
>>>>  - Speedups to vector indexing/search via integration of the
>>>> Panama vector API.
>>>>  - Reduced overhead of soft deletes.
>>>>  - Support for update by query.
>>>>
>>>> I propose we start the process for a 9.7 release, and I
>>>> volunteer to be the release manager. I suggest the following
>>>> schedule:
>>>>  - Feature freeze on June 16th, one week from now. This is when
>>>> the 9.7 branch will be cut.
>>>>  - Open a vote on June 21st, which we'll possibly delay if
>>>> blockers get identified.
>>>>
>>>> --
>>>> Adrien
>>> --
>>> Uwe Schindler
>>> Achterdiek 19, D-28357 Bremen
>>> https://www.thetaphi.de
>>> eMail:uwe@thetaphi.de
>>
>> --
>> Uwe Schindler
>> Achterdiek 19, 28357 Bremen
>> https://www.thetaphi.de
> --
> Uwe Schindler
> Achterdiek 19, D-28357 Bremen
> https://www.thetaphi.de
> eMail:uwe@thetaphi.de

--
Uwe Schindler
Achterdiek 19, D-28357 Bremen
https://www.thetaphi.de
eMail:uwe@thetaphi.de
Re: Lucene 9.7 release [ In reply to ]
On Tue, Jun 13, 2023 at 6:14?AM Uwe Schindler <uwe@thetaphi.de> wrote:

> P.S.: We should update the Smoketester to accept an arbitrary number of
> alternative JDKs to run tests. Currently it is fixed to Java 11 and 17 (I
> think).
>
+1, open an issue?

Mike McCandless

http://blog.mikemccandless.com

>