Mailing List Archive

I think you meant to send it to dev@solr.apache.org?

On Sun, Nov 26, 2023 at 12:24?AM Mikhail Khludnev <mkhl@apache.org> wrote:

> Hello
> It's rather like a logical error in crave pull. How to work around it?
>
> + status=0
> + ./crave pull '**/build/**/test/TEST-*.xml' '**/*.events' 'heapdumps/**' '**/hs_err_pid*'
> Error: rsync: [sender] change_dir "/tmp/src/solr/heapdumps" failed: No such file or directory (2)
> rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1682) [Receiver=3.1.3]
> rsync: [Receiver] write error: Broken pipe (32)
>
> + exit 0
>
>
> ---------- Forwarded message ---------
> From: Apache Jenkins Server <jenkins@builds.apache.org>
> Date: Sun, Nov 26, 2023 at 11:17?AM
> Subject: [JENKINS] Solr » Solr-Check-9.x - Build # 5949 - Still Failing!
> To: <builds@solr.apache.org>
>
>
> Build: https://ci-builds.apache.org/job/Solr/job/Solr-Check-9.x/5949/
>
> No tests ran.
>
> Build Log:
> [...truncated 1490 lines...]
> ERROR: Step ‘Publish JUnit test result report’ failed: No test report
> files were found. Configuration error?
> Email was triggered for: Failure - Any
> Sending email for trigger: Failure - Any
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: builds-unsubscribe@solr.apache.org
> For additional commands, e-mail: builds-help@solr.apache.org
>
>
> --
> Sincerely yours
> Mikhail Khludnev
>

Pardon

On Sun, Nov 26, 2023 at 11:28?AM Gautam Worah <worah.gautam@gmail.com>
wrote:

> I think you meant to send it to dev@solr.apache.org?
>
> On Sun, Nov 26, 2023 at 12:24?AM Mikhail Khludnev <mkhl@apache.org> wrote:
>
>> Hello
>> It's rather like a logical error in crave pull. How to work around it?
>>
>> + status=0
>> + ./crave pull '**/build/**/test/TEST-*.xml' '**/*.events' 'heapdumps/**' '**/hs_err_pid*'
>> Error: rsync: [sender] change_dir "/tmp/src/solr/heapdumps" failed: No such file or directory (2)
>> rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1682) [Receiver=3.1.3]
>> rsync: [Receiver] write error: Broken pipe (32)
>>
>> + exit 0
>>
>>
>> ---------- Forwarded message ---------
>> From: Apache Jenkins Server <jenkins@builds.apache.org>
>> Date: Sun, Nov 26, 2023 at 11:17?AM
>> Subject: [JENKINS] Solr » Solr-Check-9.x - Build # 5949 - Still Failing!
>> To: <builds@solr.apache.org>
>>
>>
>> Build: https://ci-builds.apache.org/job/Solr/job/Solr-Check-9.x/5949/
>>
>> No tests ran.
>>
>> Build Log:
>> [...truncated 1490 lines...]
>> ERROR: Step ‘Publish JUnit test result report’ failed: No test report
>> files were found. Configuration error?
>> Email was triggered for: Failure - Any
>> Sending email for trigger: Failure - Any
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: builds-unsubscribe@solr.apache.org
>> For additional commands, e-mail: builds-help@solr.apache.org
>>
>>
>> --
>> Sincerely yours
>> Mikhail Khludnev
>>
>

--
Sincerely yours
Mikhail Khludnev

Investigating.

On Nov 26 2023, at 12:32 am, Mikhail Khludnev <mkhl@apache.org> wrote:
> Pardon
>
> On Sun, Nov 26, 2023 at 11:28?AM Gautam Worah <worah.gautam@gmail.com (mailto:worah.gautam@gmail.com)> wrote:
> > I think you meant to send it to dev@solr.apache.org (mailto:dev@solr.apache.org)?
> >
> > On Sun, Nov 26, 2023 at 12:24?AM Mikhail Khludnev <mkhl@apache.org (mailto:mkhl@apache.org)> wrote:
> > > Hello
> > > It's rather like a logical error in crave pull. How to work around it?
> > > + status=0
> > > + ./crave pull '**/build/**/test/TEST-*.xml' '**/*.events' 'heapdumps/**' '**/hs_err_pid*'
> > > Error: rsync: [sender] change_dir "/tmp/src/solr/heapdumps" failed: No such file or directory (2)
> > > rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1682) [Receiver=3.1.3]
> > > rsync: [Receiver] write error: Broken pipe (32)
> > >
> > > + exit 0
> > > ---------- Forwarded message ---------
> > > From: Apache Jenkins Server <jenkins@builds.apache.org (mailto:jenkins@builds.apache.org)>
> > > Date: Sun, Nov 26, 2023 at 11:17?AM
> > > Subject: [JENKINS] Solr » Solr-Check-9.x - Build # 5949 - Still Failing!
> > > To: <builds@solr.apache.org (mailto:builds@solr.apache.org)>
> > >
> > >
> > >
> > > Build: https://ci-builds.apache.org/job/Solr/job/Solr-Check-9.x/5949/
> > > No tests ran.
> > > Build Log:
> > > [...truncated 1490 lines...]
> > > ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?
> > > Email was triggered for: Failure - Any
> > > Sending email for trigger: Failure - Any
> > >
> > > ---------------------------------------------------------------------
> > > To unsubscribe, e-mail: builds-unsubscribe@solr.apache.org (mailto:builds-unsubscribe@solr.apache.org)
> > > For additional commands, e-mail: builds-help@solr.apache.org (mailto:builds-help@solr.apache.org)
> > >
> > >
> > >
> > >
> > > --
> > > Sincerely yours
> > > Mikhail Khludnev
> > >
> > >
> > >
> >
> >
> >
>
>
>
>
> --
> Sincerely yours
> Mikhail Khludnev
>
>

I just started a build with crave:
crave run ./gradlew --console=plain check integrationTests

And at the end of it, looked for the patterns in the crave pull command:
admin@171074329f9e:/tmp/src/solr$ find . -name '*.events'
admin@171074329f9e:/tmp/src/solr$ find . -name 'hs_err_pid*'
admin@171074329f9e:/tmp/src/solr$
admin@171074329f9e:/tmp/src/solr$ ls -l heapdumps
ls: cannot access 'heapdumps': No such file or directory
The only thing I could get a lot of output on was
admin@171074329f9e:/tmp/src/solr$ find . | grep 'build.*test.TEST' | head
./solr/solr-ref-guide/build/test-results/test/TEST-org.apache.solr.client.ref_guide_examples.JsonRequestApiTest.xml
./solr/solr-ref-guide/build/test-results/test/TEST-org.apache.solr.client.ref_guide_examples.UsingSolrJRefGuideExamplesTest.xml (https://link.getmailspring.com/link/A1463805-BFD9-43A5-BD19-08E9AE1A4450@getmailspring.com/0?redirect=TEST-org.apache.solr.client.ref_guide_examples.UsingSolrJRefGuideExamplesTest.xml&recipient=ZGV2QGx1Y2VuZS5hcGFjaGUub3Jn)
./solr/solr-ref-guide/build/test-results/test/TEST-org.apache.solr.client.ref_guide_examples.IndexingNestedDocuments.xml
./solr/solr-ref-guide/build/test-results/test/TEST-org.apache.solr.client.ref_guide_examples.ZkConfigFilesTest.xml
./solr/solr-ref-guide/build/test-results/test/TEST-org.apache.solr.client.ref_guide_examples.JsonRequestApiHeatmapFacetingTest.xml
./solr/prometheus-exporter/build/test-results/test/TEST-org.apache.solr.prometheus.exporter.SolrExporterIntegrationTest.xml
./solr/prometheus-exporter/build/test-results/test/TEST-org.apache.solr.prometheus.scraper.SolrStandaloneScraperBasicAuthTest.xml
./solr/prometheus-exporter/build/test-results/test/TEST-org.apache.solr.prometheus.exporter.MetricsQueryTemplateTest.xml
./solr/prometheus-exporter/build/test-results/test/TEST-org.apache.solr.prometheus.scraper.SolrStandaloneScraperTest.xml
./solr/prometheus-exporter/build/test-results/test/TEST-org.apache.solr.prometheus.scraper.SolrCloudScraperTest.xml
Is there some other build command required to generate the other file patterns?
Thanks,
-Uv

On Nov 30 2023, at 11:33 am, Yuvraaj Kelkar <uv@crave.io> wrote:
> Investigating.
>
> On Nov 26 2023, at 12:32 am, Mikhail Khludnev <mkhl@apache.org> wrote:
> > Pardon
> >
> > On Sun, Nov 26, 2023 at 11:28?AM Gautam Worah <worah.gautam@gmail.com (mailto:worah.gautam@gmail.com)> wrote:
> > > I think you meant to send it to dev@solr.apache.org (mailto:dev@solr.apache.org)?
> > >
> > > On Sun, Nov 26, 2023 at 12:24?AM Mikhail Khludnev <mkhl@apache.org (mailto:mkhl@apache.org)> wrote:
> > > > Hello
> > > > It's rather like a logical error in crave pull. How to work around it?
> > > >
> > > > + status=0
> > > > + ./crave pull '**/build/**/test/TEST-*.xml' '**/*.events' 'heapdumps/**' '**/hs_err_pid*'
> > > > Error: rsync: [sender] change_dir "/tmp/src/solr/heapdumps" failed: No such file or directory (2)
> > > > rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1682) [Receiver=3.1.3]
> > > > rsync: [Receiver] write error: Broken pipe (32)
> > > >
> > > > + exit 0
> > > > ---------- Forwarded message ---------
> > > > From: Apache Jenkins Server <jenkins@builds.apache.org (mailto:jenkins@builds.apache.org)>
> > > > Date: Sun, Nov 26, 2023 at 11:17?AM
> > > > Subject: [JENKINS] Solr » Solr-Check-9.x - Build # 5949 - Still Failing!
> > > > To: <builds@solr.apache.org (mailto:builds@solr.apache.org)>
> > > >
> > > >
> > > >
> > > > Build: https://ci-builds.apache.org/job/Solr/job/Solr-Check-9.x/5949/
> > > > No tests ran.
> > > > Build Log:
> > > > [...truncated 1490 lines...]
> > > > ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?
> > > > Email was triggered for: Failure - Any
> > > > Sending email for trigger: Failure - Any
> > > >
> > > > ---------------------------------------------------------------------
> > > > To unsubscribe, e-mail: builds-unsubscribe@solr.apache.org (mailto:builds-unsubscribe@solr.apache.org)
> > > > For additional commands, e-mail: builds-help@solr.apache.org (mailto:builds-help@solr.apache.org)
> > > >
> > > >
> > > >
> > > >
> > > > --
> > > > Sincerely yours
> > > > Mikhail Khludnev
> > > >
> > > >
> > > >
> > >
> > >
> > >
> >
> >
> >
> >
> > --
> > Sincerely yours
> > Mikhail Khludnev
> >
> >
>

Hello Yuvraaj,
Thanks for taking care of this. Honestly it's not my wheelhouse.
I seems like there's a consideration that a test getting out of heap will
create heapdumps folder and put a file into. I don't know wether
test/gradle can dump heap there ever. At least we don't have tests dumps
heap there now. So, whether this folder exists or is absent is not certain.
We have a few options:
- drop heapdumps/** from crave pull until someone needs to investigate a
test falling out of memory.
- hack crave pull to ignore path wildcards for absent dir
- execute $mkdir heapdumps or $mkdir -p heapdumps (depending on script's
error handling more) before $crave pull


On Thu, Nov 30, 2023 at 11:24?PM Yuvraaj Kelkar <uv@crave.io> wrote:

> I just started a build with crave:
> crave run ./gradlew --console=plain check integrationTests
>
> And at the end of it, looked for the patterns in the crave pull command:
>
> admin@171074329f9e:/tmp/src/solr$ find . -name '*.events'
> admin@171074329f9e:/tmp/src/solr$ find . -name 'hs_err_pid*'
> admin@171074329f9e:/tmp/src/solr$
> admin@171074329f9e:/tmp/src/solr$ ls -l heapdumps
> ls: cannot access 'heapdumps': No such file or directory
>
>
> The only thing I could get a lot of output on was
>
> admin@171074329f9e:/tmp/src/solr$ find . | grep 'build.*test.TEST' | head
> ./solr/solr-ref-guide/build/test-results/test/TEST-org.apache.solr.client.ref_guide_examples.JsonRequestApiTest.xml
> ./solr/solr-ref-guide/build/test-results/test/TEST-org.apache.solr.client.ref_guide_examples.UsingSolrJRefGuideExamplesTest.xml <https://link.getmailspring.com/link/A1463805-BFD9-43A5-BD19-08E9AE1A4450@getmailspring.com/0?redirect=TEST-org.apache.solr.client.ref_guide_examples.UsingSolrJRefGuideExamplesTest.xml&recipient=ZGV2QGx1Y2VuZS5hcGFjaGUub3Jn>
> ./solr/solr-ref-guide/build/test-results/test/TEST-org.apache.solr.client.ref_guide_examples.IndexingNestedDocuments.xml
> ./solr/solr-ref-guide/build/test-results/test/TEST-org.apache.solr.client.ref_guide_examples.ZkConfigFilesTest.xml
> ./solr/solr-ref-guide/build/test-results/test/TEST-org.apache.solr.client.ref_guide_examples.JsonRequestApiHeatmapFacetingTest.xml
> ./solr/prometheus-exporter/build/test-results/test/TEST-org.apache.solr.prometheus.exporter.SolrExporterIntegrationTest.xml
> ./solr/prometheus-exporter/build/test-results/test/TEST-org.apache.solr.prometheus.scraper.SolrStandaloneScraperBasicAuthTest.xml
> ./solr/prometheus-exporter/build/test-results/test/TEST-org.apache.solr.prometheus.exporter.MetricsQueryTemplateTest.xml
> ./solr/prometheus-exporter/build/test-results/test/TEST-org.apache.solr.prometheus.scraper.SolrStandaloneScraperTest.xml
> ./solr/prometheus-exporter/build/test-results/test/TEST-org.apache.solr.prometheus.scraper.SolrCloudScraperTest.xml
>
>
> Is there some other build command required to generate the other file
> patterns?
>
> Thanks,
> -Uv
>
> On Nov 30 2023, at 11:33 am, Yuvraaj Kelkar <uv@crave.io> wrote:
>
> Investigating.
>
> On Nov 26 2023, at 12:32 am, Mikhail Khludnev <mkhl@apache.org> wrote:
>
> Pardon
>
> [image: Sent from Mailspring]
> On Sun, Nov 26, 2023 at 11:28?AM Gautam Worah <worah.gautam@gmail.com>
> wrote:
>
> I think you meant to send it to dev@solr.apache.org?
>
> On Sun, Nov 26, 2023 at 12:24?AM Mikhail Khludnev <mkhl@apache.org> wrote:
>
> Hello
> It's rather like a logical error in crave pull. How to work around it?
>
> + status=0
> + ./crave pull '**/build/**/test/TEST-*.xml' '**/*.events' 'heapdumps/**' '**/hs_err_pid*'
> Error: rsync: [sender] change_dir "/tmp/src/solr/heapdumps" failed: No such file or directory (2)
> rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1682) [Receiver=3.1.3]
> rsync: [Receiver] write error: Broken pipe (32)
>
> + exit 0
>
>
> ---------- Forwarded message ---------
> From: *Apache Jenkins Server* <jenkins@builds.apache.org>
> Date: Sun, Nov 26, 2023 at 11:17?AM
> Subject: [JENKINS] Solr » Solr-Check-9.x - Build # 5949 - Still Failing!
> To: <builds@solr.apache.org>
>
>
> Build: https://ci-builds.apache.org/job/Solr/job/Solr-Check-9.x/5949/
>
> No tests ran.
>
> Build Log:
> [...truncated 1490 lines...]
> ERROR: Step ‘Publish JUnit test result report’ failed: No test report
> files were found. Configuration error?
> Email was triggered for: Failure - Any
> Sending email for trigger: Failure - Any
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: builds-unsubscribe@solr.apache.org
> For additional commands, e-mail: builds-help@solr.apache.org
>
>
> --
> Sincerely yours
> Mikhail Khludnev
>
>
>
> --
> Sincerely yours
> Mikhail Khludnev
>
>

--
Sincerely yours
Mikhail Khludnev

I think the second option is what we'll go for.
I'm going to add a flag to pull that will allow the user to specify extra flags to be given to rsync.
Then we can call crave pull like this:
./crave pull --extra-rsync-flags ' --ignore-missing-args' '**/build/**/test/TEST-*.xml' '**/*.events' 'heapdumps/**' '**/hs_err_pid*'

*** Note the additional space before the hypen in ' --ignore-missing-args' .
This should handle the missing source files/directories.
What do you think?
Thanks,
-Uv

On Dec 1 2023, at 12:56 am, Mikhail Khludnev <mkhl@apache.org> wrote:
> Hello Yuvraaj,
> Thanks for taking care of this. Honestly it's not my wheelhouse.
> I seems like there's a consideration that a test getting out of heap will create heapdumps folder and put a file into. I don't know wether test/gradle can dump heap there ever. At least we don't have tests dumps heap there now. So, whether this folder exists or is absent is not certain.
> We have a few options:
> - drop heapdumps/** from crave pull until someone needs to investigate a test falling out of memory.
> - hack crave pull to ignore path wildcards for absent dir
> - execute $mkdir heapdumps or $mkdir -p heapdumps (depending on script's error handling more) before $crave pull
>
>
> On Thu, Nov 30, 2023 at 11:24?PM Yuvraaj Kelkar <uv@crave.io (mailto:uv@crave.io)> wrote:
> > I just started a build with crave:
> > crave run ./gradlew --console=plain check integrationTests
> >
> > And at the end of it, looked for the patterns in the crave pull command:
> >
> > admin@171074329f9e:/tmp/src/solr$ find . -name '*.events'
> > admin@171074329f9e:/tmp/src/solr$ find . -name 'hs_err_pid*'
> > admin@171074329f9e:/tmp/src/solr$
> > admin@171074329f9e:/tmp/src/solr$ ls -l heapdumps
> > ls: cannot access 'heapdumps': No such file or directory
> >
> > The only thing I could get a lot of output on was
> >
> > admin@171074329f9e:/tmp/src/solr$ find . | grep 'build.*test.TEST' | head
> > ./solr/solr-ref-guide/build/test-results/test/TEST-org.apache.solr.client.ref_guide_examples.JsonRequestApiTest.xml
> > ./solr/solr-ref-guide/build/test-results/test/TEST-org.apache.solr.client.ref_guide_examples.UsingSolrJRefGuideExamplesTest.xml (https://link.getmailspring.com/link/A1463805-BFD9-43A5-BD19-08E9AE1A4450@getmailspring.com/0?redirect=TEST-org.apache.solr.client.ref_guide_examples.UsingSolrJRefGuideExamplesTest.xml&recipient=ZGV2QGx1Y2VuZS5hcGFjaGUub3Jn)
> > ./solr/solr-ref-guide/build/test-results/test/TEST-org.apache.solr.client.ref_guide_examples.IndexingNestedDocuments.xml
> > ./solr/solr-ref-guide/build/test-results/test/TEST-org.apache.solr.client.ref_guide_examples.ZkConfigFilesTest.xml
> > ./solr/solr-ref-guide/build/test-results/test/TEST-org.apache.solr.client.ref_guide_examples.JsonRequestApiHeatmapFacetingTest.xml
> > ./solr/prometheus-exporter/build/test-results/test/TEST-org.apache.solr.prometheus.exporter.SolrExporterIntegrationTest.xml
> > ./solr/prometheus-exporter/build/test-results/test/TEST-org.apache.solr.prometheus.scraper.SolrStandaloneScraperBasicAuthTest.xml
> > ./solr/prometheus-exporter/build/test-results/test/TEST-org.apache.solr.prometheus.exporter.MetricsQueryTemplateTest.xml
> > ./solr/prometheus-exporter/build/test-results/test/TEST-org.apache.solr.prometheus.scraper.SolrStandaloneScraperTest.xml
> > ./solr/prometheus-exporter/build/test-results/test/TEST-org.apache.solr.prometheus.scraper.SolrCloudScraperTest.xml
> >
> > Is there some other build command required to generate the other file patterns?
> > Thanks,
> > -Uv
> >
> > On Nov 30 2023, at 11:33 am, Yuvraaj Kelkar <uv@crave.io (mailto:uv@crave.io)> wrote:
> > > Investigating.
> > >
> > > On Nov 26 2023, at 12:32 am, Mikhail Khludnev <mkhl@apache.org (mailto:mkhl@apache.org)> wrote:
> > > > Pardon
> > > >
> > > > On Sun, Nov 26, 2023 at 11:28?AM Gautam Worah <worah.gautam@gmail.com (mailto:worah.gautam@gmail.com)> wrote:
> > > > > I think you meant to send it to dev@solr.apache.org (mailto:dev@solr.apache.org)?
> > > > >
> > > > > On Sun, Nov 26, 2023 at 12:24?AM Mikhail Khludnev <mkhl@apache.org (mailto:mkhl@apache.org)> wrote:
> > > > > > Hello
> > > > > > It's rather like a logical error in crave pull. How to work around it?
> > > > > >
> > > > > > + status=0
> > > > > > + ./crave pull '**/build/**/test/TEST-*.xml' '**/*.events' 'heapdumps/**' '**/hs_err_pid*'
> > > > > > Error: rsync: [sender] change_dir "/tmp/src/solr/heapdumps" failed: No such file or directory (2)
> > > > > > rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1682) [Receiver=3.1.3]
> > > > > > rsync: [Receiver] write error: Broken pipe (32)
> > > > > >
> > > > > > + exit 0
> > > > > > ---------- Forwarded message ---------
> > > > > > From: Apache Jenkins Server <jenkins@builds.apache.org (mailto:jenkins@builds.apache.org)>
> > > > > > Date: Sun, Nov 26, 2023 at 11:17?AM
> > > > > > Subject: [JENKINS] Solr » Solr-Check-9.x - Build # 5949 - Still Failing!
> > > > > > To: <builds@solr.apache.org (mailto:builds@solr.apache.org)>
> > > > > >
> > > > > >
> > > > > >
> > > > > > Build: https://ci-builds.apache.org/job/Solr/job/Solr-Check-9.x/5949/
> > > > > > No tests ran.
> > > > > > Build Log:
> > > > > > [...truncated 1490 lines...]
> > > > > > ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?
> > > > > > Email was triggered for: Failure - Any
> > > > > > Sending email for trigger: Failure - Any
> > > > > >
> > > > > > ---------------------------------------------------------------------
> > > > > > To unsubscribe, e-mail: builds-unsubscribe@solr.apache.org (mailto:builds-unsubscribe@solr.apache.org)
> > > > > > For additional commands, e-mail: builds-help@solr.apache.org (mailto:builds-help@solr.apache.org)
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > > Sincerely yours
> > > > > > Mikhail Khludnev
> > > > > >
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > > >
> > > >
> > > >
> > > >
> > > >
> > > > --
> > > > Sincerely yours
> > > > Mikhail Khludnev
> > > >
> > > >
> > >
> >
>
>
>
>
> --
> Sincerely yours
> Mikhail Khludnev
>
>
>

Make sense.

On Fri, Dec 1, 2023 at 7:56?PM Yuvraaj Kelkar <uv@crave.io> wrote:

> I think the second option is what we'll go for.
> I'm going to add a flag to pull that will allow the user to specify extra
> flags to be given to rsync.
> Then we can call crave pull like this:
> ./crave pull --extra-rsync-flags ' --ignore-missing-args'
> '**/build/**/test/TEST-*.xml' '**/*.events' 'heapdumps/**' '**/hs_err_pid*'
>
>
> *** Note the additional space before the hypen in ' --ignore-missing-args'
> .
>
> This should handle the missing source files/directories.
>
> What do you think?
>
> Thanks,
> -Uv
>
> On Dec 1 2023, at 12:56 am, Mikhail Khludnev <mkhl@apache.org> wrote:
>
> Hello Yuvraaj,
> Thanks for taking care of this. Honestly it's not my wheelhouse.
> I seems like there's a consideration that a test getting out of heap will
> create heapdumps folder and put a file into. I don't know wether
> test/gradle can dump heap there ever. At least we don't have tests dumps
> heap there now. So, whether this folder exists or is absent is not certain.
> We have a few options:
> - drop heapdumps/** from crave pull until someone needs to investigate a
> test falling out of memory.
> - hack crave pull to ignore path wildcards for absent dir
> - execute $mkdir heapdumps or $mkdir -p heapdumps (depending on script's
> error handling more) before $crave pull
>
>
> [image: Sent from Mailspring]
> On Thu, Nov 30, 2023 at 11:24?PM Yuvraaj Kelkar <uv@crave.io> wrote:
>
> I just started a build with crave:
> crave run ./gradlew --console=plain check integrationTests
>
> And at the end of it, looked for the patterns in the crave pull command:
>
> admin@171074329f9e:/tmp/src/solr$ find . -name '*.events'
> admin@171074329f9e:/tmp/src/solr$ find . -name 'hs_err_pid*'
> admin@171074329f9e:/tmp/src/solr$
> admin@171074329f9e:/tmp/src/solr$ ls -l heapdumps
> ls: cannot access 'heapdumps': No such file or directory
>
>
> The only thing I could get a lot of output on was
>
> admin@171074329f9e:/tmp/src/solr$ find . | grep 'build.*test.TEST' | head
> ./solr/solr-ref-guide/build/test-results/test/TEST-org.apache.solr.client.ref_guide_examples.JsonRequestApiTest.xml
> ./solr/solr-ref-guide/build/test-results/test/TEST-org.apache.solr.client.ref_guide_examples.UsingSolrJRefGuideExamplesTest.xml <https://link.getmailspring.com/link/A1463805-BFD9-43A5-BD19-08E9AE1A4450@getmailspring.com/0?redirect=TEST-org.apache.solr.client.ref_guide_examples.UsingSolrJRefGuideExamplesTest.xml&recipient=ZGV2QGx1Y2VuZS5hcGFjaGUub3Jn>
> ./solr/solr-ref-guide/build/test-results/test/TEST-org.apache.solr.client.ref_guide_examples.IndexingNestedDocuments.xml
> ./solr/solr-ref-guide/build/test-results/test/TEST-org.apache.solr.client.ref_guide_examples.ZkConfigFilesTest.xml
> ./solr/solr-ref-guide/build/test-results/test/TEST-org.apache.solr.client.ref_guide_examples.JsonRequestApiHeatmapFacetingTest.xml
> ./solr/prometheus-exporter/build/test-results/test/TEST-org.apache.solr.prometheus.exporter.SolrExporterIntegrationTest.xml
> ./solr/prometheus-exporter/build/test-results/test/TEST-org.apache.solr.prometheus.scraper.SolrStandaloneScraperBasicAuthTest.xml
> ./solr/prometheus-exporter/build/test-results/test/TEST-org.apache.solr.prometheus.exporter.MetricsQueryTemplateTest.xml
> ./solr/prometheus-exporter/build/test-results/test/TEST-org.apache.solr.prometheus.scraper.SolrStandaloneScraperTest.xml
> ./solr/prometheus-exporter/build/test-results/test/TEST-org.apache.solr.prometheus.scraper.SolrCloudScraperTest.xml
>
>
> Is there some other build command required to generate the other file
> patterns?
>
> Thanks,
> -Uv
>
> On Nov 30 2023, at 11:33 am, Yuvraaj Kelkar <uv@crave.io> wrote:
>
> Investigating.
>
> On Nov 26 2023, at 12:32 am, Mikhail Khludnev <mkhl@apache.org> wrote:
>
> Pardon
>
> On Sun, Nov 26, 2023 at 11:28?AM Gautam Worah <worah.gautam@gmail.com>
> wrote:
>
> I think you meant to send it to dev@solr.apache.org?
>
> On Sun, Nov 26, 2023 at 12:24?AM Mikhail Khludnev <mkhl@apache.org> wrote:
>
> Hello
> It's rather like a logical error in crave pull. How to work around it?
>
> + status=0
> + ./crave pull '**/build/**/test/TEST-*.xml' '**/*.events' 'heapdumps/**' '**/hs_err_pid*'
> Error: rsync: [sender] change_dir "/tmp/src/solr/heapdumps" failed: No such file or directory (2)
> rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1682) [Receiver=3.1.3]
> rsync: [Receiver] write error: Broken pipe (32)
>
> + exit 0
>
>
> ---------- Forwarded message ---------
> From: *Apache Jenkins Server* <jenkins@builds.apache.org>
> Date: Sun, Nov 26, 2023 at 11:17?AM
> Subject: [JENKINS] Solr » Solr-Check-9.x - Build # 5949 - Still Failing!
> To: <builds@solr.apache.org>
>
>
> Build: https://ci-builds.apache.org/job/Solr/job/Solr-Check-9.x/5949/
>
> No tests ran.
>
> Build Log:
> [...truncated 1490 lines...]
> ERROR: Step ‘Publish JUnit test result report’ failed: No test report
> files were found. Configuration error?
> Email was triggered for: Failure - Any
> Sending email for trigger: Failure - Any
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: builds-unsubscribe@solr.apache.org
> For additional commands, e-mail: builds-help@solr.apache.org
>
>
> --
> Sincerely yours
> Mikhail Khludnev
>
>
>
> --
> Sincerely yours
> Mikhail Khludnev
>
>
>
> --
> Sincerely yours
> Mikhail Khludnev
>
>

--
Sincerely yours
Mikhail Khludnev

The new version of crave is in place and will be used automatically on the next invocation from Jenkins.
Can you update the Jenkins script to call crave like this:

./crave pull --extra-rsync-flags ' --ignore-missing-args' '**/build/**/test/TEST-*.xml' '**/*.events' 'heapdumps/**' '**/hs_err_pid*'
Release has been marked here: https://github.com/accupara/crave/releases/tag/0.2-6879 (https://link.getmailspring.com/link/010A76BD-7093-4BFD-980E-9902966570FF@getmailspring.com/0?redirect=https%3A%2F%2Fgithub.com%2Faccupara%2Fcrave%2Freleases%2Ftag%2F0.2-6879&recipient=ZGV2QGx1Y2VuZS5hcGFjaGUub3Jn)
Thanks,
-Uv
On Dec 1 2023, at 11:10 am, Mikhail Khludnev <mkhl@apache.org> wrote:
> Make sense.
>
> On Fri, Dec 1, 2023 at 7:56?PM Yuvraaj Kelkar <uv@crave.io (mailto:uv@crave.io)> wrote:
> > I think the second option is what we'll go for.
> > I'm going to add a flag to pull that will allow the user to specify extra flags to be given to rsync.
> > Then we can call crave pull like this:
> > ./crave pull --extra-rsync-flags ' --ignore-missing-args' '**/build/**/test/TEST-*.xml' '**/*.events' 'heapdumps/**' '**/hs_err_pid*'
> >
> > *** Note the additional space before the hypen in ' --ignore-missing-args' .
> > This should handle the missing source files/directories.
> > What do you think?
> > Thanks,
> > -Uv
> >
> > On Dec 1 2023, at 12:56 am, Mikhail Khludnev <mkhl@apache.org (mailto:mkhl@apache.org)> wrote:
> > > Hello Yuvraaj,
> > > Thanks for taking care of this. Honestly it's not my wheelhouse.
> > > I seems like there's a consideration that a test getting out of heap will create heapdumps folder and put a file into. I don't know wether test/gradle can dump heap there ever. At least we don't have tests dumps heap there now. So, whether this folder exists or is absent is not certain.
> > > We have a few options:
> > > - drop heapdumps/** from crave pull until someone needs to investigate a test falling out of memory.
> > > - hack crave pull to ignore path wildcards for absent dir
> > > - execute $mkdir heapdumps or $mkdir -p heapdumps (depending on script's error handling more) before $crave pull
> > >
> > >
> > > On Thu, Nov 30, 2023 at 11:24?PM Yuvraaj Kelkar <uv@crave.io (mailto:uv@crave.io)> wrote:
> > > > I just started a build with crave:
> > > > crave run ./gradlew --console=plain check integrationTests
> > > >
> > > > And at the end of it, looked for the patterns in the crave pull command:
> > > >
> > > > admin@171074329f9e:/tmp/src/solr$ find . -name '*.events'
> > > > admin@171074329f9e:/tmp/src/solr$ find . -name 'hs_err_pid*'
> > > > admin@171074329f9e:/tmp/src/solr$
> > > > admin@171074329f9e:/tmp/src/solr$ ls -l heapdumps
> > > > ls: cannot access 'heapdumps': No such file or directory
> > > >
> > > > The only thing I could get a lot of output on was
> > > >
> > > > admin@171074329f9e:/tmp/src/solr$ find . | grep 'build.*test.TEST' | head
> > > > ./solr/solr-ref-guide/build/test-results/test/TEST-org.apache.solr.client.ref_guide_examples.JsonRequestApiTest.xml
> > > > ./solr/solr-ref-guide/build/test-results/test/TEST-org.apache.solr.client.ref_guide_examples.UsingSolrJRefGuideExamplesTest.xml (https://link.getmailspring.com/link/A1463805-BFD9-43A5-BD19-08E9AE1A4450@getmailspring.com/0?redirect=TEST-org.apache.solr.client.ref_guide_examples.UsingSolrJRefGuideExamplesTest.xml&recipient=ZGV2QGx1Y2VuZS5hcGFjaGUub3Jn)
> > > > ./solr/solr-ref-guide/build/test-results/test/TEST-org.apache.solr.client.ref_guide_examples.IndexingNestedDocuments.xml
> > > > ./solr/solr-ref-guide/build/test-results/test/TEST-org.apache.solr.client.ref_guide_examples.ZkConfigFilesTest.xml
> > > > ./solr/solr-ref-guide/build/test-results/test/TEST-org.apache.solr.client.ref_guide_examples.JsonRequestApiHeatmapFacetingTest.xml
> > > > ./solr/prometheus-exporter/build/test-results/test/TEST-org.apache.solr.prometheus.exporter.SolrExporterIntegrationTest.xml
> > > > ./solr/prometheus-exporter/build/test-results/test/TEST-org.apache.solr.prometheus.scraper.SolrStandaloneScraperBasicAuthTest.xml
> > > > ./solr/prometheus-exporter/build/test-results/test/TEST-org.apache.solr.prometheus.exporter.MetricsQueryTemplateTest.xml
> > > > ./solr/prometheus-exporter/build/test-results/test/TEST-org.apache.solr.prometheus.scraper.SolrStandaloneScraperTest.xml
> > > > ./solr/prometheus-exporter/build/test-results/test/TEST-org.apache.solr.prometheus.scraper.SolrCloudScraperTest.xml
> > > >
> > > > Is there some other build command required to generate the other file patterns?
> > > > Thanks,
> > > > -Uv
> > > >
> > > > On Nov 30 2023, at 11:33 am, Yuvraaj Kelkar <uv@crave.io (mailto:uv@crave.io)> wrote:
> > > > > Investigating.
> > > > >
> > > > > On Nov 26 2023, at 12:32 am, Mikhail Khludnev <mkhl@apache.org (mailto:mkhl@apache.org)> wrote:
> > > > > > Pardon
> > > > > >
> > > > > > On Sun, Nov 26, 2023 at 11:28?AM Gautam Worah <worah.gautam@gmail.com (mailto:worah.gautam@gmail.com)> wrote:
> > > > > > > I think you meant to send it to dev@solr.apache.org (mailto:dev@solr.apache.org)?
> > > > > > >
> > > > > > > On Sun, Nov 26, 2023 at 12:24?AM Mikhail Khludnev <mkhl@apache.org (mailto:mkhl@apache.org)> wrote:
> > > > > > > > Hello
> > > > > > > > It's rather like a logical error in crave pull. How to work around it?
> > > > > > > >
> > > > > > > > + status=0
> > > > > > > > + ./crave pull '**/build/**/test/TEST-*.xml' '**/*.events' 'heapdumps/**' '**/hs_err_pid*'
> > > > > > > > Error: rsync: [sender] change_dir "/tmp/src/solr/heapdumps" failed: No such file or directory (2)
> > > > > > > > rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1682) [Receiver=3.1.3]
> > > > > > > > rsync: [Receiver] write error: Broken pipe (32)
> > > > > > > >
> > > > > > > > + exit 0
> > > > > > > > ---------- Forwarded message ---------
> > > > > > > > From: Apache Jenkins Server <jenkins@builds.apache.org (mailto:jenkins@builds.apache.org)>
> > > > > > > > Date: Sun, Nov 26, 2023 at 11:17?AM
> > > > > > > > Subject: [JENKINS] Solr » Solr-Check-9.x - Build # 5949 - Still Failing!
> > > > > > > > To: <builds@solr.apache.org (mailto:builds@solr.apache.org)>
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > Build: https://ci-builds.apache.org/job/Solr/job/Solr-Check-9.x/5949/
> > > > > > > > No tests ran.
> > > > > > > > Build Log:
> > > > > > > > [...truncated 1490 lines...]
> > > > > > > > ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?
> > > > > > > > Email was triggered for: Failure - Any
> > > > > > > > Sending email for trigger: Failure - Any
> > > > > > > >
> > > > > > > > ---------------------------------------------------------------------
> > > > > > > > To unsubscribe, e-mail: builds-unsubscribe@solr.apache.org (mailto:builds-unsubscribe@solr.apache.org)
> > > > > > > > For additional commands, e-mail: builds-help@solr.apache.org (mailto:builds-help@solr.apache.org)
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > --
> > > > > > > > Sincerely yours
> > > > > > > > Mikhail Khludnev
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > > Sincerely yours
> > > > > > Mikhail Khludnev
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> > >
> > >
> > >
> > > --
> > > Sincerely yours
> > > Mikhail Khludnev
> > >
> > >
> > >
> >
>
>
>
>
> --
> Sincerely yours
> Mikhail Khludnev
>
>

Thanks Yuvraaj.
dev@, how to tweak jenkins script?

On Sat, Dec 2, 2023 at 9:25?PM Yuvraaj Kelkar <uv@crave.io> wrote:

> The new version of crave is in place and will be used automatically on the
> next invocation from Jenkins.
> Can you update the Jenkins script to call crave like this:
>
> ./crave pull --extra-rsync-flags ' --ignore-missing-args'
> '**/build/**/test/TEST-*.xml' '**/*.events' 'heapdumps/**' '**/hs_err_pid*'
>
>
> Release has been marked here:
> https://github.com/accupara/crave/releases/tag/0.2-6879
> <https://link.getmailspring.com/link/010A76BD-7093-4BFD-980E-9902966570FF@getmailspring.com/0?redirect=https%3A%2F%2Fgithub.com%2Faccupara%2Fcrave%2Freleases%2Ftag%2F0.2-6879&recipient=ZGV2QGx1Y2VuZS5hcGFjaGUub3Jn>
>
> Thanks,
> -Uv
> On Dec 1 2023, at 11:10 am, Mikhail Khludnev <mkhl@apache.org> wrote:
>
> Make sense.
>
> [image: Sent from Mailspring]
> On Fri, Dec 1, 2023 at 7:56?PM Yuvraaj Kelkar <uv@crave.io> wrote:
>
> I think the second option is what we'll go for.
> I'm going to add a flag to pull that will allow the user to specify extra
> flags to be given to rsync.
> Then we can call crave pull like this:
> ./crave pull --extra-rsync-flags ' --ignore-missing-args'
> '**/build/**/test/TEST-*.xml' '**/*.events' 'heapdumps/**' '**/hs_err_pid*'
>
>
> *** Note the additional space before the hypen in ' --ignore-missing-args'
> .
>
> This should handle the missing source files/directories.
>
> What do you think?
>
> Thanks,
> -Uv
>
> On Dec 1 2023, at 12:56 am, Mikhail Khludnev <mkhl@apache.org> wrote:
>
> Hello Yuvraaj,
> Thanks for taking care of this. Honestly it's not my wheelhouse.
> I seems like there's a consideration that a test getting out of heap will
> create heapdumps folder and put a file into. I don't know wether
> test/gradle can dump heap there ever. At least we don't have tests dumps
> heap there now. So, whether this folder exists or is absent is not certain.
> We have a few options:
> - drop heapdumps/** from crave pull until someone needs to investigate a
> test falling out of memory.
> - hack crave pull to ignore path wildcards for absent dir
> - execute $mkdir heapdumps or $mkdir -p heapdumps (depending on script's
> error handling more) before $crave pull
>
>
> On Thu, Nov 30, 2023 at 11:24?PM Yuvraaj Kelkar <uv@crave.io> wrote:
>
> I just started a build with crave:
> crave run ./gradlew --console=plain check integrationTests
>
> And at the end of it, looked for the patterns in the crave pull command:
>
> admin@171074329f9e:/tmp/src/solr$ find . -name '*.events'
> admin@171074329f9e:/tmp/src/solr$ find . -name 'hs_err_pid*'
> admin@171074329f9e:/tmp/src/solr$
> admin@171074329f9e:/tmp/src/solr$ ls -l heapdumps
> ls: cannot access 'heapdumps': No such file or directory
>
>
> The only thing I could get a lot of output on was
>
> admin@171074329f9e:/tmp/src/solr$ find . | grep 'build.*test.TEST' | head
> ./solr/solr-ref-guide/build/test-results/test/TEST-org.apache.solr.client.ref_guide_examples.JsonRequestApiTest.xml
> ./solr/solr-ref-guide/build/test-results/test/TEST-org.apache.solr.client.ref_guide_examples.UsingSolrJRefGuideExamplesTest.xml <https://link.getmailspring.com/link/A1463805-BFD9-43A5-BD19-08E9AE1A4450@getmailspring.com/0?redirect=TEST-org.apache.solr.client.ref_guide_examples.UsingSolrJRefGuideExamplesTest.xml&recipient=ZGV2QGx1Y2VuZS5hcGFjaGUub3Jn>
> ./solr/solr-ref-guide/build/test-results/test/TEST-org.apache.solr.client.ref_guide_examples.IndexingNestedDocuments.xml
> ./solr/solr-ref-guide/build/test-results/test/TEST-org.apache.solr.client.ref_guide_examples.ZkConfigFilesTest.xml
> ./solr/solr-ref-guide/build/test-results/test/TEST-org.apache.solr.client.ref_guide_examples.JsonRequestApiHeatmapFacetingTest.xml
> ./solr/prometheus-exporter/build/test-results/test/TEST-org.apache.solr.prometheus.exporter.SolrExporterIntegrationTest.xml
> ./solr/prometheus-exporter/build/test-results/test/TEST-org.apache.solr.prometheus.scraper.SolrStandaloneScraperBasicAuthTest.xml
> ./solr/prometheus-exporter/build/test-results/test/TEST-org.apache.solr.prometheus.exporter.MetricsQueryTemplateTest.xml
> ./solr/prometheus-exporter/build/test-results/test/TEST-org.apache.solr.prometheus.scraper.SolrStandaloneScraperTest.xml
> ./solr/prometheus-exporter/build/test-results/test/TEST-org.apache.solr.prometheus.scraper.SolrCloudScraperTest.xml
>
>
> Is there some other build command required to generate the other file
> patterns?
>
> Thanks,
> -Uv
>
> On Nov 30 2023, at 11:33 am, Yuvraaj Kelkar <uv@crave.io> wrote:
>
> Investigating.
>
> On Nov 26 2023, at 12:32 am, Mikhail Khludnev <mkhl@apache.org> wrote:
>
> Pardon
>
> On Sun, Nov 26, 2023 at 11:28?AM Gautam Worah <worah.gautam@gmail.com>
> wrote:
>
> I think you meant to send it to dev@solr.apache.org?
>
> On Sun, Nov 26, 2023 at 12:24?AM Mikhail Khludnev <mkhl@apache.org> wrote:
>
> Hello
> It's rather like a logical error in crave pull. How to work around it?
>
> + status=0
> + ./crave pull '**/build/**/test/TEST-*.xml' '**/*.events' 'heapdumps/**' '**/hs_err_pid*'
> Error: rsync: [sender] change_dir "/tmp/src/solr/heapdumps" failed: No such file or directory (2)
> rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1682) [Receiver=3.1.3]
> rsync: [Receiver] write error: Broken pipe (32)
>
> + exit 0
>
>
> ---------- Forwarded message ---------
> From: *Apache Jenkins Server* <jenkins@builds.apache.org>
> Date: Sun, Nov 26, 2023 at 11:17?AM
> Subject: [JENKINS] Solr » Solr-Check-9.x - Build # 5949 - Still Failing!
> To: <builds@solr.apache.org>
>
>
> Build: https://ci-builds.apache.org/job/Solr/job/Solr-Check-9.x/5949/
>
> No tests ran.
>
> Build Log:
> [...truncated 1490 lines...]
> ERROR: Step ‘Publish JUnit test result report’ failed: No test report
> files were found. Configuration error?
> Email was triggered for: Failure - Any
> Sending email for trigger: Failure - Any
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: builds-unsubscribe@solr.apache.org
> For additional commands, e-mail: builds-help@solr.apache.org
>
>
> --
> Sincerely yours
> Mikhail Khludnev
>
>
>
> --
> Sincerely yours
> Mikhail Khludnev
>
>
>
> --
> Sincerely yours
> Mikhail Khludnev
>
>
>
> --
> Sincerely yours
> Mikhail Khludnev
>
>

--
Sincerely yours
Mikhail Khludnev

I updated the script accordingly and I still see the problem:

https://ci-builds.apache.org/job/Solr/job/Solr-Check-9.x/6008/console

+ status=0
+ ./crave pull --extra-rsync-flags ' --ignore-missing-args'
'**/build/**/test/TEST-*.xml' '**/*.events' 'heapdumps/**'
'**/hs_err_pid*'
Error: rsync: [sender] change_dir "/tmp/src/solr/heapdumps" failed: No
such file or directory (2)
rsync error: some files/attrs were not transferred (see previous
errors) (code 23) at main.c(1675) [Receiver=3.1.2]
rsync: [Receiver] write error: Broken pipe (32)

~ David


On Sat, Dec 2, 2023 at 5:55?PM Mikhail Khludnev <mkhl@apache.org> wrote:

> Thanks Yuvraaj.
> dev@, how to tweak jenkins script?
>
> On Sat, Dec 2, 2023 at 9:25?PM Yuvraaj Kelkar <uv@crave.io> wrote:
>
>> The new version of crave is in place and will be used automatically on
>> the next invocation from Jenkins.
>> Can you update the Jenkins script to call crave like this:
>>
>> ./crave pull --extra-rsync-flags ' --ignore-missing-args'
>> '**/build/**/test/TEST-*.xml' '**/*.events' 'heapdumps/**' '**/hs_err_pid*'
>>
>>
>> Release has been marked here:
>> https://github.com/accupara/crave/releases/tag/0.2-6879
>> <https://link.getmailspring.com/link/010A76BD-7093-4BFD-980E-9902966570FF@getmailspring.com/0?redirect=https%3A%2F%2Fgithub.com%2Faccupara%2Fcrave%2Freleases%2Ftag%2F0.2-6879&recipient=ZGV2QGx1Y2VuZS5hcGFjaGUub3Jn>
>>
>> Thanks,
>> -Uv
>> On Dec 1 2023, at 11:10 am, Mikhail Khludnev <mkhl@apache.org> wrote:
>>
>> Make sense.
>>
>> [image: Sent from Mailspring]
>> On Fri, Dec 1, 2023 at 7:56?PM Yuvraaj Kelkar <uv@crave.io> wrote:
>>
>> I think the second option is what we'll go for.
>> I'm going to add a flag to pull that will allow the user to specify extra
>> flags to be given to rsync.
>> Then we can call crave pull like this:
>> ./crave pull --extra-rsync-flags ' --ignore-missing-args'
>> '**/build/**/test/TEST-*.xml' '**/*.events' 'heapdumps/**' '**/hs_err_pid*'
>>
>>
>> *** Note the additional space before the hypen in '
>> --ignore-missing-args' .
>>
>> This should handle the missing source files/directories.
>>
>> What do you think?
>>
>> Thanks,
>> -Uv
>>
>> On Dec 1 2023, at 12:56 am, Mikhail Khludnev <mkhl@apache.org> wrote:
>>
>> Hello Yuvraaj,
>> Thanks for taking care of this. Honestly it's not my wheelhouse.
>> I seems like there's a consideration that a test getting out of heap will
>> create heapdumps folder and put a file into. I don't know wether
>> test/gradle can dump heap there ever. At least we don't have tests dumps
>> heap there now. So, whether this folder exists or is absent is not certain.
>> We have a few options:
>> - drop heapdumps/** from crave pull until someone needs to investigate a
>> test falling out of memory.
>> - hack crave pull to ignore path wildcards for absent dir
>> - execute $mkdir heapdumps or $mkdir -p heapdumps (depending on
>> script's error handling more) before $crave pull
>>
>>
>> On Thu, Nov 30, 2023 at 11:24?PM Yuvraaj Kelkar <uv@crave.io> wrote:
>>
>> I just started a build with crave:
>> crave run ./gradlew --console=plain check integrationTests
>>
>> And at the end of it, looked for the patterns in the crave pull command:
>>
>> admin@171074329f9e:/tmp/src/solr$ find . -name '*.events'
>> admin@171074329f9e:/tmp/src/solr$ find . -name 'hs_err_pid*'
>> admin@171074329f9e:/tmp/src/solr$
>> admin@171074329f9e:/tmp/src/solr$ ls -l heapdumps
>> ls: cannot access 'heapdumps': No such file or directory
>>
>>
>> The only thing I could get a lot of output on was
>>
>> admin@171074329f9e:/tmp/src/solr$ find . | grep 'build.*test.TEST' | head
>> ./solr/solr-ref-guide/build/test-results/test/TEST-org.apache.solr.client.ref_guide_examples.JsonRequestApiTest.xml
>> ./solr/solr-ref-guide/build/test-results/test/TEST-org.apache.solr.client.ref_guide_examples.UsingSolrJRefGuideExamplesTest.xml <https://link.getmailspring.com/link/A1463805-BFD9-43A5-BD19-08E9AE1A4450@getmailspring.com/0?redirect=TEST-org.apache.solr.client.ref_guide_examples.UsingSolrJRefGuideExamplesTest.xml&recipient=ZGV2QGx1Y2VuZS5hcGFjaGUub3Jn>
>> ./solr/solr-ref-guide/build/test-results/test/TEST-org.apache.solr.client.ref_guide_examples.IndexingNestedDocuments.xml
>> ./solr/solr-ref-guide/build/test-results/test/TEST-org.apache.solr.client.ref_guide_examples.ZkConfigFilesTest.xml
>> ./solr/solr-ref-guide/build/test-results/test/TEST-org.apache.solr.client.ref_guide_examples.JsonRequestApiHeatmapFacetingTest.xml
>> ./solr/prometheus-exporter/build/test-results/test/TEST-org.apache.solr.prometheus.exporter.SolrExporterIntegrationTest.xml
>> ./solr/prometheus-exporter/build/test-results/test/TEST-org.apache.solr.prometheus.scraper.SolrStandaloneScraperBasicAuthTest.xml
>> ./solr/prometheus-exporter/build/test-results/test/TEST-org.apache.solr.prometheus.exporter.MetricsQueryTemplateTest.xml
>> ./solr/prometheus-exporter/build/test-results/test/TEST-org.apache.solr.prometheus.scraper.SolrStandaloneScraperTest.xml
>> ./solr/prometheus-exporter/build/test-results/test/TEST-org.apache.solr.prometheus.scraper.SolrCloudScraperTest.xml
>>
>>
>> Is there some other build command required to generate the other file
>> patterns?
>>
>> Thanks,
>> -Uv
>>
>> On Nov 30 2023, at 11:33 am, Yuvraaj Kelkar <uv@crave.io> wrote:
>>
>> Investigating.
>>
>> On Nov 26 2023, at 12:32 am, Mikhail Khludnev <mkhl@apache.org> wrote:
>>
>> Pardon
>>
>> On Sun, Nov 26, 2023 at 11:28?AM Gautam Worah <worah.gautam@gmail.com>
>> wrote:
>>
>> I think you meant to send it to dev@solr.apache.org?
>>
>> On Sun, Nov 26, 2023 at 12:24?AM Mikhail Khludnev <mkhl@apache.org>
>> wrote:
>>
>> Hello
>> It's rather like a logical error in crave pull. How to work around it?
>>
>> + status=0
>> + ./crave pull '**/build/**/test/TEST-*.xml' '**/*.events' 'heapdumps/**' '**/hs_err_pid*'
>> Error: rsync: [sender] change_dir "/tmp/src/solr/heapdumps" failed: No such file or directory (2)
>> rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1682) [Receiver=3.1.3]
>> rsync: [Receiver] write error: Broken pipe (32)
>>
>> + exit 0
>>
>>
>> ---------- Forwarded message ---------
>> From: *Apache Jenkins Server* <jenkins@builds.apache.org>
>> Date: Sun, Nov 26, 2023 at 11:17?AM
>> Subject: [JENKINS] Solr » Solr-Check-9.x - Build # 5949 - Still Failing!
>> To: <builds@solr.apache.org>
>>
>>
>> Build: https://ci-builds.apache.org/job/Solr/job/Solr-Check-9.x/5949/
>>
>> No tests ran.
>>
>> Build Log:
>> [...truncated 1490 lines...]
>> ERROR: Step ‘Publish JUnit test result report’ failed: No test report
>> files were found. Configuration error?
>> Email was triggered for: Failure - Any
>> Sending email for trigger: Failure - Any
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: builds-unsubscribe@solr.apache.org
>> For additional commands, e-mail: builds-help@solr.apache.org
>>
>>
>> --
>> Sincerely yours
>> Mikhail Khludnev
>>
>>
>>
>> --
>> Sincerely yours
>> Mikhail Khludnev
>>
>>
>>
>> --
>> Sincerely yours
>> Mikhail Khludnev
>>
>>
>>
>> --
>> Sincerely yours
>> Mikhail Khludnev
>>
>>
>
> --
> Sincerely yours
> Mikhail Khludnev
>

Investingating

On Dec 3 2023, at 2:44 pm, David Smiley <david.w.smiley@gmail.com> wrote:
> I updated the script accordingly and I still see the problem:
>
> https://ci-builds.apache.org/job/Solr/job/Solr-Check-9.x/6008/console (https://link.getmailspring.com/link/AF58603E-FB74-492A-8190-F5B8275DB6AD@getmailspring.com/0?redirect=https%3A%2F%2Fci-builds.apache.org%2Fjob%2FSolr%2Fjob%2FSolr-Check-9.x%2F6008%2Fconsole&recipient=ZGV2QGx1Y2VuZS5hcGFjaGUub3Jn)
> + status=0
> + ./crave pull --extra-rsync-flags ' --ignore-missing-args' '**/build/**/test/TEST-*.xml' '**/*.events' 'heapdumps/**' '**/hs_err_pid*'
> Error: rsync: [sender] change_dir "/tmp/src/solr/heapdumps" failed: No such file or directory (2)
> rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1675) [Receiver=3.1.2]
> rsync: [Receiver] write error: Broken pipe (32)
> ~ David
>
>
>
>
>
>
>
>
> On Sat, Dec 2, 2023 at 5:55?PM Mikhail Khludnev <mkhl@apache.org (mailto:mkhl@apache.org)> wrote:
> > Thanks Yuvraaj.
> > dev@, how to tweak jenkins script?
> >
> >
> > On Sat, Dec 2, 2023 at 9:25?PM Yuvraaj Kelkar <uv@crave.io (mailto:uv@crave.io)> wrote:
> > > The new version of crave is in place and will be used automatically on the next invocation from Jenkins.
> > > Can you update the Jenkins script to call crave like this:
> > >
> > > ./crave pull --extra-rsync-flags ' --ignore-missing-args' '**/build/**/test/TEST-*.xml' '**/*.events' 'heapdumps/**' '**/hs_err_pid*'
> > > Release has been marked here: https://github.com/accupara/crave/releases/tag/0.2-6879 (https://link.getmailspring.com/link/010A76BD-7093-4BFD-980E-9902966570FF@getmailspring.com/0?redirect=https%3A%2F%2Fgithub.com%2Faccupara%2Fcrave%2Freleases%2Ftag%2F0.2-6879&recipient=ZGV2QGx1Y2VuZS5hcGFjaGUub3Jn)
> > > Thanks,
> > > -Uv
> > > On Dec 1 2023, at 11:10 am, Mikhail Khludnev <mkhl@apache.org (mailto:mkhl@apache.org)> wrote:
> > > > Make sense.
> > > >
> > > > On Fri, Dec 1, 2023 at 7:56?PM Yuvraaj Kelkar <uv@crave.io (mailto:uv@crave.io)> wrote:
> > > > > I think the second option is what we'll go for.
> > > > > I'm going to add a flag to pull that will allow the user to specify extra flags to be given to rsync.
> > > > > Then we can call crave pull like this:
> > > > > ./crave pull --extra-rsync-flags ' --ignore-missing-args' '**/build/**/test/TEST-*.xml' '**/*.events' 'heapdumps/**' '**/hs_err_pid*'
> > > > >
> > > > > *** Note the additional space before the hypen in ' --ignore-missing-args' .
> > > > > This should handle the missing source files/directories.
> > > > > What do you think?
> > > > > Thanks,
> > > > > -Uv
> > > > >
> > > > > On Dec 1 2023, at 12:56 am, Mikhail Khludnev <mkhl@apache.org (mailto:mkhl@apache.org)> wrote:
> > > > > > Hello Yuvraaj,
> > > > > > Thanks for taking care of this. Honestly it's not my wheelhouse.
> > > > > > I seems like there's a consideration that a test getting out of heap will create heapdumps folder and put a file into. I don't know wether test/gradle can dump heap there ever. At least we don't have tests dumps heap there now. So, whether this folder exists or is absent is not certain.
> > > > > > We have a few options:
> > > > > > - drop heapdumps/** from crave pull until someone needs to investigate a test falling out of memory.
> > > > > > - hack crave pull to ignore path wildcards for absent dir
> > > > > > - execute $mkdir heapdumps or $mkdir -p heapdumps (depending on script's error handling more) before $crave pull
> > > > > >
> > > > > >
> > > > > > On Thu, Nov 30, 2023 at 11:24?PM Yuvraaj Kelkar <uv@crave.io (mailto:uv@crave.io)> wrote:
> > > > > > > I just started a build with crave:
> > > > > > > crave run ./gradlew --console=plain check integrationTests
> > > > > > >
> > > > > > > And at the end of it, looked for the patterns in the crave pull command:
> > > > > > >
> > > > > > > admin@171074329f9e:/tmp/src/solr$ find . -name '*.events'
> > > > > > > admin@171074329f9e:/tmp/src/solr$ find . -name 'hs_err_pid*'
> > > > > > > admin@171074329f9e:/tmp/src/solr$
> > > > > > > admin@171074329f9e:/tmp/src/solr$ ls -l heapdumps
> > > > > > > ls: cannot access 'heapdumps': No such file or directory
> > > > > > >
> > > > > > > The only thing I could get a lot of output on was
> > > > > > >
> > > > > > > admin@171074329f9e:/tmp/src/solr$ find . | grep 'build.*test.TEST' | head
> > > > > > > ./solr/solr-ref-guide/build/test-results/test/TEST-org.apache.solr.client.ref_guide_examples.JsonRequestApiTest.xml
> > > > > > > ./solr/solr-ref-guide/build/test-results/test/TEST-org.apache.solr.client.ref_guide_examples.UsingSolrJRefGuideExamplesTest.xml (https://link.getmailspring.com/link/A1463805-BFD9-43A5-BD19-08E9AE1A4450@getmailspring.com/0?redirect=TEST-org.apache.solr.client.ref_guide_examples.UsingSolrJRefGuideExamplesTest.xml&recipient=ZGV2QGx1Y2VuZS5hcGFjaGUub3Jn)
> > > > > > > ./solr/solr-ref-guide/build/test-results/test/TEST-org.apache.solr.client.ref_guide_examples.IndexingNestedDocuments.xml
> > > > > > > ./solr/solr-ref-guide/build/test-results/test/TEST-org.apache.solr.client.ref_guide_examples.ZkConfigFilesTest.xml
> > > > > > > ./solr/solr-ref-guide/build/test-results/test/TEST-org.apache.solr.client.ref_guide_examples.JsonRequestApiHeatmapFacetingTest.xml
> > > > > > > ./solr/prometheus-exporter/build/test-results/test/TEST-org.apache.solr.prometheus.exporter.SolrExporterIntegrationTest.xml
> > > > > > > ./solr/prometheus-exporter/build/test-results/test/TEST-org.apache.solr.prometheus.scraper.SolrStandaloneScraperBasicAuthTest.xml
> > > > > > > ./solr/prometheus-exporter/build/test-results/test/TEST-org.apache.solr.prometheus.exporter.MetricsQueryTemplateTest.xml
> > > > > > > ./solr/prometheus-exporter/build/test-results/test/TEST-org.apache.solr.prometheus.scraper.SolrStandaloneScraperTest.xml
> > > > > > > ./solr/prometheus-exporter/build/test-results/test/TEST-org.apache.solr.prometheus.scraper.SolrCloudScraperTest.xml
> > > > > > >
> > > > > > > Is there some other build command required to generate the other file patterns?
> > > > > > > Thanks,
> > > > > > > -Uv
> > > > > > >
> > > > > > > On Nov 30 2023, at 11:33 am, Yuvraaj Kelkar <uv@crave.io (mailto:uv@crave.io)> wrote:
> > > > > > > > Investigating.
> > > > > > > >
> > > > > > > > On Nov 26 2023, at 12:32 am, Mikhail Khludnev <mkhl@apache.org (mailto:mkhl@apache.org)> wrote:
> > > > > > > > > Pardon
> > > > > > > > >
> > > > > > > > > On Sun, Nov 26, 2023 at 11:28?AM Gautam Worah <worah.gautam@gmail.com (mailto:worah.gautam@gmail.com)> wrote:
> > > > > > > > > > I think you meant to send it to dev@solr.apache.org (mailto:dev@solr.apache.org)?
> > > > > > > > > >
> > > > > > > > > > On Sun, Nov 26, 2023 at 12:24?AM Mikhail Khludnev <mkhl@apache.org (mailto:mkhl@apache.org)> wrote:
> > > > > > > > > > > Hello
> > > > > > > > > > > It's rather like a logical error in crave pull. How to work around it?
> > > > > > > > > > >
> > > > > > > > > > > + status=0
> > > > > > > > > > > + ./crave pull '**/build/**/test/TEST-*.xml' '**/*.events' 'heapdumps/**' '**/hs_err_pid*'
> > > > > > > > > > > Error: rsync: [sender] change_dir "/tmp/src/solr/heapdumps" failed: No such file or directory (2)
> > > > > > > > > > > rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1682) [Receiver=3.1.3]
> > > > > > > > > > > rsync: [Receiver] write error: Broken pipe (32)
> > > > > > > > > > >
> > > > > > > > > > > + exit 0
> > > > > > > > > > > ---------- Forwarded message ---------
> > > > > > > > > > > From: Apache Jenkins Server <jenkins@builds.apache.org (mailto:jenkins@builds.apache.org)>
> > > > > > > > > > > Date: Sun, Nov 26, 2023 at 11:17?AM
> > > > > > > > > > > Subject: [JENKINS] Solr » Solr-Check-9.x - Build # 5949 - Still Failing!
> > > > > > > > > > > To: <builds@solr.apache.org (mailto:builds@solr.apache.org)>
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > Build: https://ci-builds.apache.org/job/Solr/job/Solr-Check-9.x/5949/
> > > > > > > > > > > No tests ran.
> > > > > > > > > > > Build Log:
> > > > > > > > > > > [...truncated 1490 lines...]
> > > > > > > > > > > ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?
> > > > > > > > > > > Email was triggered for: Failure - Any
> > > > > > > > > > > Sending email for trigger: Failure - Any
> > > > > > > > > > >
> > > > > > > > > > > ---------------------------------------------------------------------
> > > > > > > > > > > To unsubscribe, e-mail: builds-unsubscribe@solr.apache.org (mailto:builds-unsubscribe@solr.apache.org)
> > > > > > > > > > > For additional commands, e-mail: builds-help@solr.apache.org (mailto:builds-help@solr.apache.org)
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > --
> > > > > > > > > > > Sincerely yours
> > > > > > > > > > > Mikhail Khludnev
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > --
> > > > > > > > > Sincerely yours
> > > > > > > > > Mikhail Khludnev
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > > Sincerely yours
> > > > > > Mikhail Khludnev
> > > > > >
> > > > > >
> > > > > >
> > > > >
> > > >
> > > >
> > > >
> > > >
> > > > --
> > > > Sincerely yours
> > > > Mikhail Khludnev
> > > >
> > > >
> > >
> >
> >
> >
> >
> > --
> > Sincerely yours
> > Mikhail Khludnev
> >
> >
>
>