Mailing List Archive

1 2  View All
Re: [VOTE] Release Lucene/Solr 8.9.0 RC1 [ In reply to ]
+1 (binding)

SUCCESS! [1:06:13.636144]

Also tried basic indexing and querying and it looks good!

On Tue, Jun 15, 2021 at 10:54 AM Uwe Schindler <uwe@thetaphi.de> wrote:

> Hi again, short update to my previous mail:
>
> New maven metadata artifacts work fine, I was able to build a Solr plugin
> of a customer after adding 2 repos to its POM. It then downloaded the
> internet and Solr and plugin built sucessfully (including tests using the
> solr test framework, indirectly also testing lucene test framework):
>
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD SUCCESS
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 02:27 min
> [INFO] Finished at: 2021-06-15T19:44:09+02:00
> [INFO]
> ------------------------------------------------------------------------
>
>
> In case you want to try:
>
> <repositories>
> <repository>
> <id>lucene</id>
> <url>
> https://dist.apache.org/repos/dist/dev/lucene/lucene-solr-8.9.0-RC1-rev05c8a6f0163fe4c330e93775e8e91f3ab66a3f80/lucene/maven/
> </url>
> </repository>
> <repository>
> <id>solr</id>
> <url>
> https://dist.apache.org/repos/dist/dev/lucene/lucene-solr-8.9.0-RC1-rev05c8a6f0163fe4c330e93775e8e91f3ab66a3f80/solr/maven/
> </url>
> </repository>
> </repositories>
>
> You can also try this out, but be sure to remove the dowloaded artifacts
> from your local repository, if we need to respin the release process!
>
> Uwe
>
> -----
> Uwe Schindler
> Achterdiek 19, D-28357 Bremen
> https://www.thetaphi.de
> eMail: uwe@thetaphi.de
>
> > -----Original Message-----
> > From: Uwe Schindler <uwe@thetaphi.de>
> > Sent: Tuesday, June 15, 2021 7:27 PM
> > To: dev@lucene.apache.org
> > Subject: RE: [VOTE] Release Lucene/Solr 8.9.0 RC1
> >
> > +1
> >
> > SUCCESS! [1:24:00.227990]
> >
> > Policeman Jenkins tested it for me:
> https://jenkins.thetaphi.de/job/Lucene-Solr-
> > Release-Tester/36/console
> > I had not much time to do my own checks of targz artifacts, so I trust
> the
> > technical workflow.
> >
> > I only checked the maven folders and verified that the new POM layout
> looks
> > fine, but I did not do a test build of a Solr plugin this time (I did
> this before
> > committing the change). The release artifacts are a bit complicated to
> use as
> > it's 2 repos.
> >
> > Uwe
> >
> > -----
> > Uwe Schindler
> > Achterdiek 19, D-28357 Bremen
> > https://www.thetaphi.de
> > eMail: uwe@thetaphi.de
> >
> > > -----Original Message-----
> > > From: Atri Sharma <atri@apache.org>
> > > Sent: Tuesday, June 15, 2021 5:00 PM
> > > To: Lucene Dev <dev@lucene.apache.org>
> > > Subject: Re: [VOTE] Release Lucene/Solr 8.9.0 RC1
> > >
> > > +1 SUCCESS! [1:32:12.04043]
> > >
> > > On Tue, Jun 15, 2021 at 8:27 PM Adrien Grand <jpountz@gmail.com>
> wrote:
> > > >
> > > > +1 SUCCESS! [1:36:12.056443]
> > > >
> > > > On Tue, Jun 15, 2021 at 4:26 PM Mayya Sharipova
> > > <mayya.sharipova@elastic.co.invalid> wrote:
> > > >>
> > > >> Thanks Robert for such detailed investigations.
> > > >>
> > > >> Lucene-Solr-SmokeRelease-8.9 also had 2 recent failures. Failures
> are not
> > > reproducible on my local machine.
> > > >>
> > > >> build #13: ant test -Dtestcase=SolrCloudReportersTest -
> > > Dtests.method=testExplicitConfiguration -Dtests.seed=60FEAB39C2B47705 -
> > > Dtests.multiplier=2 -Dtests.locale=ro-RO
> -Dtests.timezone=Africa/Brazzaville -
> > > Dtests.asserts=true -Dtests.file.encoding=UTF-8
> > > >> build# 12: ant test -Dtestcase=LeaderTragicEventTest -
> > > Dtests.method=testLeaderFailsOver -Dtests.seed=BB301A174F4BDB5 -
> > > Dtests.multiplier=2 -Dtests.locale=sr-Latn-RS
> -Dtests.timezone=Africa/Bissau -
> > > Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
> > > >>
> > > >> On Sat, Jun 12, 2021 at 5:06 PM Robert Muir <rcmuir@gmail.com>
> wrote:
> > > >>>
> > > >>> OK I managed to finally get this smoketester to pass on my
> machine, so
> > > >>> for THIS release I will retract my -1 and change it to a +1.
> > > >>>
> > > >>> I have reset my system configuration back though, so we should
> really
> > > >>> fix these test problems for the future.
> > > >>>
> > > >>> SUCCESS! [1:08:26.448122]
> > > >>>
> > > >>> There were a few compounding issues, I will break out some issues a
> > > >>> bit later. I don't think they need to be blockers for THIS release,
> > > >>> but let's please fix them! I can help try to dig on each one, but
> here
> > > >>> are the biggest two problems:
> > > >>>
> > > >>> 1. some solr tests don't obey their sandbox and fail with
> > > >>> tests.workDir (if it is set in the user's build.properties). These
> > > >>> tests try to access wrong parts of the filesystem which can cause
> > > >>> tests to meddle with each other. obeying the test sandbox
> > > >>> (tests.workDir) is important, it is how I prevent these tests from
> > > >>> destroying my SSDs.
> > > >>>
> > > >>> 2. some solr HDFS tests will falsely fail if they "think" disk
> space
> > > >>> is low (even when it is not running out). They dump megabytes of
> > > >>> output, but this part is the key:
> > > >>>
> > > >>> [junit4] 2> 1000960 WARN (IPC Server handler 3 on 33951) [
> ]
> > > >>> o.a.h.h.s.b.BlockPlacementPolicy Failed to place enough replicas,
> > > >>> still in need of 2 to reach 2 (unavailableStorages=[],
> > > >>> storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK],
> > > >>> creationFallbacks=[], replicationFallbacks=[ARCHIVE]},
> newBlock=true)
> > > >>> For more information, please enable DEBUG log level on
> > > >>> org.apache.hadoop.hdfs.server.blockmanagement.BlockPlacementPolicy
> > > and
> > > >>> org.apache.hadoop.net.NetworkTopology
> > > >>> [junit4] 2> 1000960 WARN (IPC Server handler 3 on 33951) [
> ]
> > > >>> o.a.h.h.p.BlockStoragePolicy Failed to place enough replicas:
> expected
> > > >>> size is 2 but only 0 storage types can be selected (replication=2,
> > > >>> selected=[], unavailable=[DISK], removed=[DISK, DISK],
> > > >>> policy=BlockStoragePolicy{HOT:7, storageTypes=[DISK],
> > > >>> creationFallbacks=[], replicationFallbacks=[ARCHIVE]})
> > > >>> [junit4] 2> 1000960 WARN (IPC Server handler 3 on 33951) [
> ]
> > > >>> o.a.h.h.s.b.BlockPlacementPolicy Failed to place enough replicas,
> > > >>> still in need of 2 to reach 2 (unavailableStorages=[DISK],
> > > >>> storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK],
> > > >>> creationFallbacks=[], replicationFallbacks=[ARCHIVE]},
> newBlock=true)
> > > >>> All required storage types are unavailable:
> > > >>> unavailableStorages=[DISK], storagePolicy=BlockStoragePolicy{HOT:7,
> > > >>> storageTypes=[DISK], creationFallbacks=[],
> > > >>> replicationFallbacks=[ARCHIVE]}
> > > >>> [junit4] 2> 1000961 WARN (Thread-2642) [ ]
> > > >>> o.a.h.h.DataStreamer DataStreamer Exception
> > > >>> [junit4] 2> =>
> > > >>> org.apache.hadoop.ipc.RemoteException(java.io.IOException): File
> > > >>> /testfile could only be written to 0 of the 1 minReplication nodes.
> > > >>> There are 2 datanode(s) running and 2 node(s) are excluded in this
> > > >>> operation.
> > > >>>
> > > >>> So I think these tests should be tweaked to not require gigabytes
> of
> > > >>> free space to pass. (fix the threshold or whatever, or add an
> assume
> > > >>> or something). I worked around the situation by temporarily
> > > >>> repartitioning and giving them another gigabyte (!). In no event
> was
> > > >>> there ever any danger of running out of space! They just falsely
> fail
> > > >>> even when there are hundreds of MB available. Seems they have some
> > > >>> kind of bogus threshold in the algorithm (e.g. inspecting
> percentages
> > > >>> or something).
> > > >>>
> > > >>> On Sat, Jun 12, 2021 at 12:22 PM Robert Muir <rcmuir@gmail.com>
> > wrote:
> > > >>> >
> > > >>> > The tests also aren't "timing out". They are failing.
> > > >>> >
> > > >>> > On Sat, Jun 12, 2021 at 12:21 PM Robert Muir <rcmuir@gmail.com>
> > > wrote:
> > > >>> > >
> > > >>> > > Ishan, no, they arent running out of resources, not even
> close. I have
> > > >>> > > 20GB of ram and by default it is only using 3 JVMs.
> > > >>> > >
> > > >>> > > On Sat, Jun 12, 2021 at 12:04 PM Ishan Chattopadhyaya
> > > >>> > > <ichattopadhyaya@gmail.com> wrote:
> > > >>> > > >
> > > >>> > > > Hi Rob, could it be possible that the tests are timing out
> on your
> > > machine due to lack of resources? Can you try running them with just
> just one
> > > JVM at a time?
> > > >>> > > >
> > > >>> > > > On Sat, 12 Jun, 2021, 8:20 pm Robert Muir, <rcmuir@gmail.com
> >
> > > wrote:
> > > >>> > > >>
> > > >>> > > >> I ran smoketester yet one more time and again numerous
> tests fail:
> > > >>> > > >>
> > > >>> > > >> [junit4] Tests with failures [seed: A3FDDCE09965D7AE]
> (first 10
> > > out of 18):
> > > >>> > > >> [junit4] -
> > > org.apache.solr.update.TestHdfsUpdateLog.testFSThreadSafety
> > > >>> > > >> [junit4] - org.apache.solr.update.TestHdfsUpdateLog
> (suite)
> > > >>> > > >> [junit4] -
> > > >>> > > >>
> > >
> org.apache.solr.cloud.hdfs.HDFSCollectionsAPITest.testDataDirIsNotReused
> > > >>> > > >> [junit4] -
> > > org.apache.solr.cloud.hdfs.HdfsRecoverLeaseTest.testBasic
> > > >>> > > >> [junit4] -
> > > >>> > > >>
> > org.apache.solr.cloud.hdfs.HdfsRecoverLeaseTest.testMultiThreaded
> > > >>> > > >> [junit4] -
> org.apache.solr.cloud.hdfs.HdfsRecoverLeaseTest
> > (suite)
> > > >>> > > >> [junit4] -
> > > >>> > > >>
> > >
> >
> org.apache.solr.core.backup.repository.HdfsBackupRepositoryIntegrationTest.te
> > > stCanDistinguishBetweenFilesAndDirectories
> > > >>> > > >> [junit4] -
> > > >>> > > >>
> > >
> >
> org.apache.solr.core.backup.repository.HdfsBackupRepositoryIntegrationTest.te
> > > stCanDeleteEmptyOrFullDirectories
> > > >>> > > >> [junit4] -
> > > >>> > > >>
> > >
> >
> org.apache.solr.core.backup.repository.HdfsBackupRepositoryIntegrationTest.te
> > > stCanDeleteIndividualFiles
> > > >>> > > >> [junit4] -
> > > >>> > > >>
> > >
> >
> org.apache.solr.core.backup.repository.HdfsBackupRepositoryIntegrationTest.te
> > > stArbitraryFileDataCanBeStoredAndRetrieved
> > > >>> > > >> [junit4]
> > > >>> > > >> [junit4]
> > > >>> > > >> [junit4] JVM J0: 0.72 .. 1241.80 = 1241.08s
> > > >>> > > >> [junit4] JVM J1: 0.67 .. 1198.72 = 1198.05s
> > > >>> > > >> [junit4] JVM J2: 0.91 .. 1198.75 = 1197.84s
> > > >>> > > >> [junit4] Execution time total: 20 minutes 41 seconds
> > > >>> > > >> [junit4] Tests summary: 939 suites (5 ignored), 4884
> tests, 3
> > > >>> > > >> suite-level errors, 15 errors, 1 failure, 2581 ignored (506
> > > >>> > > >> assumptions)
> > > >>> > > >>
> > > >>> > > >> On Fri, Jun 11, 2021 at 11:52 AM Robert Muir
> > <rcmuir@gmail.com>
> > > wrote:
> > > >>> > > >> >
> > > >>> > > >> > After nuking all settings (i simply removed the whole
> > > >>> > > >> > lucene.build.properties in my homedir), it still fails.
> Seems maybe
> > > >>> > > >> > like less failures though?
> > > >>> > > >> >
> > > >>> > > >> > I will upload logs to the JIRA issue.
> > > >>> > > >> >
> > > >>> > > >> > [junit4] Completed [939/939 (4!)] on J2 in 383.02s, 2
> tests, 1
> > > >>> > > >> > failure <<< FAILURES!
> > > >>> > > >> > [junit4]
> > > >>> > > >> > [junit4]
> > > >>> > > >> > [junit4] Tests with failures [seed: AC205159663D0461]:
> > > >>> > > >> > [junit4] -
> > > org.apache.solr.update.TestHdfsUpdateLog.testFSThreadSafety
> > > >>> > > >> > [junit4] - org.apache.solr.update.TestHdfsUpdateLog
> (suite)
> > > >>> > > >> > [junit4] -
> > > >>> > > >> >
> > org.apache.solr.core.HdfsDirectoryFactoryTest.testLocalityReporter
> > > >>> > > >> > [junit4] -
> > > org.apache.solr.cloud.hdfs.HdfsRecoverLeaseTest.testBasic
> > > >>> > > >> > [junit4] -
> > > >>> > > >> >
> > > org.apache.solr.cloud.hdfs.HdfsRecoverLeaseTest.testMultiThreaded
> > > >>> > > >> > [junit4] -
> org.apache.solr.cloud.hdfs.HdfsRecoverLeaseTest
> > > (suite)
> > > >>> > > >> > [junit4] -
> > > >>> > > >> >
> > >
> org.apache.solr.cloud.api.collections.TestLocalFSCloudBackupRestore.test
> > > >>> > > >> > [junit4]
> > > >>> > > >> > [junit4]
> > > >>> > > >> > [junit4] JVM J0: 0.68 .. 1197.30 = 1196.62s
> > > >>> > > >> > [junit4] JVM J1: 0.71 .. 1113.59 = 1112.89s
> > > >>> > > >> > [junit4] JVM J2: 0.68 .. 1406.83 = 1406.15s
> > > >>> > > >> > [junit4] Execution time total: 23 minutes 26 seconds
> > > >>> > > >> > [junit4] Tests summary: 939 suites (5 ignored), 4884
> tests, 3
> > > >>> > > >> > suite-level errors, 4 errors, 1 failure, 2457 ignored (517
> > > >>> > > >> > assumptions)
> > > >>> > > >> >
> > > >>> > > >> > BUILD FAILED
> > > >>> > > >> >
> > >
> > /tmp/smoke_lucene_8.9.0_05c8a6f0163fe4c330e93775e8e91f3ab66a3f80/un
> > > pack/solr-8.9.0/solr/build.xml:231:
> > > >>> > > >> > The following error occurred while executing this line:
> > > >>> > > >> >
> > >
> > /tmp/smoke_lucene_8.9.0_05c8a6f0163fe4c330e93775e8e91f3ab66a3f80/un
> > > pack/solr-8.9.0/solr/common-build.xml:550:
> > > >>> > > >> > The following error occurred while executing this line:
> > > >>> > > >> >
> > >
> > /tmp/smoke_lucene_8.9.0_05c8a6f0163fe4c330e93775e8e91f3ab66a3f80/un
> > > pack/solr-8.9.0/lucene/common-build.xml:1608:
> > > >>> > > >> > The following error occurred while executing this line:
> > > >>> > > >> >
> > >
> > /tmp/smoke_lucene_8.9.0_05c8a6f0163fe4c330e93775e8e91f3ab66a3f80/un
> > > pack/solr-8.9.0/lucene/common-build.xml:1135:
> > > >>> > > >> > There were test failures: 939 suites (5 ignored), 4884
> tests, 3
> > > >>> > > >> > suite-level errors, 4 errors, 1 failure, 2457 ignored (517
> > > >>> > > >> > assumptions) [seed: AC205159663D0461]
> > > >>> > > >> >
> > > >>> > > >> > Total time: 24 minutes 16 seconds
> > > >>> > > >> >
> > > >>> > > >> >
> > > >>> > > >> > Traceback (most recent call last):
> > > >>> > > >> > File "/home/rmuir/workspace/lucene-solr/dev-
> > > tools/scripts/smokeTestRelease.py",
> > > >>> > > >> > line 1495, in <module>
> > > >>> > > >> > main()
> > > >>> > > >> > File "/home/rmuir/workspace/lucene-solr/dev-
> > > tools/scripts/smokeTestRelease.py",
> > > >>> > > >> > line 1417, in main
> > > >>> > > >> > smokeTest(c.java, c.url, c.revision, c.version,
> c.tmp_dir,
> > > >>> > > >> > c.is_signed, c.local_keys, ' '.join(c.test_args),
> > > >>> > > >> > File "/home/rmuir/workspace/lucene-solr/dev-
> > > tools/scripts/smokeTestRelease.py",
> > > >>> > > >> > line 1483, in smokeTest
> > > >>> > > >> > solrSrcUnpackPath = unpackAndVerify(java, 'solr',
> tmpDir,
> > > >>> > > >> > 'solr-%s-src.tgz' % version,
> > > >>> > > >> > File "/home/rmuir/workspace/lucene-solr/dev-
> > > tools/scripts/smokeTestRelease.py",
> > > >>> > > >> > line 566, in unpackAndVerify
> > > >>> > > >> > verifyUnpacked(java, project, artifact, unpackPath,
> gitRevision,
> > > >>> > > >> > version, testArgs, tmpDir, baseURL)
> > > >>> > > >> > File "/home/rmuir/workspace/lucene-solr/dev-
> > > tools/scripts/smokeTestRelease.py",
> > > >>> > > >> > line 687, in verifyUnpacked
> > > >>> > > >> > java.run_java8('ant clean test -Dtests.slow=false %s'
> %
> > testArgs,
> > > >>> > > >> > '%s/test.log' % unpackPath)
> > > >>> > > >> > File "/home/rmuir/workspace/lucene-solr/dev-
> > > tools/scripts/smokeTestRelease.py",
> > > >>> > > >> > line 1212, in run_java
> > > >>> > > >> > run('%s; %s' % (cmd_prefix, cmd), logfile)
> > > >>> > > >> > File "/home/rmuir/workspace/lucene-solr/dev-
> > > tools/scripts/smokeTestRelease.py",
> > > >>> > > >> > line 500, in run
> > > >>> > > >> > raise RuntimeError('command "%s" failed; see log file
> %s' %
> > > >>> > > >> > (command, logPath))
> > > >>> > > >> > RuntimeError: command "export
> > > >>> > > >> > JAVA_HOME="/home/rmuir/Downloads/jdk8u282-b08"
> > > >>> > > >> > PATH="/home/rmuir/Downloads/jdk8u282-b08/bin:$PATH"
> > > >>> > > >> > JAVACMD="/home/rmuir/Downloads/jdk8u282-b08/bin/java";
> > ant
> > > clean test
> > > >>> > > >> > -Dtests.slow=false -Dtests.badapples=false " failed; see
> log file
> > > >>> > > >> >
> > >
> > /tmp/smoke_lucene_8.9.0_05c8a6f0163fe4c330e93775e8e91f3ab66a3f80/un
> > > pack/solr-8.9.0/test.log
> > > >>> > > >> >
> > > >>> > > >> > On Fri, Jun 11, 2021 at 9:47 AM Robert Muir
> > <rcmuir@gmail.com>
> > > wrote:
> > > >>> > > >> > >
> > > >>> > > >> > > I nuked all my settings and am rerunning with all
> defaults. I'll
> > > >>> > > >> > > report back what happens/upload log when/if it finishes
> or
> > fails.
> > > >>> > > >> > >
> > > >>> > > >> > > On Fri, Jun 11, 2021 at 9:45 AM Michael Sokolov
> > > <msokolov@gmail.com> wrote:
> > > >>> > > >> > > >
> > > >>> > > >> > > > I tried to comment on the JIRA, but it seems to be
> timing out.
> > > Now
> > > >>> > > >> > > > when I go back, SOLR issues are marked as "You can't
> view
> > this
> > > issue
> > > >>> > > >> > > > It may have been deleted or you don't have permission
> to
> > view
> > > it."
> > > >>> > > >> > > > Waat?
> > > >>> > > >> > > >
> > > >>> > > >> > > > Anyway, Robert you suggested there that maybe the
> problem
> > is
> > > being
> > > >>> > > >> > > > surfaced by using a different working directory for
> the tests.
> > Do
> > > you
> > > >>> > > >> > > > think that the tests need to be fixed so that they
> work with
> > this
> > > >>> > > >> > > > tmp.workDir parameter? What if you were to cd to the
> place
> > > you want to
> > > >>> > > >> > > > use as the working dir and call the smokeTester from
> there?
> > > >>> > > >> > > >
> > > >>> > > >> > > >
> > > >>> > > >> > > > On Fri, Jun 11, 2021 at 9:29 AM Mayya Sharipova
> > > >>> > > >> > > > <mayya.sharipova@elastic.co.invalid> wrote:
> > > >>> > > >> > > > >
> > > >>> > > >> > > > > Thanks very much Robert for detailed
> investigations, and
> > > thanks Jan for your tests.
> > > >>> > > >> > > > >
> > > >>> > > >> > > > > I will sort out the problem with my GPG key, but I
> am not
> > > sure what to do with this SOLR-15473. I've run the smoker test again,
> and it
> > > passed on my Mac again: SUCCESS! [1:00:03.751500]
> > > >>> > > >> > > > > Would appreciate more guidance, if we need to
> resolve
> > SOLR-
> > > 15473 before 8.9 release.
> > > >>> > > >> > > > >
> > > >>> > > >> > > > >
> > > >>> > > >> > > > > On Fri, Jun 11, 2021 at 8:09 AM Robert Muir
> > > <rcmuir@gmail.com> wrote:
> > > >>> > > >> > > > >>
> > > >>> > > >> > > > >> Dude, if you can vote +1 when the smoketester
> passes,
> > then
> > > I can vote
> > > >>> > > >> > > > >> -1 when it fails. This is my vote, not your vote.
> You don't
> > get
> > > to
> > > >>> > > >> > > > >> decide about it, or change it in any way.
> > > >>> > > >> > > > >>
> > > >>> > > >> > > > >> On Fri, Jun 11, 2021 at 8:04 AM Jan Høydahl
> > > <jan.asf@cominvent.com> wrote:
> > > >>> > > >> > > > >> >
> > > >>> > > >> > > > >> > Does it reproduce for you? Are you suspecting a
> bug in
> > Solr
> > > that we cannot ship, or only a bug in the smoketester py itself? The
> -1 should
> > > be about the released bits, not about other tooling?
> > > >>> > > >> > > > >> > My JVM is OpenJDK 64-Bit Server VM
> > > (AdoptOpenJDK)(build 25.292-b10, mixed mode)
> > > >>> > > >> > > > >> >
> > > >>> > > >> > > > >> > Jan
> > > >>> > > >> > > > >> >
> > > >>> > > >> > > > >> > > 11. jun. 2021 kl. 13:48 skrev Robert Muir
> > > <rcmuir@gmail.com>:
> > > >>> > > >> > > > >> > >
> > > >>> > > >> > > > >> > > Jan, I'm using the same automated smoketester
> as
> > > everyone else. It
> > > >>> > > >> > > > >> > > fails, so my vote is -1.
> > > >>> > > >> > > > >> > >
> > > >>> > > >> > > > >> > > On Fri, Jun 11, 2021 at 7:22 AM Jan Høydahl
> > > <jan.asf@cominvent.com> wrote:
> > > >>> > > >> > > > >> > >>
> > > >>> > > >> > > > >> > >> Tested on MacOS (Intel), No other
> verification than
> > > smoketester done
> > > >>> > > >> > > > >> > >>
> > > >>> > > >> > > > >> > >> SUCCESS! [1:08:19.953492]
> > > >>> > > >> > > > >> > >>
> > > >>> > > >> > > > >> > >> +1
> > > >>> > > >> > > > >> > >>
> > > >>> > > >> > > > >> > >> Robert - not sure if one test-run failure
> should cancel
> > > the build. Our smoketester and tests are sometimes a bit picky, and
> does not
> > > mean that the artifacts are faulty.
> > > >>> > > >> > > > >> > >>
> > > >>> > > >> > > > >> > >> Jan
> > > >>> > > >> > > > >> > >>
> > > >>> > > >> > > > >> > >> 11. jun. 2021 kl. 04:14 skrev Mayya Sharipova
> > > <mayya.sharipova@elastic.co.INVALID>:
> > > >>> > > >> > > > >> > >>
> > > >>> > > >> > > > >> > >> Please vote for release candidate 1 for
> Lucene/Solr
> > > 8.9.0
> > > >>> > > >> > > > >> > >>
> > > >>> > > >> > > > >> > >> The artifacts can be downloaded from:
> > > >>> > > >> > > > >> > >>
> https://dist.apache.org/repos/dist/dev/lucene/lucene-
> > > solr-8.9.0-RC1-rev05c8a6f0163fe4c330e93775e8e91f3ab66a3f80
> > > >>> > > >> > > > >> > >>
> > > >>> > > >> > > > >> > >> You can run the smoke tester directly with
> this
> > > command:
> > > >>> > > >> > > > >> > >>
> > > >>> > > >> > > > >> > >> python3 -u
> dev-tools/scripts/smokeTestRelease.py \
> > > >>> > > >> > > > >> > >>
> https://dist.apache.org/repos/dist/dev/lucene/lucene-
> > > solr-8.9.0-RC1-rev05c8a6f0163fe4c330e93775e8e91f3ab66a3f80
> > > >>> > > >> > > > >> > >>
> > > >>> > > >> > > > >> > >> The vote will be open for at least 72 hours
> i.e. until
> > > 2021-06-16 02:00 UTC.
> > > >>> > > >> > > > >> > >>
> > > >>> > > >> > > > >> > >> [ ] +1 approve
> > > >>> > > >> > > > >> > >> [ ] +0 no opinion
> > > >>> > > >> > > > >> > >> [ ] -1 disapprove (and reason why)
> > > >>> > > >> > > > >> > >>
> > > >>> > > >> > > > >> > >> Here is my +1
> > > >>> > > >> > > > >> > >> SUCCESS! [0:01:43.815224]
> > > >>> > > >> > > > >> > >>
> > > >>> > > >> > > > >> > >>
> > > >>> > > >> > > > >> > >
> > > >>> > > >> > > > >> > >
> ---------------------------------------------------------------------
> > > >>> > > >> > > > >> > > To unsubscribe, e-mail: dev-
> > > unsubscribe@lucene.apache.org
> > > >>> > > >> > > > >> > > For additional commands, e-mail: dev-
> > > help@lucene.apache.org
> > > >>> > > >> > > > >> > >
> > > >>> > > >> > > > >> >
> > > >>> > > >> > > > >> >
> > > >>> > > >> > > > >> >
> ---------------------------------------------------------------------
> > > >>> > > >> > > > >> > To unsubscribe, e-mail: dev-
> > > unsubscribe@lucene.apache.org
> > > >>> > > >> > > > >> > For additional commands, e-mail: dev-
> > > help@lucene.apache.org
> > > >>> > > >> > > > >> >
> > > >>> > > >> > > > >>
> > > >>> > > >> > > > >>
> ---------------------------------------------------------------------
> > > >>> > > >> > > > >> To unsubscribe, e-mail: dev-
> > unsubscribe@lucene.apache.org
> > > >>> > > >> > > > >> For additional commands, e-mail: dev-
> > > help@lucene.apache.org
> > > >>> > > >> > > > >>
> > > >>> > > >> > > >
> > > >>> > > >> > > >
> ---------------------------------------------------------------------
> > > >>> > > >> > > > To unsubscribe, e-mail:
> dev-unsubscribe@lucene.apache.org
> > > >>> > > >> > > > For additional commands, e-mail: dev-
> > help@lucene.apache.org
> > > >>> > > >> > > >
> > > >>> > > >>
> > > >>> > > >>
> ---------------------------------------------------------------------
> > > >>> > > >> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> > > >>> > > >> For additional commands, e-mail: dev-help@lucene.apache.org
> > > >>> > > >>
> > > >>>
> > > >>>
> ---------------------------------------------------------------------
> > > >>> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> > > >>> For additional commands, e-mail: dev-help@lucene.apache.org
> > > >>>
> > > >
> > > >
> > > > --
> > > > Adrien
> > >
> > > --
> > > Regards,
> > >
> > > Atri
> > > Apache Concerted
> > >
> > > ---------------------------------------------------------------------
> > > To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> > > For additional commands, e-mail: dev-help@lucene.apache.org
> >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> > For additional commands, e-mail: dev-help@lucene.apache.org
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
>
>

--
Anshum Gupta
Re: [VOTE] Release Lucene/Solr 8.9.0 RC1 [ In reply to ]
+1 (binding)

SUCCESS! [1:09:07.601567]

Also, fired up the bin/solr -e cloud example and ran through the Admin UI

Thanks Mayya!

On Tue, Jun 15, 2021 at 11:48 AM Uwe Schindler <uwe@thetaphi.de> wrote:
>
> Hi again, short update to my previous mail:
>
> New maven metadata artifacts work fine, I was able to build a Solr plugin of a customer after adding 2 repos to its POM. It then downloaded the internet and Solr and plugin built sucessfully (including tests using the solr test framework, indirectly also testing lucene test framework):
>
> [INFO] ------------------------------------------------------------------------
> [INFO] BUILD SUCCESS
> [INFO] ------------------------------------------------------------------------
> [INFO] Total time: 02:27 min
> [INFO] Finished at: 2021-06-15T19:44:09+02:00
> [INFO] ------------------------------------------------------------------------
>
>
> In case you want to try:
>
> <repositories>
> <repository>
> <id>lucene</id>
> <url>https://dist.apache.org/repos/dist/dev/lucene/lucene-solr-8.9.0-RC1-rev05c8a6f0163fe4c330e93775e8e91f3ab66a3f80/lucene/maven/</url>
> </repository>
> <repository>
> <id>solr</id>
> <url>https://dist.apache.org/repos/dist/dev/lucene/lucene-solr-8.9.0-RC1-rev05c8a6f0163fe4c330e93775e8e91f3ab66a3f80/solr/maven/</url>
> </repository>
> </repositories>
>
> You can also try this out, but be sure to remove the dowloaded artifacts from your local repository, if we need to respin the release process!
>
> Uwe
>
> -----
> Uwe Schindler
> Achterdiek 19, D-28357 Bremen
> https://www.thetaphi.de
> eMail: uwe@thetaphi.de
>
> > -----Original Message-----
> > From: Uwe Schindler <uwe@thetaphi.de>
> > Sent: Tuesday, June 15, 2021 7:27 PM
> > To: dev@lucene.apache.org
> > Subject: RE: [VOTE] Release Lucene/Solr 8.9.0 RC1
> >
> > +1
> >
> > SUCCESS! [1:24:00.227990]
> >
> > Policeman Jenkins tested it for me: https://jenkins.thetaphi.de/job/Lucene-Solr-
> > Release-Tester/36/console
> > I had not much time to do my own checks of targz artifacts, so I trust the
> > technical workflow.
> >
> > I only checked the maven folders and verified that the new POM layout looks
> > fine, but I did not do a test build of a Solr plugin this time (I did this before
> > committing the change). The release artifacts are a bit complicated to use as
> > it's 2 repos.
> >
> > Uwe
> >
> > -----
> > Uwe Schindler
> > Achterdiek 19, D-28357 Bremen
> > https://www.thetaphi.de
> > eMail: uwe@thetaphi.de
> >
> > > -----Original Message-----
> > > From: Atri Sharma <atri@apache.org>
> > > Sent: Tuesday, June 15, 2021 5:00 PM
> > > To: Lucene Dev <dev@lucene.apache.org>
> > > Subject: Re: [VOTE] Release Lucene/Solr 8.9.0 RC1
> > >
> > > +1 SUCCESS! [1:32:12.04043]
> > >
> > > On Tue, Jun 15, 2021 at 8:27 PM Adrien Grand <jpountz@gmail.com> wrote:
> > > >
> > > > +1 SUCCESS! [1:36:12.056443]
> > > >
> > > > On Tue, Jun 15, 2021 at 4:26 PM Mayya Sharipova
> > > <mayya.sharipova@elastic.co.invalid> wrote:
> > > >>
> > > >> Thanks Robert for such detailed investigations.
> > > >>
> > > >> Lucene-Solr-SmokeRelease-8.9 also had 2 recent failures. Failures are not
> > > reproducible on my local machine.
> > > >>
> > > >> build #13: ant test -Dtestcase=SolrCloudReportersTest -
> > > Dtests.method=testExplicitConfiguration -Dtests.seed=60FEAB39C2B47705 -
> > > Dtests.multiplier=2 -Dtests.locale=ro-RO -Dtests.timezone=Africa/Brazzaville -
> > > Dtests.asserts=true -Dtests.file.encoding=UTF-8
> > > >> build# 12: ant test -Dtestcase=LeaderTragicEventTest -
> > > Dtests.method=testLeaderFailsOver -Dtests.seed=BB301A174F4BDB5 -
> > > Dtests.multiplier=2 -Dtests.locale=sr-Latn-RS -Dtests.timezone=Africa/Bissau -
> > > Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
> > > >>
> > > >> On Sat, Jun 12, 2021 at 5:06 PM Robert Muir <rcmuir@gmail.com> wrote:
> > > >>>
> > > >>> OK I managed to finally get this smoketester to pass on my machine, so
> > > >>> for THIS release I will retract my -1 and change it to a +1.
> > > >>>
> > > >>> I have reset my system configuration back though, so we should really
> > > >>> fix these test problems for the future.
> > > >>>
> > > >>> SUCCESS! [1:08:26.448122]
> > > >>>
> > > >>> There were a few compounding issues, I will break out some issues a
> > > >>> bit later. I don't think they need to be blockers for THIS release,
> > > >>> but let's please fix them! I can help try to dig on each one, but here
> > > >>> are the biggest two problems:
> > > >>>
> > > >>> 1. some solr tests don't obey their sandbox and fail with
> > > >>> tests.workDir (if it is set in the user's build.properties). These
> > > >>> tests try to access wrong parts of the filesystem which can cause
> > > >>> tests to meddle with each other. obeying the test sandbox
> > > >>> (tests.workDir) is important, it is how I prevent these tests from
> > > >>> destroying my SSDs.
> > > >>>
> > > >>> 2. some solr HDFS tests will falsely fail if they "think" disk space
> > > >>> is low (even when it is not running out). They dump megabytes of
> > > >>> output, but this part is the key:
> > > >>>
> > > >>> [junit4] 2> 1000960 WARN (IPC Server handler 3 on 33951) [ ]
> > > >>> o.a.h.h.s.b.BlockPlacementPolicy Failed to place enough replicas,
> > > >>> still in need of 2 to reach 2 (unavailableStorages=[],
> > > >>> storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK],
> > > >>> creationFallbacks=[], replicationFallbacks=[ARCHIVE]}, newBlock=true)
> > > >>> For more information, please enable DEBUG log level on
> > > >>> org.apache.hadoop.hdfs.server.blockmanagement.BlockPlacementPolicy
> > > and
> > > >>> org.apache.hadoop.net.NetworkTopology
> > > >>> [junit4] 2> 1000960 WARN (IPC Server handler 3 on 33951) [ ]
> > > >>> o.a.h.h.p.BlockStoragePolicy Failed to place enough replicas: expected
> > > >>> size is 2 but only 0 storage types can be selected (replication=2,
> > > >>> selected=[], unavailable=[DISK], removed=[DISK, DISK],
> > > >>> policy=BlockStoragePolicy{HOT:7, storageTypes=[DISK],
> > > >>> creationFallbacks=[], replicationFallbacks=[ARCHIVE]})
> > > >>> [junit4] 2> 1000960 WARN (IPC Server handler 3 on 33951) [ ]
> > > >>> o.a.h.h.s.b.BlockPlacementPolicy Failed to place enough replicas,
> > > >>> still in need of 2 to reach 2 (unavailableStorages=[DISK],
> > > >>> storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK],
> > > >>> creationFallbacks=[], replicationFallbacks=[ARCHIVE]}, newBlock=true)
> > > >>> All required storage types are unavailable:
> > > >>> unavailableStorages=[DISK], storagePolicy=BlockStoragePolicy{HOT:7,
> > > >>> storageTypes=[DISK], creationFallbacks=[],
> > > >>> replicationFallbacks=[ARCHIVE]}
> > > >>> [junit4] 2> 1000961 WARN (Thread-2642) [ ]
> > > >>> o.a.h.h.DataStreamer DataStreamer Exception
> > > >>> [junit4] 2> =>
> > > >>> org.apache.hadoop.ipc.RemoteException(java.io.IOException): File
> > > >>> /testfile could only be written to 0 of the 1 minReplication nodes.
> > > >>> There are 2 datanode(s) running and 2 node(s) are excluded in this
> > > >>> operation.
> > > >>>
> > > >>> So I think these tests should be tweaked to not require gigabytes of
> > > >>> free space to pass. (fix the threshold or whatever, or add an assume
> > > >>> or something). I worked around the situation by temporarily
> > > >>> repartitioning and giving them another gigabyte (!). In no event was
> > > >>> there ever any danger of running out of space! They just falsely fail
> > > >>> even when there are hundreds of MB available. Seems they have some
> > > >>> kind of bogus threshold in the algorithm (e.g. inspecting percentages
> > > >>> or something).
> > > >>>
> > > >>> On Sat, Jun 12, 2021 at 12:22 PM Robert Muir <rcmuir@gmail.com>
> > wrote:
> > > >>> >
> > > >>> > The tests also aren't "timing out". They are failing.
> > > >>> >
> > > >>> > On Sat, Jun 12, 2021 at 12:21 PM Robert Muir <rcmuir@gmail.com>
> > > wrote:
> > > >>> > >
> > > >>> > > Ishan, no, they arent running out of resources, not even close. I have
> > > >>> > > 20GB of ram and by default it is only using 3 JVMs.
> > > >>> > >
> > > >>> > > On Sat, Jun 12, 2021 at 12:04 PM Ishan Chattopadhyaya
> > > >>> > > <ichattopadhyaya@gmail.com> wrote:
> > > >>> > > >
> > > >>> > > > Hi Rob, could it be possible that the tests are timing out on your
> > > machine due to lack of resources? Can you try running them with just just one
> > > JVM at a time?
> > > >>> > > >
> > > >>> > > > On Sat, 12 Jun, 2021, 8:20 pm Robert Muir, <rcmuir@gmail.com>
> > > wrote:
> > > >>> > > >>
> > > >>> > > >> I ran smoketester yet one more time and again numerous tests fail:
> > > >>> > > >>
> > > >>> > > >> [junit4] Tests with failures [seed: A3FDDCE09965D7AE] (first 10
> > > out of 18):
> > > >>> > > >> [junit4] -
> > > org.apache.solr.update.TestHdfsUpdateLog.testFSThreadSafety
> > > >>> > > >> [junit4] - org.apache.solr.update.TestHdfsUpdateLog (suite)
> > > >>> > > >> [junit4] -
> > > >>> > > >>
> > > org.apache.solr.cloud.hdfs.HDFSCollectionsAPITest.testDataDirIsNotReused
> > > >>> > > >> [junit4] -
> > > org.apache.solr.cloud.hdfs.HdfsRecoverLeaseTest.testBasic
> > > >>> > > >> [junit4] -
> > > >>> > > >>
> > org.apache.solr.cloud.hdfs.HdfsRecoverLeaseTest.testMultiThreaded
> > > >>> > > >> [junit4] - org.apache.solr.cloud.hdfs.HdfsRecoverLeaseTest
> > (suite)
> > > >>> > > >> [junit4] -
> > > >>> > > >>
> > >
> > org.apache.solr.core.backup.repository.HdfsBackupRepositoryIntegrationTest.te
> > > stCanDistinguishBetweenFilesAndDirectories
> > > >>> > > >> [junit4] -
> > > >>> > > >>
> > >
> > org.apache.solr.core.backup.repository.HdfsBackupRepositoryIntegrationTest.te
> > > stCanDeleteEmptyOrFullDirectories
> > > >>> > > >> [junit4] -
> > > >>> > > >>
> > >
> > org.apache.solr.core.backup.repository.HdfsBackupRepositoryIntegrationTest.te
> > > stCanDeleteIndividualFiles
> > > >>> > > >> [junit4] -
> > > >>> > > >>
> > >
> > org.apache.solr.core.backup.repository.HdfsBackupRepositoryIntegrationTest.te
> > > stArbitraryFileDataCanBeStoredAndRetrieved
> > > >>> > > >> [junit4]
> > > >>> > > >> [junit4]
> > > >>> > > >> [junit4] JVM J0: 0.72 .. 1241.80 = 1241.08s
> > > >>> > > >> [junit4] JVM J1: 0.67 .. 1198.72 = 1198.05s
> > > >>> > > >> [junit4] JVM J2: 0.91 .. 1198.75 = 1197.84s
> > > >>> > > >> [junit4] Execution time total: 20 minutes 41 seconds
> > > >>> > > >> [junit4] Tests summary: 939 suites (5 ignored), 4884 tests, 3
> > > >>> > > >> suite-level errors, 15 errors, 1 failure, 2581 ignored (506
> > > >>> > > >> assumptions)
> > > >>> > > >>
> > > >>> > > >> On Fri, Jun 11, 2021 at 11:52 AM Robert Muir
> > <rcmuir@gmail.com>
> > > wrote:
> > > >>> > > >> >
> > > >>> > > >> > After nuking all settings (i simply removed the whole
> > > >>> > > >> > lucene.build.properties in my homedir), it still fails. Seems maybe
> > > >>> > > >> > like less failures though?
> > > >>> > > >> >
> > > >>> > > >> > I will upload logs to the JIRA issue.
> > > >>> > > >> >
> > > >>> > > >> > [junit4] Completed [939/939 (4!)] on J2 in 383.02s, 2 tests, 1
> > > >>> > > >> > failure <<< FAILURES!
> > > >>> > > >> > [junit4]
> > > >>> > > >> > [junit4]
> > > >>> > > >> > [junit4] Tests with failures [seed: AC205159663D0461]:
> > > >>> > > >> > [junit4] -
> > > org.apache.solr.update.TestHdfsUpdateLog.testFSThreadSafety
> > > >>> > > >> > [junit4] - org.apache.solr.update.TestHdfsUpdateLog (suite)
> > > >>> > > >> > [junit4] -
> > > >>> > > >> >
> > org.apache.solr.core.HdfsDirectoryFactoryTest.testLocalityReporter
> > > >>> > > >> > [junit4] -
> > > org.apache.solr.cloud.hdfs.HdfsRecoverLeaseTest.testBasic
> > > >>> > > >> > [junit4] -
> > > >>> > > >> >
> > > org.apache.solr.cloud.hdfs.HdfsRecoverLeaseTest.testMultiThreaded
> > > >>> > > >> > [junit4] - org.apache.solr.cloud.hdfs.HdfsRecoverLeaseTest
> > > (suite)
> > > >>> > > >> > [junit4] -
> > > >>> > > >> >
> > > org.apache.solr.cloud.api.collections.TestLocalFSCloudBackupRestore.test
> > > >>> > > >> > [junit4]
> > > >>> > > >> > [junit4]
> > > >>> > > >> > [junit4] JVM J0: 0.68 .. 1197.30 = 1196.62s
> > > >>> > > >> > [junit4] JVM J1: 0.71 .. 1113.59 = 1112.89s
> > > >>> > > >> > [junit4] JVM J2: 0.68 .. 1406.83 = 1406.15s
> > > >>> > > >> > [junit4] Execution time total: 23 minutes 26 seconds
> > > >>> > > >> > [junit4] Tests summary: 939 suites (5 ignored), 4884 tests, 3
> > > >>> > > >> > suite-level errors, 4 errors, 1 failure, 2457 ignored (517
> > > >>> > > >> > assumptions)
> > > >>> > > >> >
> > > >>> > > >> > BUILD FAILED
> > > >>> > > >> >
> > >
> > /tmp/smoke_lucene_8.9.0_05c8a6f0163fe4c330e93775e8e91f3ab66a3f80/un
> > > pack/solr-8.9.0/solr/build.xml:231:
> > > >>> > > >> > The following error occurred while executing this line:
> > > >>> > > >> >
> > >
> > /tmp/smoke_lucene_8.9.0_05c8a6f0163fe4c330e93775e8e91f3ab66a3f80/un
> > > pack/solr-8.9.0/solr/common-build.xml:550:
> > > >>> > > >> > The following error occurred while executing this line:
> > > >>> > > >> >
> > >
> > /tmp/smoke_lucene_8.9.0_05c8a6f0163fe4c330e93775e8e91f3ab66a3f80/un
> > > pack/solr-8.9.0/lucene/common-build.xml:1608:
> > > >>> > > >> > The following error occurred while executing this line:
> > > >>> > > >> >
> > >
> > /tmp/smoke_lucene_8.9.0_05c8a6f0163fe4c330e93775e8e91f3ab66a3f80/un
> > > pack/solr-8.9.0/lucene/common-build.xml:1135:
> > > >>> > > >> > There were test failures: 939 suites (5 ignored), 4884 tests, 3
> > > >>> > > >> > suite-level errors, 4 errors, 1 failure, 2457 ignored (517
> > > >>> > > >> > assumptions) [seed: AC205159663D0461]
> > > >>> > > >> >
> > > >>> > > >> > Total time: 24 minutes 16 seconds
> > > >>> > > >> >
> > > >>> > > >> >
> > > >>> > > >> > Traceback (most recent call last):
> > > >>> > > >> > File "/home/rmuir/workspace/lucene-solr/dev-
> > > tools/scripts/smokeTestRelease.py",
> > > >>> > > >> > line 1495, in <module>
> > > >>> > > >> > main()
> > > >>> > > >> > File "/home/rmuir/workspace/lucene-solr/dev-
> > > tools/scripts/smokeTestRelease.py",
> > > >>> > > >> > line 1417, in main
> > > >>> > > >> > smokeTest(c.java, c.url, c.revision, c.version, c.tmp_dir,
> > > >>> > > >> > c.is_signed, c.local_keys, ' '.join(c.test_args),
> > > >>> > > >> > File "/home/rmuir/workspace/lucene-solr/dev-
> > > tools/scripts/smokeTestRelease.py",
> > > >>> > > >> > line 1483, in smokeTest
> > > >>> > > >> > solrSrcUnpackPath = unpackAndVerify(java, 'solr', tmpDir,
> > > >>> > > >> > 'solr-%s-src.tgz' % version,
> > > >>> > > >> > File "/home/rmuir/workspace/lucene-solr/dev-
> > > tools/scripts/smokeTestRelease.py",
> > > >>> > > >> > line 566, in unpackAndVerify
> > > >>> > > >> > verifyUnpacked(java, project, artifact, unpackPath, gitRevision,
> > > >>> > > >> > version, testArgs, tmpDir, baseURL)
> > > >>> > > >> > File "/home/rmuir/workspace/lucene-solr/dev-
> > > tools/scripts/smokeTestRelease.py",
> > > >>> > > >> > line 687, in verifyUnpacked
> > > >>> > > >> > java.run_java8('ant clean test -Dtests.slow=false %s' %
> > testArgs,
> > > >>> > > >> > '%s/test.log' % unpackPath)
> > > >>> > > >> > File "/home/rmuir/workspace/lucene-solr/dev-
> > > tools/scripts/smokeTestRelease.py",
> > > >>> > > >> > line 1212, in run_java
> > > >>> > > >> > run('%s; %s' % (cmd_prefix, cmd), logfile)
> > > >>> > > >> > File "/home/rmuir/workspace/lucene-solr/dev-
> > > tools/scripts/smokeTestRelease.py",
> > > >>> > > >> > line 500, in run
> > > >>> > > >> > raise RuntimeError('command "%s" failed; see log file %s' %
> > > >>> > > >> > (command, logPath))
> > > >>> > > >> > RuntimeError: command "export
> > > >>> > > >> > JAVA_HOME="/home/rmuir/Downloads/jdk8u282-b08"
> > > >>> > > >> > PATH="/home/rmuir/Downloads/jdk8u282-b08/bin:$PATH"
> > > >>> > > >> > JAVACMD="/home/rmuir/Downloads/jdk8u282-b08/bin/java";
> > ant
> > > clean test
> > > >>> > > >> > -Dtests.slow=false -Dtests.badapples=false " failed; see log file
> > > >>> > > >> >
> > >
> > /tmp/smoke_lucene_8.9.0_05c8a6f0163fe4c330e93775e8e91f3ab66a3f80/un
> > > pack/solr-8.9.0/test.log
> > > >>> > > >> >
> > > >>> > > >> > On Fri, Jun 11, 2021 at 9:47 AM Robert Muir
> > <rcmuir@gmail.com>
> > > wrote:
> > > >>> > > >> > >
> > > >>> > > >> > > I nuked all my settings and am rerunning with all defaults. I'll
> > > >>> > > >> > > report back what happens/upload log when/if it finishes or
> > fails.
> > > >>> > > >> > >
> > > >>> > > >> > > On Fri, Jun 11, 2021 at 9:45 AM Michael Sokolov
> > > <msokolov@gmail.com> wrote:
> > > >>> > > >> > > >
> > > >>> > > >> > > > I tried to comment on the JIRA, but it seems to be timing out.
> > > Now
> > > >>> > > >> > > > when I go back, SOLR issues are marked as "You can't view
> > this
> > > issue
> > > >>> > > >> > > > It may have been deleted or you don't have permission to
> > view
> > > it."
> > > >>> > > >> > > > Waat?
> > > >>> > > >> > > >
> > > >>> > > >> > > > Anyway, Robert you suggested there that maybe the problem
> > is
> > > being
> > > >>> > > >> > > > surfaced by using a different working directory for the tests.
> > Do
> > > you
> > > >>> > > >> > > > think that the tests need to be fixed so that they work with
> > this
> > > >>> > > >> > > > tmp.workDir parameter? What if you were to cd to the place
> > > you want to
> > > >>> > > >> > > > use as the working dir and call the smokeTester from there?
> > > >>> > > >> > > >
> > > >>> > > >> > > >
> > > >>> > > >> > > > On Fri, Jun 11, 2021 at 9:29 AM Mayya Sharipova
> > > >>> > > >> > > > <mayya.sharipova@elastic.co.invalid> wrote:
> > > >>> > > >> > > > >
> > > >>> > > >> > > > > Thanks very much Robert for detailed investigations, and
> > > thanks Jan for your tests.
> > > >>> > > >> > > > >
> > > >>> > > >> > > > > I will sort out the problem with my GPG key, but I am not
> > > sure what to do with this SOLR-15473. I've run the smoker test again, and it
> > > passed on my Mac again: SUCCESS! [1:00:03.751500]
> > > >>> > > >> > > > > Would appreciate more guidance, if we need to resolve
> > SOLR-
> > > 15473 before 8.9 release.
> > > >>> > > >> > > > >
> > > >>> > > >> > > > >
> > > >>> > > >> > > > > On Fri, Jun 11, 2021 at 8:09 AM Robert Muir
> > > <rcmuir@gmail.com> wrote:
> > > >>> > > >> > > > >>
> > > >>> > > >> > > > >> Dude, if you can vote +1 when the smoketester passes,
> > then
> > > I can vote
> > > >>> > > >> > > > >> -1 when it fails. This is my vote, not your vote. You don't
> > get
> > > to
> > > >>> > > >> > > > >> decide about it, or change it in any way.
> > > >>> > > >> > > > >>
> > > >>> > > >> > > > >> On Fri, Jun 11, 2021 at 8:04 AM Jan Høydahl
> > > <jan.asf@cominvent.com> wrote:
> > > >>> > > >> > > > >> >
> > > >>> > > >> > > > >> > Does it reproduce for you? Are you suspecting a bug in
> > Solr
> > > that we cannot ship, or only a bug in the smoketester py itself? The -1 should
> > > be about the released bits, not about other tooling?
> > > >>> > > >> > > > >> > My JVM is OpenJDK 64-Bit Server VM
> > > (AdoptOpenJDK)(build 25.292-b10, mixed mode)
> > > >>> > > >> > > > >> >
> > > >>> > > >> > > > >> > Jan
> > > >>> > > >> > > > >> >
> > > >>> > > >> > > > >> > > 11. jun. 2021 kl. 13:48 skrev Robert Muir
> > > <rcmuir@gmail.com>:
> > > >>> > > >> > > > >> > >
> > > >>> > > >> > > > >> > > Jan, I'm using the same automated smoketester as
> > > everyone else. It
> > > >>> > > >> > > > >> > > fails, so my vote is -1.
> > > >>> > > >> > > > >> > >
> > > >>> > > >> > > > >> > > On Fri, Jun 11, 2021 at 7:22 AM Jan Høydahl
> > > <jan.asf@cominvent.com> wrote:
> > > >>> > > >> > > > >> > >>
> > > >>> > > >> > > > >> > >> Tested on MacOS (Intel), No other verification than
> > > smoketester done
> > > >>> > > >> > > > >> > >>
> > > >>> > > >> > > > >> > >> SUCCESS! [1:08:19.953492]
> > > >>> > > >> > > > >> > >>
> > > >>> > > >> > > > >> > >> +1
> > > >>> > > >> > > > >> > >>
> > > >>> > > >> > > > >> > >> Robert - not sure if one test-run failure should cancel
> > > the build. Our smoketester and tests are sometimes a bit picky, and does not
> > > mean that the artifacts are faulty.
> > > >>> > > >> > > > >> > >>
> > > >>> > > >> > > > >> > >> Jan
> > > >>> > > >> > > > >> > >>
> > > >>> > > >> > > > >> > >> 11. jun. 2021 kl. 04:14 skrev Mayya Sharipova
> > > <mayya.sharipova@elastic.co.INVALID>:
> > > >>> > > >> > > > >> > >>
> > > >>> > > >> > > > >> > >> Please vote for release candidate 1 for Lucene/Solr
> > > 8.9.0
> > > >>> > > >> > > > >> > >>
> > > >>> > > >> > > > >> > >> The artifacts can be downloaded from:
> > > >>> > > >> > > > >> > >> https://dist.apache.org/repos/dist/dev/lucene/lucene-
> > > solr-8.9.0-RC1-rev05c8a6f0163fe4c330e93775e8e91f3ab66a3f80
> > > >>> > > >> > > > >> > >>
> > > >>> > > >> > > > >> > >> You can run the smoke tester directly with this
> > > command:
> > > >>> > > >> > > > >> > >>
> > > >>> > > >> > > > >> > >> python3 -u dev-tools/scripts/smokeTestRelease.py \
> > > >>> > > >> > > > >> > >> https://dist.apache.org/repos/dist/dev/lucene/lucene-
> > > solr-8.9.0-RC1-rev05c8a6f0163fe4c330e93775e8e91f3ab66a3f80
> > > >>> > > >> > > > >> > >>
> > > >>> > > >> > > > >> > >> The vote will be open for at least 72 hours i.e. until
> > > 2021-06-16 02:00 UTC.
> > > >>> > > >> > > > >> > >>
> > > >>> > > >> > > > >> > >> [ ] +1 approve
> > > >>> > > >> > > > >> > >> [ ] +0 no opinion
> > > >>> > > >> > > > >> > >> [ ] -1 disapprove (and reason why)
> > > >>> > > >> > > > >> > >>
> > > >>> > > >> > > > >> > >> Here is my +1
> > > >>> > > >> > > > >> > >> SUCCESS! [0:01:43.815224]
> > > >>> > > >> > > > >> > >>
> > > >>> > > >> > > > >> > >>
> > > >>> > > >> > > > >> > >
> > > >>> > > >> > > > >> > > ---------------------------------------------------------------------
> > > >>> > > >> > > > >> > > To unsubscribe, e-mail: dev-
> > > unsubscribe@lucene.apache.org
> > > >>> > > >> > > > >> > > For additional commands, e-mail: dev-
> > > help@lucene.apache.org
> > > >>> > > >> > > > >> > >
> > > >>> > > >> > > > >> >
> > > >>> > > >> > > > >> >
> > > >>> > > >> > > > >> > ---------------------------------------------------------------------
> > > >>> > > >> > > > >> > To unsubscribe, e-mail: dev-
> > > unsubscribe@lucene.apache.org
> > > >>> > > >> > > > >> > For additional commands, e-mail: dev-
> > > help@lucene.apache.org
> > > >>> > > >> > > > >> >
> > > >>> > > >> > > > >>
> > > >>> > > >> > > > >> ---------------------------------------------------------------------
> > > >>> > > >> > > > >> To unsubscribe, e-mail: dev-
> > unsubscribe@lucene.apache.org
> > > >>> > > >> > > > >> For additional commands, e-mail: dev-
> > > help@lucene.apache.org
> > > >>> > > >> > > > >>
> > > >>> > > >> > > >
> > > >>> > > >> > > > ---------------------------------------------------------------------
> > > >>> > > >> > > > To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> > > >>> > > >> > > > For additional commands, e-mail: dev-
> > help@lucene.apache.org
> > > >>> > > >> > > >
> > > >>> > > >>
> > > >>> > > >> ---------------------------------------------------------------------
> > > >>> > > >> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> > > >>> > > >> For additional commands, e-mail: dev-help@lucene.apache.org
> > > >>> > > >>
> > > >>>
> > > >>> ---------------------------------------------------------------------
> > > >>> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> > > >>> For additional commands, e-mail: dev-help@lucene.apache.org
> > > >>>
> > > >
> > > >
> > > > --
> > > > Adrien
> > >
> > > --
> > > Regards,
> > >
> > > Atri
> > > Apache Concerted
> > >
> > > ---------------------------------------------------------------------
> > > To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> > > For additional commands, e-mail: dev-help@lucene.apache.org
> >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> > For additional commands, e-mail: dev-help@lucene.apache.org
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
>

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
Re: [VOTE] Release Lucene/Solr 8.9.0 RC1 [ In reply to ]
Thanks very much everyone for running tests!


On Tue, Jun 15, 2021 at 4:53 PM Timothy Potter <thelabdude@gmail.com> wrote:

> +1 (binding)
>
> SUCCESS! [1:09:07.601567]
>
> Also, fired up the bin/solr -e cloud example and ran through the Admin UI
>
> Thanks Mayya!
>
> On Tue, Jun 15, 2021 at 11:48 AM Uwe Schindler <uwe@thetaphi.de> wrote:
> >
> > Hi again, short update to my previous mail:
> >
> > New maven metadata artifacts work fine, I was able to build a Solr
> plugin of a customer after adding 2 repos to its POM. It then downloaded
> the internet and Solr and plugin built sucessfully (including tests using
> the solr test framework, indirectly also testing lucene test framework):
> >
> > [INFO]
> ------------------------------------------------------------------------
> > [INFO] BUILD SUCCESS
> > [INFO]
> ------------------------------------------------------------------------
> > [INFO] Total time: 02:27 min
> > [INFO] Finished at: 2021-06-15T19:44:09+02:00
> > [INFO]
> ------------------------------------------------------------------------
> >
> >
> > In case you want to try:
> >
> > <repositories>
> > <repository>
> > <id>lucene</id>
> > <url>
> https://dist.apache.org/repos/dist/dev/lucene/lucene-solr-8.9.0-RC1-rev05c8a6f0163fe4c330e93775e8e91f3ab66a3f80/lucene/maven/
> </url>
> > </repository>
> > <repository>
> > <id>solr</id>
> > <url>
> https://dist.apache.org/repos/dist/dev/lucene/lucene-solr-8.9.0-RC1-rev05c8a6f0163fe4c330e93775e8e91f3ab66a3f80/solr/maven/
> </url>
> > </repository>
> > </repositories>
> >
> > You can also try this out, but be sure to remove the dowloaded artifacts
> from your local repository, if we need to respin the release process!
> >
> > Uwe
> >
> > -----
> > Uwe Schindler
> > Achterdiek 19, D-28357 Bremen
> > https://www.thetaphi.de
> > eMail: uwe@thetaphi.de
> >
> > > -----Original Message-----
> > > From: Uwe Schindler <uwe@thetaphi.de>
> > > Sent: Tuesday, June 15, 2021 7:27 PM
> > > To: dev@lucene.apache.org
> > > Subject: RE: [VOTE] Release Lucene/Solr 8.9.0 RC1
> > >
> > > +1
> > >
> > > SUCCESS! [1:24:00.227990]
> > >
> > > Policeman Jenkins tested it for me:
> https://jenkins.thetaphi.de/job/Lucene-Solr-
> > > Release-Tester/36/console
> > > I had not much time to do my own checks of targz artifacts, so I trust
> the
> > > technical workflow.
> > >
> > > I only checked the maven folders and verified that the new POM layout
> looks
> > > fine, but I did not do a test build of a Solr plugin this time (I did
> this before
> > > committing the change). The release artifacts are a bit complicated to
> use as
> > > it's 2 repos.
> > >
> > > Uwe
> > >
> > > -----
> > > Uwe Schindler
> > > Achterdiek 19, D-28357 Bremen
> > > https://www.thetaphi.de
> > > eMail: uwe@thetaphi.de
> > >
> > > > -----Original Message-----
> > > > From: Atri Sharma <atri@apache.org>
> > > > Sent: Tuesday, June 15, 2021 5:00 PM
> > > > To: Lucene Dev <dev@lucene.apache.org>
> > > > Subject: Re: [VOTE] Release Lucene/Solr 8.9.0 RC1
> > > >
> > > > +1 SUCCESS! [1:32:12.04043]
> > > >
> > > > On Tue, Jun 15, 2021 at 8:27 PM Adrien Grand <jpountz@gmail.com>
> wrote:
> > > > >
> > > > > +1 SUCCESS! [1:36:12.056443]
> > > > >
> > > > > On Tue, Jun 15, 2021 at 4:26 PM Mayya Sharipova
> > > > <mayya.sharipova@elastic.co.invalid> wrote:
> > > > >>
> > > > >> Thanks Robert for such detailed investigations.
> > > > >>
> > > > >> Lucene-Solr-SmokeRelease-8.9 also had 2 recent failures. Failures
> are not
> > > > reproducible on my local machine.
> > > > >>
> > > > >> build #13: ant test -Dtestcase=SolrCloudReportersTest -
> > > > Dtests.method=testExplicitConfiguration
> -Dtests.seed=60FEAB39C2B47705 -
> > > > Dtests.multiplier=2 -Dtests.locale=ro-RO
> -Dtests.timezone=Africa/Brazzaville -
> > > > Dtests.asserts=true -Dtests.file.encoding=UTF-8
> > > > >> build# 12: ant test -Dtestcase=LeaderTragicEventTest -
> > > > Dtests.method=testLeaderFailsOver -Dtests.seed=BB301A174F4BDB5 -
> > > > Dtests.multiplier=2 -Dtests.locale=sr-Latn-RS
> -Dtests.timezone=Africa/Bissau -
> > > > Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
> > > > >>
> > > > >> On Sat, Jun 12, 2021 at 5:06 PM Robert Muir <rcmuir@gmail.com>
> wrote:
> > > > >>>
> > > > >>> OK I managed to finally get this smoketester to pass on my
> machine, so
> > > > >>> for THIS release I will retract my -1 and change it to a +1.
> > > > >>>
> > > > >>> I have reset my system configuration back though, so we should
> really
> > > > >>> fix these test problems for the future.
> > > > >>>
> > > > >>> SUCCESS! [1:08:26.448122]
> > > > >>>
> > > > >>> There were a few compounding issues, I will break out some
> issues a
> > > > >>> bit later. I don't think they need to be blockers for THIS
> release,
> > > > >>> but let's please fix them! I can help try to dig on each one,
> but here
> > > > >>> are the biggest two problems:
> > > > >>>
> > > > >>> 1. some solr tests don't obey their sandbox and fail with
> > > > >>> tests.workDir (if it is set in the user's build.properties).
> These
> > > > >>> tests try to access wrong parts of the filesystem which can cause
> > > > >>> tests to meddle with each other. obeying the test sandbox
> > > > >>> (tests.workDir) is important, it is how I prevent these tests
> from
> > > > >>> destroying my SSDs.
> > > > >>>
> > > > >>> 2. some solr HDFS tests will falsely fail if they "think" disk
> space
> > > > >>> is low (even when it is not running out). They dump megabytes of
> > > > >>> output, but this part is the key:
> > > > >>>
> > > > >>> [junit4] 2> 1000960 WARN (IPC Server handler 3 on 33951)
> [ ]
> > > > >>> o.a.h.h.s.b.BlockPlacementPolicy Failed to place enough replicas,
> > > > >>> still in need of 2 to reach 2 (unavailableStorages=[],
> > > > >>> storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK],
> > > > >>> creationFallbacks=[], replicationFallbacks=[ARCHIVE]},
> newBlock=true)
> > > > >>> For more information, please enable DEBUG log level on
> > > > >>>
> org.apache.hadoop.hdfs.server.blockmanagement.BlockPlacementPolicy
> > > > and
> > > > >>> org.apache.hadoop.net.NetworkTopology
> > > > >>> [junit4] 2> 1000960 WARN (IPC Server handler 3 on 33951)
> [ ]
> > > > >>> o.a.h.h.p.BlockStoragePolicy Failed to place enough replicas:
> expected
> > > > >>> size is 2 but only 0 storage types can be selected
> (replication=2,
> > > > >>> selected=[], unavailable=[DISK], removed=[DISK, DISK],
> > > > >>> policy=BlockStoragePolicy{HOT:7, storageTypes=[DISK],
> > > > >>> creationFallbacks=[], replicationFallbacks=[ARCHIVE]})
> > > > >>> [junit4] 2> 1000960 WARN (IPC Server handler 3 on 33951)
> [ ]
> > > > >>> o.a.h.h.s.b.BlockPlacementPolicy Failed to place enough replicas,
> > > > >>> still in need of 2 to reach 2 (unavailableStorages=[DISK],
> > > > >>> storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK],
> > > > >>> creationFallbacks=[], replicationFallbacks=[ARCHIVE]},
> newBlock=true)
> > > > >>> All required storage types are unavailable:
> > > > >>> unavailableStorages=[DISK],
> storagePolicy=BlockStoragePolicy{HOT:7,
> > > > >>> storageTypes=[DISK], creationFallbacks=[],
> > > > >>> replicationFallbacks=[ARCHIVE]}
> > > > >>> [junit4] 2> 1000961 WARN (Thread-2642) [ ]
> > > > >>> o.a.h.h.DataStreamer DataStreamer Exception
> > > > >>> [junit4] 2> =>
> > > > >>> org.apache.hadoop.ipc.RemoteException(java.io.IOException): File
> > > > >>> /testfile could only be written to 0 of the 1 minReplication
> nodes.
> > > > >>> There are 2 datanode(s) running and 2 node(s) are excluded in
> this
> > > > >>> operation.
> > > > >>>
> > > > >>> So I think these tests should be tweaked to not require
> gigabytes of
> > > > >>> free space to pass. (fix the threshold or whatever, or add an
> assume
> > > > >>> or something). I worked around the situation by temporarily
> > > > >>> repartitioning and giving them another gigabyte (!). In no event
> was
> > > > >>> there ever any danger of running out of space! They just falsely
> fail
> > > > >>> even when there are hundreds of MB available. Seems they have
> some
> > > > >>> kind of bogus threshold in the algorithm (e.g. inspecting
> percentages
> > > > >>> or something).
> > > > >>>
> > > > >>> On Sat, Jun 12, 2021 at 12:22 PM Robert Muir <rcmuir@gmail.com>
> > > wrote:
> > > > >>> >
> > > > >>> > The tests also aren't "timing out". They are failing.
> > > > >>> >
> > > > >>> > On Sat, Jun 12, 2021 at 12:21 PM Robert Muir <rcmuir@gmail.com
> >
> > > > wrote:
> > > > >>> > >
> > > > >>> > > Ishan, no, they arent running out of resources, not even
> close. I have
> > > > >>> > > 20GB of ram and by default it is only using 3 JVMs.
> > > > >>> > >
> > > > >>> > > On Sat, Jun 12, 2021 at 12:04 PM Ishan Chattopadhyaya
> > > > >>> > > <ichattopadhyaya@gmail.com> wrote:
> > > > >>> > > >
> > > > >>> > > > Hi Rob, could it be possible that the tests are timing out
> on your
> > > > machine due to lack of resources? Can you try running them with just
> just one
> > > > JVM at a time?
> > > > >>> > > >
> > > > >>> > > > On Sat, 12 Jun, 2021, 8:20 pm Robert Muir, <
> rcmuir@gmail.com>
> > > > wrote:
> > > > >>> > > >>
> > > > >>> > > >> I ran smoketester yet one more time and again numerous
> tests fail:
> > > > >>> > > >>
> > > > >>> > > >> [junit4] Tests with failures [seed: A3FDDCE09965D7AE]
> (first 10
> > > > out of 18):
> > > > >>> > > >> [junit4] -
> > > > org.apache.solr.update.TestHdfsUpdateLog.testFSThreadSafety
> > > > >>> > > >> [junit4] - org.apache.solr.update.TestHdfsUpdateLog
> (suite)
> > > > >>> > > >> [junit4] -
> > > > >>> > > >>
> > > >
> org.apache.solr.cloud.hdfs.HDFSCollectionsAPITest.testDataDirIsNotReused
> > > > >>> > > >> [junit4] -
> > > > org.apache.solr.cloud.hdfs.HdfsRecoverLeaseTest.testBasic
> > > > >>> > > >> [junit4] -
> > > > >>> > > >>
> > > org.apache.solr.cloud.hdfs.HdfsRecoverLeaseTest.testMultiThreaded
> > > > >>> > > >> [junit4] -
> org.apache.solr.cloud.hdfs.HdfsRecoverLeaseTest
> > > (suite)
> > > > >>> > > >> [junit4] -
> > > > >>> > > >>
> > > >
> > >
> org.apache.solr.core.backup.repository.HdfsBackupRepositoryIntegrationTest.te
> > > > stCanDistinguishBetweenFilesAndDirectories
> > > > >>> > > >> [junit4] -
> > > > >>> > > >>
> > > >
> > >
> org.apache.solr.core.backup.repository.HdfsBackupRepositoryIntegrationTest.te
> > > > stCanDeleteEmptyOrFullDirectories
> > > > >>> > > >> [junit4] -
> > > > >>> > > >>
> > > >
> > >
> org.apache.solr.core.backup.repository.HdfsBackupRepositoryIntegrationTest.te
> > > > stCanDeleteIndividualFiles
> > > > >>> > > >> [junit4] -
> > > > >>> > > >>
> > > >
> > >
> org.apache.solr.core.backup.repository.HdfsBackupRepositoryIntegrationTest.te
> > > > stArbitraryFileDataCanBeStoredAndRetrieved
> > > > >>> > > >> [junit4]
> > > > >>> > > >> [junit4]
> > > > >>> > > >> [junit4] JVM J0: 0.72 .. 1241.80 = 1241.08s
> > > > >>> > > >> [junit4] JVM J1: 0.67 .. 1198.72 = 1198.05s
> > > > >>> > > >> [junit4] JVM J2: 0.91 .. 1198.75 = 1197.84s
> > > > >>> > > >> [junit4] Execution time total: 20 minutes 41 seconds
> > > > >>> > > >> [junit4] Tests summary: 939 suites (5 ignored), 4884
> tests, 3
> > > > >>> > > >> suite-level errors, 15 errors, 1 failure, 2581 ignored
> (506
> > > > >>> > > >> assumptions)
> > > > >>> > > >>
> > > > >>> > > >> On Fri, Jun 11, 2021 at 11:52 AM Robert Muir
> > > <rcmuir@gmail.com>
> > > > wrote:
> > > > >>> > > >> >
> > > > >>> > > >> > After nuking all settings (i simply removed the whole
> > > > >>> > > >> > lucene.build.properties in my homedir), it still fails.
> Seems maybe
> > > > >>> > > >> > like less failures though?
> > > > >>> > > >> >
> > > > >>> > > >> > I will upload logs to the JIRA issue.
> > > > >>> > > >> >
> > > > >>> > > >> > [junit4] Completed [939/939 (4!)] on J2 in 383.02s,
> 2 tests, 1
> > > > >>> > > >> > failure <<< FAILURES!
> > > > >>> > > >> > [junit4]
> > > > >>> > > >> > [junit4]
> > > > >>> > > >> > [junit4] Tests with failures [seed:
> AC205159663D0461]:
> > > > >>> > > >> > [junit4] -
> > > > org.apache.solr.update.TestHdfsUpdateLog.testFSThreadSafety
> > > > >>> > > >> > [junit4] -
> org.apache.solr.update.TestHdfsUpdateLog (suite)
> > > > >>> > > >> > [junit4] -
> > > > >>> > > >> >
> > > org.apache.solr.core.HdfsDirectoryFactoryTest.testLocalityReporter
> > > > >>> > > >> > [junit4] -
> > > > org.apache.solr.cloud.hdfs.HdfsRecoverLeaseTest.testBasic
> > > > >>> > > >> > [junit4] -
> > > > >>> > > >> >
> > > > org.apache.solr.cloud.hdfs.HdfsRecoverLeaseTest.testMultiThreaded
> > > > >>> > > >> > [junit4] -
> org.apache.solr.cloud.hdfs.HdfsRecoverLeaseTest
> > > > (suite)
> > > > >>> > > >> > [junit4] -
> > > > >>> > > >> >
> > > >
> org.apache.solr.cloud.api.collections.TestLocalFSCloudBackupRestore.test
> > > > >>> > > >> > [junit4]
> > > > >>> > > >> > [junit4]
> > > > >>> > > >> > [junit4] JVM J0: 0.68 .. 1197.30 = 1196.62s
> > > > >>> > > >> > [junit4] JVM J1: 0.71 .. 1113.59 = 1112.89s
> > > > >>> > > >> > [junit4] JVM J2: 0.68 .. 1406.83 = 1406.15s
> > > > >>> > > >> > [junit4] Execution time total: 23 minutes 26 seconds
> > > > >>> > > >> > [junit4] Tests summary: 939 suites (5 ignored), 4884
> tests, 3
> > > > >>> > > >> > suite-level errors, 4 errors, 1 failure, 2457 ignored
> (517
> > > > >>> > > >> > assumptions)
> > > > >>> > > >> >
> > > > >>> > > >> > BUILD FAILED
> > > > >>> > > >> >
> > > >
> > > /tmp/smoke_lucene_8.9.0_05c8a6f0163fe4c330e93775e8e91f3ab66a3f80/un
> > > > pack/solr-8.9.0/solr/build.xml:231:
> > > > >>> > > >> > The following error occurred while executing this line:
> > > > >>> > > >> >
> > > >
> > > /tmp/smoke_lucene_8.9.0_05c8a6f0163fe4c330e93775e8e91f3ab66a3f80/un
> > > > pack/solr-8.9.0/solr/common-build.xml:550:
> > > > >>> > > >> > The following error occurred while executing this line:
> > > > >>> > > >> >
> > > >
> > > /tmp/smoke_lucene_8.9.0_05c8a6f0163fe4c330e93775e8e91f3ab66a3f80/un
> > > > pack/solr-8.9.0/lucene/common-build.xml:1608:
> > > > >>> > > >> > The following error occurred while executing this line:
> > > > >>> > > >> >
> > > >
> > > /tmp/smoke_lucene_8.9.0_05c8a6f0163fe4c330e93775e8e91f3ab66a3f80/un
> > > > pack/solr-8.9.0/lucene/common-build.xml:1135:
> > > > >>> > > >> > There were test failures: 939 suites (5 ignored), 4884
> tests, 3
> > > > >>> > > >> > suite-level errors, 4 errors, 1 failure, 2457 ignored
> (517
> > > > >>> > > >> > assumptions) [seed: AC205159663D0461]
> > > > >>> > > >> >
> > > > >>> > > >> > Total time: 24 minutes 16 seconds
> > > > >>> > > >> >
> > > > >>> > > >> >
> > > > >>> > > >> > Traceback (most recent call last):
> > > > >>> > > >> > File "/home/rmuir/workspace/lucene-solr/dev-
> > > > tools/scripts/smokeTestRelease.py",
> > > > >>> > > >> > line 1495, in <module>
> > > > >>> > > >> > main()
> > > > >>> > > >> > File "/home/rmuir/workspace/lucene-solr/dev-
> > > > tools/scripts/smokeTestRelease.py",
> > > > >>> > > >> > line 1417, in main
> > > > >>> > > >> > smokeTest(c.java, c.url, c.revision, c.version,
> c.tmp_dir,
> > > > >>> > > >> > c.is_signed, c.local_keys, ' '.join(c.test_args),
> > > > >>> > > >> > File "/home/rmuir/workspace/lucene-solr/dev-
> > > > tools/scripts/smokeTestRelease.py",
> > > > >>> > > >> > line 1483, in smokeTest
> > > > >>> > > >> > solrSrcUnpackPath = unpackAndVerify(java, 'solr',
> tmpDir,
> > > > >>> > > >> > 'solr-%s-src.tgz' % version,
> > > > >>> > > >> > File "/home/rmuir/workspace/lucene-solr/dev-
> > > > tools/scripts/smokeTestRelease.py",
> > > > >>> > > >> > line 566, in unpackAndVerify
> > > > >>> > > >> > verifyUnpacked(java, project, artifact, unpackPath,
> gitRevision,
> > > > >>> > > >> > version, testArgs, tmpDir, baseURL)
> > > > >>> > > >> > File "/home/rmuir/workspace/lucene-solr/dev-
> > > > tools/scripts/smokeTestRelease.py",
> > > > >>> > > >> > line 687, in verifyUnpacked
> > > > >>> > > >> > java.run_java8('ant clean test -Dtests.slow=false
> %s' %
> > > testArgs,
> > > > >>> > > >> > '%s/test.log' % unpackPath)
> > > > >>> > > >> > File "/home/rmuir/workspace/lucene-solr/dev-
> > > > tools/scripts/smokeTestRelease.py",
> > > > >>> > > >> > line 1212, in run_java
> > > > >>> > > >> > run('%s; %s' % (cmd_prefix, cmd), logfile)
> > > > >>> > > >> > File "/home/rmuir/workspace/lucene-solr/dev-
> > > > tools/scripts/smokeTestRelease.py",
> > > > >>> > > >> > line 500, in run
> > > > >>> > > >> > raise RuntimeError('command "%s" failed; see log
> file %s' %
> > > > >>> > > >> > (command, logPath))
> > > > >>> > > >> > RuntimeError: command "export
> > > > >>> > > >> > JAVA_HOME="/home/rmuir/Downloads/jdk8u282-b08"
> > > > >>> > > >> > PATH="/home/rmuir/Downloads/jdk8u282-b08/bin:$PATH"
> > > > >>> > > >> > JAVACMD="/home/rmuir/Downloads/jdk8u282-b08/bin/java";
> > > ant
> > > > clean test
> > > > >>> > > >> > -Dtests.slow=false -Dtests.badapples=false " failed;
> see log file
> > > > >>> > > >> >
> > > >
> > > /tmp/smoke_lucene_8.9.0_05c8a6f0163fe4c330e93775e8e91f3ab66a3f80/un
> > > > pack/solr-8.9.0/test.log
> > > > >>> > > >> >
> > > > >>> > > >> > On Fri, Jun 11, 2021 at 9:47 AM Robert Muir
> > > <rcmuir@gmail.com>
> > > > wrote:
> > > > >>> > > >> > >
> > > > >>> > > >> > > I nuked all my settings and am rerunning with all
> defaults. I'll
> > > > >>> > > >> > > report back what happens/upload log when/if it
> finishes or
> > > fails.
> > > > >>> > > >> > >
> > > > >>> > > >> > > On Fri, Jun 11, 2021 at 9:45 AM Michael Sokolov
> > > > <msokolov@gmail.com> wrote:
> > > > >>> > > >> > > >
> > > > >>> > > >> > > > I tried to comment on the JIRA, but it seems to be
> timing out.
> > > > Now
> > > > >>> > > >> > > > when I go back, SOLR issues are marked as "You
> can't view
> > > this
> > > > issue
> > > > >>> > > >> > > > It may have been deleted or you don't have
> permission to
> > > view
> > > > it."
> > > > >>> > > >> > > > Waat?
> > > > >>> > > >> > > >
> > > > >>> > > >> > > > Anyway, Robert you suggested there that maybe the
> problem
> > > is
> > > > being
> > > > >>> > > >> > > > surfaced by using a different working directory for
> the tests.
> > > Do
> > > > you
> > > > >>> > > >> > > > think that the tests need to be fixed so that they
> work with
> > > this
> > > > >>> > > >> > > > tmp.workDir parameter? What if you were to cd to
> the place
> > > > you want to
> > > > >>> > > >> > > > use as the working dir and call the smokeTester
> from there?
> > > > >>> > > >> > > >
> > > > >>> > > >> > > >
> > > > >>> > > >> > > > On Fri, Jun 11, 2021 at 9:29 AM Mayya Sharipova
> > > > >>> > > >> > > > <mayya.sharipova@elastic.co.invalid> wrote:
> > > > >>> > > >> > > > >
> > > > >>> > > >> > > > > Thanks very much Robert for detailed
> investigations, and
> > > > thanks Jan for your tests.
> > > > >>> > > >> > > > >
> > > > >>> > > >> > > > > I will sort out the problem with my GPG key, but
> I am not
> > > > sure what to do with this SOLR-15473. I've run the smoker test
> again, and it
> > > > passed on my Mac again: SUCCESS! [1:00:03.751500]
> > > > >>> > > >> > > > > Would appreciate more guidance, if we need to
> resolve
> > > SOLR-
> > > > 15473 before 8.9 release.
> > > > >>> > > >> > > > >
> > > > >>> > > >> > > > >
> > > > >>> > > >> > > > > On Fri, Jun 11, 2021 at 8:09 AM Robert Muir
> > > > <rcmuir@gmail.com> wrote:
> > > > >>> > > >> > > > >>
> > > > >>> > > >> > > > >> Dude, if you can vote +1 when the smoketester
> passes,
> > > then
> > > > I can vote
> > > > >>> > > >> > > > >> -1 when it fails. This is my vote, not your
> vote. You don't
> > > get
> > > > to
> > > > >>> > > >> > > > >> decide about it, or change it in any way.
> > > > >>> > > >> > > > >>
> > > > >>> > > >> > > > >> On Fri, Jun 11, 2021 at 8:04 AM Jan Høydahl
> > > > <jan.asf@cominvent.com> wrote:
> > > > >>> > > >> > > > >> >
> > > > >>> > > >> > > > >> > Does it reproduce for you? Are you suspecting
> a bug in
> > > Solr
> > > > that we cannot ship, or only a bug in the smoketester py itself? The
> -1 should
> > > > be about the released bits, not about other tooling?
> > > > >>> > > >> > > > >> > My JVM is OpenJDK 64-Bit Server VM
> > > > (AdoptOpenJDK)(build 25.292-b10, mixed mode)
> > > > >>> > > >> > > > >> >
> > > > >>> > > >> > > > >> > Jan
> > > > >>> > > >> > > > >> >
> > > > >>> > > >> > > > >> > > 11. jun. 2021 kl. 13:48 skrev Robert Muir
> > > > <rcmuir@gmail.com>:
> > > > >>> > > >> > > > >> > >
> > > > >>> > > >> > > > >> > > Jan, I'm using the same automated
> smoketester as
> > > > everyone else. It
> > > > >>> > > >> > > > >> > > fails, so my vote is -1.
> > > > >>> > > >> > > > >> > >
> > > > >>> > > >> > > > >> > > On Fri, Jun 11, 2021 at 7:22 AM Jan Høydahl
> > > > <jan.asf@cominvent.com> wrote:
> > > > >>> > > >> > > > >> > >>
> > > > >>> > > >> > > > >> > >> Tested on MacOS (Intel), No other
> verification than
> > > > smoketester done
> > > > >>> > > >> > > > >> > >>
> > > > >>> > > >> > > > >> > >> SUCCESS! [1:08:19.953492]
> > > > >>> > > >> > > > >> > >>
> > > > >>> > > >> > > > >> > >> +1
> > > > >>> > > >> > > > >> > >>
> > > > >>> > > >> > > > >> > >> Robert - not sure if one test-run failure
> should cancel
> > > > the build. Our smoketester and tests are sometimes a bit picky, and
> does not
> > > > mean that the artifacts are faulty.
> > > > >>> > > >> > > > >> > >>
> > > > >>> > > >> > > > >> > >> Jan
> > > > >>> > > >> > > > >> > >>
> > > > >>> > > >> > > > >> > >> 11. jun. 2021 kl. 04:14 skrev Mayya
> Sharipova
> > > > <mayya.sharipova@elastic.co.INVALID>:
> > > > >>> > > >> > > > >> > >>
> > > > >>> > > >> > > > >> > >> Please vote for release candidate 1 for
> Lucene/Solr
> > > > 8.9.0
> > > > >>> > > >> > > > >> > >>
> > > > >>> > > >> > > > >> > >> The artifacts can be downloaded from:
> > > > >>> > > >> > > > >> > >>
> https://dist.apache.org/repos/dist/dev/lucene/lucene-
> > > > solr-8.9.0-RC1-rev05c8a6f0163fe4c330e93775e8e91f3ab66a3f80
> > > > >>> > > >> > > > >> > >>
> > > > >>> > > >> > > > >> > >> You can run the smoke tester directly with
> this
> > > > command:
> > > > >>> > > >> > > > >> > >>
> > > > >>> > > >> > > > >> > >> python3 -u
> dev-tools/scripts/smokeTestRelease.py \
> > > > >>> > > >> > > > >> > >>
> https://dist.apache.org/repos/dist/dev/lucene/lucene-
> > > > solr-8.9.0-RC1-rev05c8a6f0163fe4c330e93775e8e91f3ab66a3f80
> > > > >>> > > >> > > > >> > >>
> > > > >>> > > >> > > > >> > >> The vote will be open for at least 72 hours
> i.e. until
> > > > 2021-06-16 02:00 UTC.
> > > > >>> > > >> > > > >> > >>
> > > > >>> > > >> > > > >> > >> [ ] +1 approve
> > > > >>> > > >> > > > >> > >> [ ] +0 no opinion
> > > > >>> > > >> > > > >> > >> [ ] -1 disapprove (and reason why)
> > > > >>> > > >> > > > >> > >>
> > > > >>> > > >> > > > >> > >> Here is my +1
> > > > >>> > > >> > > > >> > >> SUCCESS! [0:01:43.815224]
> > > > >>> > > >> > > > >> > >>
> > > > >>> > > >> > > > >> > >>
> > > > >>> > > >> > > > >> > >
> > > > >>> > > >> > > > >> > >
> ---------------------------------------------------------------------
> > > > >>> > > >> > > > >> > > To unsubscribe, e-mail: dev-
> > > > unsubscribe@lucene.apache.org
> > > > >>> > > >> > > > >> > > For additional commands, e-mail: dev-
> > > > help@lucene.apache.org
> > > > >>> > > >> > > > >> > >
> > > > >>> > > >> > > > >> >
> > > > >>> > > >> > > > >> >
> > > > >>> > > >> > > > >> >
> ---------------------------------------------------------------------
> > > > >>> > > >> > > > >> > To unsubscribe, e-mail: dev-
> > > > unsubscribe@lucene.apache.org
> > > > >>> > > >> > > > >> > For additional commands, e-mail: dev-
> > > > help@lucene.apache.org
> > > > >>> > > >> > > > >> >
> > > > >>> > > >> > > > >>
> > > > >>> > > >> > > > >>
> ---------------------------------------------------------------------
> > > > >>> > > >> > > > >> To unsubscribe, e-mail: dev-
> > > unsubscribe@lucene.apache.org
> > > > >>> > > >> > > > >> For additional commands, e-mail: dev-
> > > > help@lucene.apache.org
> > > > >>> > > >> > > > >>
> > > > >>> > > >> > > >
> > > > >>> > > >> > > >
> ---------------------------------------------------------------------
> > > > >>> > > >> > > > To unsubscribe, e-mail:
> dev-unsubscribe@lucene.apache.org
> > > > >>> > > >> > > > For additional commands, e-mail: dev-
> > > help@lucene.apache.org
> > > > >>> > > >> > > >
> > > > >>> > > >>
> > > > >>> > > >>
> ---------------------------------------------------------------------
> > > > >>> > > >> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> > > > >>> > > >> For additional commands, e-mail:
> dev-help@lucene.apache.org
> > > > >>> > > >>
> > > > >>>
> > > > >>>
> ---------------------------------------------------------------------
> > > > >>> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> > > > >>> For additional commands, e-mail: dev-help@lucene.apache.org
> > > > >>>
> > > > >
> > > > >
> > > > > --
> > > > > Adrien
> > > >
> > > > --
> > > > Regards,
> > > >
> > > > Atri
> > > > Apache Concerted
> > > >
> > > > ---------------------------------------------------------------------
> > > > To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> > > > For additional commands, e-mail: dev-help@lucene.apache.org
> > >
> > >
> > > ---------------------------------------------------------------------
> > > To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> > > For additional commands, e-mail: dev-help@lucene.apache.org
> >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> > For additional commands, e-mail: dev-help@lucene.apache.org
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
>
>

1 2  View All