If people don’t know about: http://fucit.org/solr-jenkins-reports/suspicious-failure-report.html, I strongly recommend you periodically check it. It reports tests that have changed their failure rates lately. There are three currently:
"org.apache.solr.search.TestIndexSearcher","testSearcherListeners"
"org.apache.solr.update.processor.DocExpirationUpdateProcessorFactoryTest","testAutomaticDeletes"
"org.apache.solr.cloud.PackageManagerCLITest","testPackageManager
Short form:
Raw fail count by week totals, most recent week first (corresponds to bits):
Week: 0 had 128 failures
Week: 1 had 68 failures
Week: 2 had 113 failures
Week: 3 had 103 failures
********Failures in Hoss' reports for the last 4 rollups.
There were 298 unannotated tests that failed in Hoss' rollups. Ordered by the date I downloaded the rollup file, newest->oldest. See above for the dates the files were collected
These tests were NOT BadApple'd or AwaitsFix'd
Failures in the last 4 reports..
Report Pct runs fails test
0123 0.4 1461 5 DeleteReplicaTest.deleteReplicaAndVerifyDirectoryCleanup
0123 0.7 1464 9 MetricTriggerIntegrationTest.testMetricTrigger
0123 1.6 1377 29 MultiThreadedOCPTest.test
0123 0.7 1455 5 NodeMarkersRegistrationTest.testNodeMarkersRegistration
0123 2.1 1481 17 RollingRestartTest.test
0123 0.4 1537 55 ScheduledTriggerIntegrationTest.testScheduledTrigger
0123 7.7 98 6 ShardSplitTest.testSplitWithChaosMonkey
0123 0.4 1455 9 SystemCollectionCompatTest.testBackCompat
0123 0.7 1456 14 TestPackages.testPluginLoading
0123 1.1 1460 9 TestQueryingOnDownCollection.testQueryToDownCollectionShouldFailFast
0123 0.7 1498 13 TestSimScenario.testSuggestions
********************************************
I took the SuppressWarnings count section out, it’s ridiculously big.
"org.apache.solr.search.TestIndexSearcher","testSearcherListeners"
"org.apache.solr.update.processor.DocExpirationUpdateProcessorFactoryTest","testAutomaticDeletes"
"org.apache.solr.cloud.PackageManagerCLITest","testPackageManager
Short form:
Raw fail count by week totals, most recent week first (corresponds to bits):
Week: 0 had 128 failures
Week: 1 had 68 failures
Week: 2 had 113 failures
Week: 3 had 103 failures
********Failures in Hoss' reports for the last 4 rollups.
There were 298 unannotated tests that failed in Hoss' rollups. Ordered by the date I downloaded the rollup file, newest->oldest. See above for the dates the files were collected
These tests were NOT BadApple'd or AwaitsFix'd
Failures in the last 4 reports..
Report Pct runs fails test
0123 0.4 1461 5 DeleteReplicaTest.deleteReplicaAndVerifyDirectoryCleanup
0123 0.7 1464 9 MetricTriggerIntegrationTest.testMetricTrigger
0123 1.6 1377 29 MultiThreadedOCPTest.test
0123 0.7 1455 5 NodeMarkersRegistrationTest.testNodeMarkersRegistration
0123 2.1 1481 17 RollingRestartTest.test
0123 0.4 1537 55 ScheduledTriggerIntegrationTest.testScheduledTrigger
0123 7.7 98 6 ShardSplitTest.testSplitWithChaosMonkey
0123 0.4 1455 9 SystemCollectionCompatTest.testBackCompat
0123 0.7 1456 14 TestPackages.testPluginLoading
0123 1.1 1460 9 TestQueryingOnDownCollection.testQueryToDownCollectionShouldFailFast
0123 0.7 1498 13 TestSimScenario.testSuggestions
********************************************
I took the SuppressWarnings count section out, it’s ridiculously big.