We’re backsliding some. I encourage people to look at: http://fucit.org/solr-jenkins-reports/failure-report.html, we have a number of ill-behaved tests, particularly TestRequestRateLimiter, TestBulkSchemaConcurrent, TestConfig, SchemaApiFailureTest and TestIndexingSequenceNumbers…
Raw fail count by week totals, most recent week first (corresponds to bits):
Week: 0 had 100 failures
Week: 1 had 82 failures
Week: 2 had 94 failures
Week: 3 had 502 failures
********Failures in Hoss' reports for the last 4 rollups.
There were 585 unannotated tests that failed in Hoss' rollups. Ordered by the date I downloaded the rollup file, newest->oldest. See above for the dates the files were collected
These tests were NOT BadApple'd or AwaitsFix'd
Failures in the last 4 reports..
Report Pct runs fails test
0123 4.4 1583 37 BasicDistributedZkTest.test
0123 4.3 1727 77 CloudExitableDirectoryReaderTest.test
0123 2.5 8598 248 CloudExitableDirectoryReaderTest.testCreepThenBite
0123 1.9 1712 36 CloudExitableDirectoryReaderTest.testWhitebox
0123 0.5 1587 11 DocValuesNotIndexedTest.testGroupingDVOnlySortLast
0123 2.2 1679 82 HttpPartitionOnCommitTest.test
0123 0.5 1592 16 HttpPartitionTest.test
0123 1.0 1578 9 HttpPartitionWithTlogReplicasTest.test
0123 1.3 1569 13 LeaderFailoverAfterPartitionTest.test
0123 7.4 1643 59 MultiThreadedOCPTest.test
0123 0.3 1567 8 ReplaceNodeTest.test
0123 0.2 1588 6 ShardSplitTest.testSplitShardWithRule
0123 100.0 38 33 SharedFSAutoReplicaFailoverTest.test
0123 2.1 818 19 TestCircuitBreaker.testBuildingMemoryPressure
0123 2.6 818 13 TestCircuitBreaker.testResponseWithCBTiming
0123 6.2 1848 104 TestContainerPlugin.testApiFromPackage
0123 2.5 1662 33 TestDistributedGrouping.test
0123 0.4 1448 6 TestDynamicLoading.testDynamicLoading
0123 6.4 1614 74 TestExportWriter.testExpr
0123 8.6 1356 70 TestHdfsCloudBackupRestore.test
0123 9.1 1697 136 TestLocalFSCloudBackupRestore.test
0123 0.5 1607 26 TestPackages.testPluginLoading
0123 0.7 1596 15 TestQueryingOnDownCollection.testQueryToDownCollectionShouldFailFast
0123 1.5 1610 59 TestReRankQParserPlugin.testMinExactCount
0123 0.3 1552 4 TestReplicaProperties.test
0123 0.3 1556 5 TestSolrCloudWithDelegationTokens.testDelegationTokenRenew
0123 0.3 1565 9 TestSolrConfigHandlerCloud.test
********************************************
Raw fail count by week totals, most recent week first (corresponds to bits):
Week: 0 had 100 failures
Week: 1 had 82 failures
Week: 2 had 94 failures
Week: 3 had 502 failures
********Failures in Hoss' reports for the last 4 rollups.
There were 585 unannotated tests that failed in Hoss' rollups. Ordered by the date I downloaded the rollup file, newest->oldest. See above for the dates the files were collected
These tests were NOT BadApple'd or AwaitsFix'd
Failures in the last 4 reports..
Report Pct runs fails test
0123 4.4 1583 37 BasicDistributedZkTest.test
0123 4.3 1727 77 CloudExitableDirectoryReaderTest.test
0123 2.5 8598 248 CloudExitableDirectoryReaderTest.testCreepThenBite
0123 1.9 1712 36 CloudExitableDirectoryReaderTest.testWhitebox
0123 0.5 1587 11 DocValuesNotIndexedTest.testGroupingDVOnlySortLast
0123 2.2 1679 82 HttpPartitionOnCommitTest.test
0123 0.5 1592 16 HttpPartitionTest.test
0123 1.0 1578 9 HttpPartitionWithTlogReplicasTest.test
0123 1.3 1569 13 LeaderFailoverAfterPartitionTest.test
0123 7.4 1643 59 MultiThreadedOCPTest.test
0123 0.3 1567 8 ReplaceNodeTest.test
0123 0.2 1588 6 ShardSplitTest.testSplitShardWithRule
0123 100.0 38 33 SharedFSAutoReplicaFailoverTest.test
0123 2.1 818 19 TestCircuitBreaker.testBuildingMemoryPressure
0123 2.6 818 13 TestCircuitBreaker.testResponseWithCBTiming
0123 6.2 1848 104 TestContainerPlugin.testApiFromPackage
0123 2.5 1662 33 TestDistributedGrouping.test
0123 0.4 1448 6 TestDynamicLoading.testDynamicLoading
0123 6.4 1614 74 TestExportWriter.testExpr
0123 8.6 1356 70 TestHdfsCloudBackupRestore.test
0123 9.1 1697 136 TestLocalFSCloudBackupRestore.test
0123 0.5 1607 26 TestPackages.testPluginLoading
0123 0.7 1596 15 TestQueryingOnDownCollection.testQueryToDownCollectionShouldFailFast
0123 1.5 1610 59 TestReRankQParserPlugin.testMinExactCount
0123 0.3 1552 4 TestReplicaProperties.test
0123 0.3 1556 5 TestSolrCloudWithDelegationTokens.testDelegationTokenRenew
0123 0.3 1565 9 TestSolrConfigHandlerCloud.test
********************************************