In the past two weeks we've had three true negative build failures from
Travis on trunk - i.e. bugs were introduced and CI caught them - and one
false negative (where the gcc 9 build broke because of some change in
the Ubuntu repo). So I think we're reaching the point where signal is
dominating noise.
Is everybody OK with sending e-mail notifications for CI failures for
trunk to this list? It's quite likely we will still see occassional
false negatives, and can continue to mark as "allowed failure" any build
combination which looks unstable, so it doesn't fail the job overall.
As with 2.4.x we will only see fail->pass and pass->fail transitions via
e-mail notification.
Regards, Joe
Travis on trunk - i.e. bugs were introduced and CI caught them - and one
false negative (where the gcc 9 build broke because of some change in
the Ubuntu repo). So I think we're reaching the point where signal is
dominating noise.
Is everybody OK with sending e-mail notifications for CI failures for
trunk to this list? It's quite likely we will still see occassional
false negatives, and can continue to mark as "allowed failure" any build
combination which looks unstable, so it doesn't fail the job overall.
As with 2.4.x we will only see fail->pass and pass->fail transitions via
e-mail notification.
Regards, Joe