[TIP] Blog post about flaky tests at Google

Ben Finney ben+python at benfinney.id.au
Tue Jun 7 18:55:51 PDT 2016

Brianna Laugher <brianna.laugher at gmail.com> writes:

> http://googletesting.blogspot.com.au/2016/05/flaky-tests-at-google-and-how-we.html?m=1
> TL;DR: Even Google doesn't know how to reduce or solve flaky tests   -_-

The observation:

    In some cases, developers dismiss a failing result as flaky only to
    later realize that it was a legitimate failure caused by the code.
    It is human nature to ignore alarms when there is a history of false
    signals coming from a system.

can't be repeated often enough; it is the primary motivation to fix even
small false messages as an important task.

Even one repeatedly ignored warning makes a project markedly unhealthy.

 \         “The most dangerous man to any government is the man who is |
  `\       able to think things out for himself, without regard to the |
_o__)          prevailing superstitions and taboos.” —Henry L. Mencken |
Ben Finney

More information about the testing-in-python mailing list