Pytest upgrade broke our tests (pytest-cov out of sync?)


#1

The Travis version of pytest seems to have been upgraded from 4.0.2 to 4.1.0 three days ago. Since then, all our test have been failing.

I was able to repro locally by installing pytest==4.1.0 and pytest-cov==2.6.0 which corresponds to the versions installed on Travis.

Updating to pytest-cov=2.6.1 fixes my build locally again, though.

Could you consider also upgrading pytest-cov in Travis to fix things for us?

Example of a failed build: https://travis-ci.org/Charcoal-SE/SmokeDetector/builds/477194185?utm_source=github_status&utm_medium=notification

GitHub ticket for our project: https://github.com/Charcoal-SE/SmokeDetector/issues/2587


#2

For what it’s worth, a temporary workaround was implemented in our repo, but this might still be affecting others too.


#3

Your requirements.txt had a weak requirement (pytest>=3.4.1), and when a new release came out and you ran pip3 install -r requirements.txt --upgrade, pip3 happily downloaded and used version 4.1.0 instead. In the last passing build, you see that it uses 4.0.2 from the cache.