As an aside: Do you really need to test in multiple Ubuntu versions? Unless you are testing an extension linked against distro-provided libraries – which is a questionable thing to do, Python packages distributed via PyPI should rather be built against a manylinux standard image – only the Python version matters.