Timeout extension for arm64 builds

ossdev07 · December 17, 2019, 1:16pm

Hi
I have been trying to add tests for pandas-dev for arm64 in travis-ci .
Due to absence of wheels for numpy on arm64, the whole build+test suite consumes more than 50 minutes to complete .
here is the build :
https://travis-ci.org/ossdev07/pandas/jobs/625636386

current timeout limit to finish a job in arm64 is 50 minutes, but that is a bit low for arm64 builds.
I’m estimating it will take 1 hour 20 minutes .

Is there a way to request extension of timeout limit for arm64 ?

native-api · December 17, 2019, 1:25pm

(The first few sentences from the below post apply to you)

junaruga · December 17, 2019, 7:06pm

github.com

pandas-dev/pandas/blob/master/ci/setup_env.sh#L133


echo "[Build extensions]"
python setup.py build_ext -q -i


# XXX: Some of our environments end up with old versions of pip (10.x)
# Adding a new enough version of pip to the requirements explodes the
# solve time. Just using pip to update itself.
# - py35_macos
# - py35_compat
# - py36_32bit
echo "[Updating pip]"
python -m pip install --no-deps -U pip wheel setuptools


echo "[Install pandas]"
python -m pip install --no-build-isolation -e .


echo
echo "conda list"
conda list


# Install DB for Linux
if [ "${TRAVIS_OS_NAME}" == "linux" ]; then

python -m pip install --no-deps -U pip wheel setuptools

This part in your code takes time, right?

How about using deb packages conditionally instead of python -m pip install, for example for only cases that take longer time?

In my understanding, pip install compiles binaries from the source code. But apt-get install just installs compiled binaries.
I think this saves much time.

sudo apt-get -yq install python3-pip python3-wheel python3-setuptools

https://packages.ubuntu.com/xenial/python3-pip
https://packages.ubuntu.com/xenial/python3-wheel
https://packages.ubuntu.com/xenial/python3-setuptools
https://packages.ubuntu.com/xenial/python3-numpy

Michal · October 20, 2020, 2:33am

Hi @ossdev07

Thanks for reaching out. I’ll contact you via DM about build times. Please take into consideration tips from @native-api and @junaruga (much appreciated!) - they’re spot on on speeding up your build, which not only allows to avoid timeout issues, but above all shortens your own time of waiting for the build to come through.

Happy building!