Xenial only provides Python 3.5.1 and unless your language: is python, Travis’ logic to install other versions is unavailable.
Use a 3rd-party library that can install various Python versions itself. I can name multibuild and pyenv from the top of my head.