When the build config validation contains errors, the build does not fail automatically. I think it should fail, because if the config contains errors, then we are not sure if the build is working as expected.
I’m part of Zeste de Savoir dev team and I just realized that our builds didn’t work properly during one month because Travis CI configuration changed and our
.travis.yml didn’t work anymore.
We didn’t see anything because our builds were green. You can see our build history here: https://travis-ci.org/github/zestedesavoir/zds-site/pull_requests. During one month, all builds had one job that runned for 3 minutes and showed green, compared to before where each build had five jobs that runned for about 8 minutes. This change occured between the 11th (job # 12346) and 18th February (job # 12349).
Anyway, I am fixing our build config and as far as I know it didn’t created any big issues for us, but we could have missed important feedback from our CI tests.