Hi Travis CI Community, I experience critical build delays for my open source project. Something that took minutes now takes hours or even days. Here is a build example that takes 2h 20m and not yet over - https://travis-ci.org/github/ets-labs/python-dependency-injector/builds/738348896. There are two more in a queue that even not yet started. Before that it took 15 minutes or less. I’ve started observing delays yesterday. Is it possible to get rid of these delays and get back to 15-minute builds?

As was pointed out in Builds hang in queued state - #6 by Montana linked to earlier in this topic, Travis is moving workers from travis-ci.org to travis-ci.com in preparation to fully close .org (or rather, make it read-only) around the New Year. Travis CI Documentation Migrating repositories to travis-ci.com So you need to migrate to .com to stop experiencing delays. Note the caveats: [image] How to migrate from .org to .com in the light of .org shutting down? Travis CI Discussions & Feedback You may want to consider migrating across to .com sooner rather than later How do we do that? OK, I managed to do this for my repos… I wish I recorded a screencast so I could tell you exactly what I did, becuase it involved some confusing steps, which don’t always match the travis documentation. But basically, you have to go to: => Go to https://travis-ci.com/account/repositories If you have a ‘migrate’ tab there, it will list your repos on travis-ci.org and let you migrate them. If y… [image] Will builds' logs be migrated upon .org -> .com migration? Travis CI Discussions & Feedback It’s still the case that history is not fully migrated. The old builds are shown, but not their logs. Is there a target for when it will be migrated? When ready, will already-migrated repos have the history back-filled, or will only new migrations have history migrated? [image] .org -> .com migration unexpectedly comes with a plan change for OSS. What exactly is the new deal? Travis CI Discussions & Feedback Oh hey though. I just realized, it turns out that open source will no longer be offered free service on travis-ci.com either. In case some of you had missed the announcement. https://www.jeffgeerling.com/blog/2020/travis-cis-new-pricing-plan-threw-wrench-my-open-source-works I had realized my builds stopped working on .org [1] , and was moving them all over to .com – where they started working as expected again – but I hadn’t realized that was just buying me a tiny bit of time. It looks lik…

See [image] Builds hang in queued state Travis CI Discussions & Feedback Hi, Recently I’ve found that our builds became slower and slower after each iteration. Our build is a Scala build on Xenial (default env). Here is an example: https://travis-ci.org/github/rusexpertiza-llc/yupana/jobs/738084928 Previously it takes 1-2 minutes before VM became booting, but today it takes really long time. Also I’ve found that build fails without any reproducible reason. Is it known issue (maybe some infrastructure changing is going or something like that), so any chance to se…

I noticed that for the last 24 hours or so the Linux build jobs have been capped at just under 600 from 13:30 on Thursday (whereas it has peaked over the last week in the 1200 range) which is a change from previously. This is with no announcement and NO reports of any incidents. As a result the backlog is ramping up and is in excess of 6,000 (it reached a local minimum of ~900 in the middle of the Thursdays-Friday night whereas it has always cleared in the past)! https://www.traviscistatus.com/#week

Yep ( See @BanzaiMan link. Travis guys say that it’s related to moving from .org to .com.

That isn’t immediately clear as an explanation - as far as I can tell the repositories for the project I code from have already made the switch - it is more as if they have said, "oh we do not have to provision quite as many build workers for the free projects, let’s take off a third and see if they squeal, if not we can save some Euros or use them elsewhere… " :worried: … OTOH I am a glass half empty guy!

"oh we do not have to provision quite as many build workers for the free projects, let’s take off a third and see if they squeal, if not we can save some Euros or use them elsewhere… " :worried: Right. I hope Travis will fix it or get the workers back. I’ve been using it for last 3 years and it did a great job for my open source project. As of now, the project development is in collapse cause I have build and publishing process automated as well :slight_smile:

It is a way better now. Not sure if it’s related to a fix itself or it’s just cause people don’t work on a weekend :slight_smile: Hope for the first one

[image] No the queue is still long. It is better because during the weekends there is less build see here for the graph https://www.traviscistatus.com/

Yeah, the cap has now dropped to around 560 jobs - which was only briefly hit on Saturday but we have been hard at that since 15:00 UTC on Sunday though it might just be descending from that peak now it is 23:00 UTC Sunday night. Of course the situation is not going to improve tomorrow without action by the Travis people - and as things stand I wouldn’t be surprised if the backlog exceeds 10,000 (10K) by Wednesday and does not fall to less than 3K for the rest of the week-days after that point…

Yes, we are hitting this problem as well. It’s going to cause major problems very soon if it’s not resolved. Or, I suppose I can migrate over to travis-ci.com.

Build delays for open source project

Travis CI Discussions & Feedback

BanzaiMan October 23, 2020, 7:22pm 2

See

Topic		Replies	Views
Builds hang in queued state Travis CI Discussions & Feedback	22	10805	December 17, 2020
My builds are stuck Travis CI Discussions & Feedback	2	652	November 21, 2020
Builds queuing for hours with public git repo Travis CI Discussions & Feedback travis-build	4	1032	November 4, 2020
Builds taking >1hr to start Travis CI Discussions & Feedback	1	703	November 12, 2020
Extremely poor official communication of the .org shutdown Travis CI Discussions & Feedback bug , org-com-migration , community	6	3323	November 25, 2020

Build delays for open source project

Related topics