Build taking longer on focal-gravtion2 than xenial

Hello,

My testing has shown that when moving to Unbuntu Focal with graviton2 in https://github.com/MirahezeBots/MirahezeBots/pull/334 was taking longer than Xenial.

I have added pip cache which seems to have sped it up quite a bit but I wondered if I was missing anything else or could change it further.

Feel free to either suggest here or directly open PRs.

Thanks!

Looks to be a duplicate of

Thanks for pointing that out