fix CI running out of disk space

I guess not having to copy all the compilers around for each test saved us quite a bit of time/space, around an order of magnitude for each.