Comment 5 for bug 1282876

The underlying error is that some nodepool server images in some provider regions failed to pre-cache some repositories when they were rebuilt overnight (it's possible they attempted to clone them while the git servers were running a repack, which shouldn't cause a problem, but maybe it does). Because servers launched from these images were missing some repositories, DevStack attempted to reclone them when running in jobs leading to a fairly substantial denial of service against the git servers and causing many of those clone attempts to fail, breaking the jobs performing them.

The images in question have all been deleted and replaced at this point along with the nodes built from them. The scripts which perform git repository caching on nodepool images have also been improved so that they'll now retry once on a failure, perform some basic tests within each clone, and abort the image build if issues are encountered.