This happened 3 times during one day on a recent nova-api service:
2012-09-19 14:36:54 INFO nova.api.openstack.wsgi [req-1ed1f35c-18ed-4c9e-bc1d-69a99011aaf9 d74ac063e2304b70abb9dd8f6f2d05ef ac9556a566104e8289dd519c7c7d9aa3] GET http://a.b.c.d:8774/v2/ac9556a566104e8289dd519c7c7d9aa3/servers/detail
2012-09-19 14:36:54 DEBUG nova.api.openstack.wsgi [req-1ed1f35c-18ed-4c9e-bc1d-69a99011aaf9 d74ac063e2304b70abb9dd8f6f2d05ef ac9556a566104e8289dd519c7c7d9aa3] No Content-Type provided in request from (pid=20526) get_body /usr/lib/python2.7/dist-packages/nova/api/openstack/wsgi.py:775
2012-09-19 14:36:54 DEBUG nova.compute.api [req-1ed1f35c-18ed-4c9e-bc1d-69a99011aaf9 d74ac063e2304b70abb9dd8f6f2d05ef ac9556a566104e8289dd519c7c7d9aa3] Searching by: {'deleted': False, 'project_id': u'ac9556a566104e8289dd519c7c7d9aa3'} from (pid=20526) get_all /usr/lib/python2.7/dist-packages/nova/compute/api.py:1041
2012-09-19 14:36:54 INFO nova.api.openstack.wsgi [req-1ed1f35c-18ed-4c9e-bc1d-69a99011aaf9 d74ac063e2304b70abb9dd8f6f2d05ef ac9556a566104e8289dd519c7c7d9aa3] http://a.b.c.d:8774/v2/ac9556a566104e8289dd519c7c7d9aa3/servers/detail returned with HTTP 200
2012-09-19 14:36:54 INFO nova.osapi_compute.wsgi.server [req-1ed1f35c-18ed-4c9e-bc1d-69a99011aaf9 d74ac063e2304b70abb9dd8f6f2d05ef ac9556a566104e8289dd519c7c7d9aa3] Traceback (most recent call last):
File "/usr/lib/python2.7/dist-packages/eventlet/wsgi.py", line 351, in handle_one_response
write(''.join(towrite))
File "/usr/lib/python2.7/dist-packages/eventlet/wsgi.py", line 301, in write
_writelines(towrite)
File "/usr/lib/python2.7/socket.py", line 334, in writelines
self.flush()
File "/usr/lib/python2.7/socket.py", line 303, in flush
self._sock.sendall(view[write_offset:write_offset+buffer_size])
File "/usr/lib/python2.7/dist-packages/eventlet/greenio.py", line 307, in sendall
tail = self.send(data, flags)
File "/usr/lib/python2.7/dist-packages/eventlet/greenio.py", line 286, in send
total_sent += fd.send(data[total_sent:], flags)
error: [Errno 32] Broken pipe
It looks similar to some other bugs (bug 850425, bug 718869, but both were fixed and it doesn't look like there was rabbitmq disconnection happening).
Using build from 2012-09-07 21:53. With "python-greenlet 0.3.1-1ubuntu5.2"
This traceback is in eventlet, but it could still be related to a problem in nova. Unfortunately, I don't think we can do much unless we have a better idea of when it happens. Can you reproduce it? Do you have any ideas about what triggers it?