pypi.python.org error Connection reset by peer

Bug #1334898 reported by Matt Riedemann
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack Core Infrastructure
Fix Released
High
Unassigned

Bug Description

http://logs.openstack.org/88/97788/1/gate/gate-requirements-integration-dsvm/b61c652/console.html.gz

2014-06-17 02:05:59.809 | Downloading/unpacking Django>=1.4,<1.7 (from -r /tmp/tmpEsrBJj (line 16))
2014-06-17 02:05:59.809 | Cleaning up...
2014-06-17 02:05:59.809 | Exception:
2014-06-17 02:05:59.809 | Traceback (most recent call last):
2014-06-17 02:05:59.809 | File "/tmp/tmpErMxa1/venv/local/lib/python2.7/site-packages/pip/basecommand.py", line 122, in main
2014-06-17 02:05:59.810 | status = self.run(options, args)
2014-06-17 02:05:59.810 | File "/tmp/tmpErMxa1/venv/local/lib/python2.7/site-packages/pip/commands/install.py", line 278, in run
2014-06-17 02:05:59.810 | requirement_set.prepare_files(finder, force_root_egg_info=self.bundle, bundle=self.bundle)
2014-06-17 02:05:59.810 | File "/tmp/tmpErMxa1/venv/local/lib/python2.7/site-packages/pip/req.py", line 1197, in prepare_files
2014-06-17 02:05:59.810 | do_download,
2014-06-17 02:05:59.810 | File "/tmp/tmpErMxa1/venv/local/lib/python2.7/site-packages/pip/req.py", line 1375, in unpack_url
2014-06-17 02:05:59.810 | self.session,
2014-06-17 02:05:59.810 | File "/tmp/tmpErMxa1/venv/local/lib/python2.7/site-packages/pip/download.py", line 572, in unpack_http_url
2014-06-17 02:05:59.810 | download_hash = _download_url(resp, link, temp_location)
2014-06-17 02:05:59.810 | File "/tmp/tmpErMxa1/venv/local/lib/python2.7/site-packages/pip/download.py", line 433, in _download_url
2014-06-17 02:05:59.810 | for chunk in resp_read(4096):
2014-06-17 02:05:59.810 | File "/tmp/tmpErMxa1/venv/local/lib/python2.7/site-packages/pip/download.py", line 421, in resp_read
2014-06-17 02:05:59.811 | chunk_size, decode_content=False):
2014-06-17 02:05:59.811 | File "/tmp/tmpErMxa1/venv/local/lib/python2.7/site-packages/pip/_vendor/requests/packages/urllib3/response.py", line 240, in stream
2014-06-17 02:05:59.811 | data = self.read(amt=amt, decode_content=decode_content)
2014-06-17 02:05:59.811 | File "/tmp/tmpErMxa1/venv/local/lib/python2.7/site-packages/pip/_vendor/requests/packages/urllib3/response.py", line 187, in read
2014-06-17 02:05:59.811 | data = self._fp.read(amt)
2014-06-17 02:05:59.811 | File "/usr/lib/python2.7/httplib.py", line 561, in read
2014-06-17 02:05:59.811 | s = self.fp.read(amt)
2014-06-17 02:05:59.811 | File "/usr/lib/python2.7/socket.py", line 380, in read
2014-06-17 02:05:59.811 | data = self._sock.recv(left)
2014-06-17 02:05:59.811 | File "/usr/lib/python2.7/ssl.py", line 241, in recv
2014-06-17 02:05:59.811 | return self.read(buflen)
2014-06-17 02:05:59.812 | File "/usr/lib/python2.7/ssl.py", line 160, in read
2014-06-17 02:05:59.812 | return self._sslobj.read(len)
2014-06-17 02:05:59.812 | error: [Errno 104] Connection reset by peer
2014-06-17 02:05:59.812 |
2014-06-17 02:05:59.812 | Storing debug log for failure in /home/jenkins/.pip/pip.log
2014-06-17 02:05:59.812 | pip install did not indicate success
2014-06-17 02:05:59.977 | + gen_bare_package_list '/opt/stack/new/requirements/global-requirements.txt /opt/stack/new/requirements/dev-requirements.txt'
2014-06-17 02:05:59.978 | + set +x
2014-06-17 02:05:59.985 | + gen_bare_package_list /home/jenkins/mirror_package_list.txt
2014-06-17 02:06:00.016 | + set +x
2014-06-17 02:06:00.016 | /opt/stack/new/pbr/tools/integration.sh: line 18: /home/jenkins/mirror_package_list.txt: No such file or directory

http://logstash.openstack.org/#eyJzZWFyY2giOiJtZXNzYWdlOlwiL29wdC9zdGFjay9uZXcvcGJyL3Rvb2xzL2ludGVncmF0aW9uLnNoXCIgQU5EIG1lc3NhZ2U6XCIvaG9tZS9qZW5raW5zL21pcnJvcl9wYWNrYWdlX2xpc3QudHh0OiBObyBzdWNoIGZpbGUgb3IgZGlyZWN0b3J5XCIgQU5EIHRhZ3M6XCJjb25zb2xlXCIgQU5EIChidWlsZF9uYW1lOlwiZ2F0ZS1yZXF1aXJlbWVudHMtaW50ZWdyYXRpb24tZHN2bVwiIE9SIGJ1aWxkX25hbWU6XCJjaGVjay1yZXF1aXJlbWVudHMtaW50ZWdyYXRpb24tZHN2bVwiKSIsImZpZWxkcyI6W10sIm9mZnNldCI6MCwidGltZWZyYW1lIjoiNjA0ODAwIiwiZ3JhcGhtb2RlIjoiY291bnQiLCJ0aW1lIjp7InVzZXJfaW50ZXJ2YWwiOjB9LCJzdGFtcCI6MTQwMzgyNTEyNDM5OSwibW9kZSI6IiIsImFuYWx5emVfZmllbGQiOiIifQ==

5 hits in 7 days, check and gate, all failures.

message:"/opt/stack/new/pbr/tools/integration.sh" AND message:"/home/jenkins/mirror_package_list.txt: No such file or directory" AND tags:"console" AND (build_name:"gate-requirements-integration-dsvm" OR build_name:"check-requirements-integration-dsvm")

Tags: gate-failure
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to elastic-recheck (master)

Related fix proposed to branch: master
Review: https://review.openstack.org/102979

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to elastic-recheck (master)

Reviewed: https://review.openstack.org/102979
Committed: https://git.openstack.org/cgit/openstack-infra/elastic-recheck/commit/?id=7225c73011de23a7bc1d93b449e9ed93d9988f87
Submitter: Jenkins
Branch: master

commit 7225c73011de23a7bc1d93b449e9ed93d9988f87
Author: Matt Riedemann <email address hidden>
Date: Thu Jun 26 16:37:05 2014 -0700

    Add query for bug 1334898

    Not sure if this is an infra or pbr bug, but it's in the gate, 5 hits in
    7 days, all failures.

    Related-Bug: #1334898

    Change-Id: I06317a57f3571f7015e0fedab780041795d2a465

Revision history for this message
Jeremy Stanley (fungi) wrote :

Basically, since the requirements integration job downloads from packages from pypi.python.org instead of using the pypi.openstack.org mirror, we see different failure modes associated with it. Donald Stufft has acknowledged that from time to time their Fastly CDN has issues with HTTPS connections resulting in a connection reset (TCP/RST) and exposing the error you see here.

summary: - reqs integration job fails with /home/jenkins/mirror_package_list.txt:
- No such file or directory
+ pypi.python.org error Connection reset by peer
tags: added: gate-failure
Changed in openstack-ci:
status: New → Confirmed
importance: Undecided → High
milestone: none → juno
Revision history for this message
Jeremy Stanley (fungi) wrote :

This should clear up when the requirements integration job is redone to use our new bandersnatch full-PyPI mirror, which is expected to be very soon.

Revision history for this message
James E. Blair (corvus) wrote :

Bandersnatch seems to have improved this.

Changed in openstack-ci:
status: Confirmed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.