OpenStack-Gate

stable/liberty: gate-requirements-integration-dsvm fails with due to UnicodeDecodeError in httpretty

Bug #1560808 reported by Tony Breeds
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack-Gate
Fix Released
Undecided
Unassigned

Bug Description

Firstly I know this isn't the right place for this bug but it seems the least worst.

Since about 2016-March-18 the liberty branch of openstack/requirements is failing with[1]:
Collecting httpretty<0.8.7,>=0.8.4 (from -r /opt/stack/new/requirements/global-requirements.txt (line 267))
   Downloading http://mirror.ord.rax.openstack.org/pypi/packages/source/h/httpretty/httpretty-0.8.6.tar.gz (40kB)
     Complete output from command python setup.py egg_info:
     Traceback (most recent call last):
       File "<string>", line 1, in <module>
       File "/tmp/pip-build-bdzh6t2x/httpretty/setup.py", line 86, in <module>
         version=read_version(),
       File "/tmp/pip-build-bdzh6t2x/httpretty/setup.py", line 46, in read_version
         finder.visit(ast.parse(local_file('httpretty', '__init__.py')))
       File "/tmp/pip-build-bdzh6t2x/httpretty/setup.py", line 78, in <lambda>
         open(os.path.join(os.path.dirname(__file__), *f)).read()
       File "/tmp/tmpE5SXAp/lib/python3.4/encodings/ascii.py", line 26, in decode
         return codecs.ascii_decode(input, self.errors)[0]
     UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 133: ordinal not in range(128)

This is generated during the python 3.4[2] run of generate-constraints[3]

It has been seen on several different cloud providers (RAX, OVH, Internap and OSIC)

logstash: http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22UnicodeDecodeError%3A%20'ascii'%20codec%20can't%20decode%20byte%200xc3%20in%20position%20133%3A%20ordinal%20not%20in%20range(128)%5C%22%20AND%20tags%3A%5C%22console%5C%22%20AND%20build_name%3A%5C%22gate-requirements-integration-dsvm%5C%22%20AND%20build_branch%3A%5C%22stable%2Fliberty%5C%22

[1] http://logs.openstack.org/47/282347/6/gate/gate-requirements-integration-dsvm/b8d7041/console.html#_2016-03-23_01_42_02_274
[2] http://logs.openstack.org/47/282347/6/gate/gate-requirements-integration-dsvm/b8d7041/console.html#_2016-03-23_01_42_02_194
[3] http://git.openstack.org/cgit/openstack/requirements/tree/tools/integration.sh?h=stable/liberty#n69

Revision history for this message
Tony Breeds (o-tony) wrote :

My best guess is the default encoding has switched from UTF-8 -> ASCII in our nodepool images

Revision history for this message
Tony Breeds (o-tony) wrote :

So I think *think* all the jobs that pass are devstack-trusty and the failures are ubuntu-trusty. I'll investigate that.

Possibly related to: https://review.openstack.org/#/c/290789/5

ALso:

http://logs.openstack.org/25/295625/2/check/gate-requirements-integration-dsvm/8bf651d/console.html#_2016-03-23_05_34_23_639
locale=POSIX

preferred encoding:"ANSI_X3.4-1968"

http://logs.openstack.org/25/295625/2/check/gate-requirements-integration-dsvm/8bf651d/console.html#_2016-03-23_05_49_25_004

Revision history for this message
Tony Breeds (o-tony) wrote :

Okay:

(all_reqs)root@devstack-gate:~# export LANG=
(all_reqs)root@devstack-gate:~# export LANGUAGE=
(all_reqs)root@devstack-gate:~# export LC_CTYPE="POSIX"
(all_reqs)root@devstack-gate:~# export LC_NUMERIC="POSIX"
(all_reqs)root@devstack-gate:~# export LC_TIME="POSIX"
(all_reqs)root@devstack-gate:~# export LC_COLLATE="POSIX"
(all_reqs)root@devstack-gate:~# export LC_MONETARY="POSIX"
(all_reqs)root@devstack-gate:~# export LC_MESSAGES="POSIX"
(all_reqs)root@devstack-gate:~# export LC_PAPER="POSIX"
(all_reqs)root@devstack-gate:~# export LC_NAME="POSIX"
(all_reqs)root@devstack-gate:~# export LC_ADDRESS="POSIX"
(all_reqs)root@devstack-gate:~# export LC_TELEPHONE="POSIX"
(all_reqs)root@devstack-gate:~# export LC_MEASUREMENT="POSIX"
(all_reqs)root@devstack-gate:~# export LC_IDENTIFICATION="POSIX"
(all_reqs)root@devstack-gate:~# export LC_ALL=
(all_reqs)root@devstack-gate:~#
(all_reqs)root@devstack-gate:~# cd tmp
(all_reqs)root@devstack-gate:~/tmp# cd httpretty-0.8.6
(all_reqs)root@devstack-gate:~/tmp/httpretty-0.8.6# python setup.py egg_info
Traceback (most recent call last):
  File "setup.py", line 86, in <module>
    version=read_version(),
  File "setup.py", line 46, in read_version
    finder.visit(ast.parse(local_file('httpretty', '__init__.py')))
  File "setup.py", line 78, in <lambda>
    open(os.path.join(os.path.dirname(__file__), *f)).read()
  File "/root/all_reqs/lib/python3.4/encodings/ascii.py", line 26, in decode
    return codecs.ascii_decode(input, self.errors)[0]
UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 133: ordinal not in range(128)

So we're onto something.

The DIB change referenced in Comment 2 has been +W'd so I'll re-test tomorrow

Matt Riedemann (mriedem)
Changed in openstack-gate:
status: New → Confirmed
Revision history for this message
Tony Breeds (o-tony) wrote :

Diskimage-Builder 0.13.0 includes a fix for this issue. All ubuntu-trusty nodes have been regenerated.

Changed in openstack-gate:
status: Confirmed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.