Quantal Ubuntu Desktop 20120524 failed to install: ubi-language failed with exit status 1: UnicodeError in process_line() in filteredcommand.py

Bug #1003851 reported by Jean-Baptiste Lallement
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
ubiquity (Ubuntu)
Fix Released
Critical
Colin Watson
Quantal
Fix Released
Critical
Colin Watson

Bug Description

Quantal Ubuntu Desktop 20120524 automated test failed in ubi-language

Error from debug log:
""""
May 24 09:07:28 ubiquity: Starting up '['log-output', '-t', 'ubiquity', '--pass-stdout', '/usr/lib/ubiquity/localechooser/localechooser']' for ubi-language.Page
May 24 09:07:28 ubiquity: Watching for question patterns localechooser/languagelist
May 24 09:07:28 debconf (filter): <-- CAPB backup
May 24 09:07:28 debconf (filter): <-- REGISTER debian-installer/language debconf/language
update_release_notes_label()
May 24 09:07:28 debconf (filter): <-- SUBST localechooser/languagelist CODES C, sq, am, ar, ast, eu, be, bn, bs, bg, my, ca, zh_CN, zh_TW, hr, cs, da, nl, dz, en, eo, et, fi, fr, gl, ka, de, el, gu, he, hi, hu, is, id, ga, it, ja, kn, kk, km, ko, ku, lo, lv, lt, mk, ml, mr, ne, se_NO, nb_NO, nn_NO, fa, pl, pt, pt_BR, pa, ro, ru, sr, si, sk, sl, es, sv, tl, ta, te, th, bo, tr, uk, ug, vi
May 24 09:07:28 debconf (filter): <-- SUBST localechooser/languagelist NAMES_EN C, Albanian, Amharic, Arabic, Asturian, Basque, Belarusian, Bengali, Bosnian, Bulgarian, Burmese, Catalan, Chinese (Simplified), Chinese (Traditional), Croatian, Czech, Danish, Dutch, Dzongkha, English, Esperanto, Estonian, Finnish, French, Galician, Georgian, German, Greek, Gujarati, Hebrew, Hindi, Hungarian, Icelandic, Indonesian, Irish, Italian, Japanese, Kannada, Kazakh, Khmer, Korean, Kurdish, Lao, Latvian, Lithuanian, Macedonian, Malayalam, Marathi, Nepali, Northern Sami, Norwegian Bokmaal, Norwegian Nynorsk, Persian, Polish, Portuguese, Portuguese (Brazil), Punjabi (Gurmukhi), Romanian, Russian, Serbian (Cyrillic), Sinhala, Slovak, Slovenian, Spanish, Swedish, Tagalog, Tamil, Telugu, Thai, Tibetan, Turkish, Ukrainian, Uyghur, Vietnamese
Exception caught in process_line:
Traceback (most recent call last):
  File "/usr/lib/ubiquity/ubiquity/filteredcommand.py", line 135, in process_line
    return self.dbfilter.process_line()
  File "/usr/lib/ubiquity/ubiquity/debconffilter.py", line 258, in process_line
    self.debug('filter', '<--', command, *params)
  File "/usr/lib/ubiquity/ubiquity/debconffilter.py", line 116, in debug
    file=sys.stderr)
UnicodeEncodeError: 'ascii' codec can't encode characters in position 167-170: ordinal not in range(128)
May 24 09:07:28 ubiquity: ['log-output', '-t', 'ubiquity', '--pass-stdout', '/usr/lib/ubiquity/localechooser/localechooser'] exited with code 1
""""

ProblemType: Bug
DistroRelease: Ubuntu 12.10
Package: ubiquity 2.11.1
ProcVersionSignature: Ubuntu 3.4.0-3.7-generic 3.4.0
Uname: Linux 3.4.0-3-generic x86_64
ApportVersion: 2.1-0ubuntu1
Architecture: amd64
CasperVersion: 1.317
Date: Thu May 24 09:29:12 2012
InstallCmdLine: boot=casper DEBCONF_DEBUG=developer -- debconf/priority=critical locale=en_US console-setup/ask_detect=false console-setup/layoutcode=us keyboard-configuration/layoutcode=fr keyboard-configuration/variantcode=oss noprompt console=ttyS0 automatic-ubiquity initrd=initrd.22c675df-c08c-4a41-999f-15c8ff818e6e BOOT_IMAGE=kernel.22c675df-c08c-4a41-999f-15c8ff818e6e
LiveMediaBuild: Ubuntu 12.10 "Quantal Quetzal" - Alpha amd64 (20120524)
ProcEnviron:
 TERM=xterm
 PATH=(custom, no user)
 LANG=en_US.UTF-8
 SHELL=/bin/bash
SourcePackage: ubiquity
UpgradeStatus: No upgrade log present (probably fresh install)

Revision history for this message
Jean-Baptiste Lallement (jibel) wrote :
description: updated
tags: added: iso-testing qa-daily-testing rls-mgr-p-tracking
summary: Quantal Ubuntu Desktop 20120524 failed to install: ubi-language failed
- with exit status 1
+ with exit status 1: UnicodeError in process_line() in filtercommand.py
summary: Quantal Ubuntu Desktop 20120524 failed to install: ubi-language failed
- with exit status 1: UnicodeError in process_line() in filtercommand.py
+ with exit status 1: UnicodeError in process_line() in filteredcommand.py
Revision history for this message
Jean-Baptiste Lallement (jibel) wrote :

I cannot reproduce it manually, only with a preseeded installation

Changed in ubiquity (Ubuntu Quantal):
assignee: nobody → Canonical Foundations Team (canonical-foundations)
Revision history for this message
Jean-Baptiste Lallement (jibel) wrote :

setting to critical because it blocks automated tests

Changed in ubiquity (Ubuntu Quantal):
assignee: Canonical Foundations Team (canonical-foundations) → nobody
importance: Undecided → Critical
Changed in ubiquity (Ubuntu Quantal):
assignee: nobody → Canonical Foundations Team (canonical-foundations)
Revision history for this message
Colin Watson (cjwatson) wrote :

My initial guess is that we might need something like this at the top level:

if sys.version >= '3':
    # Force encoding to UTF-8 even in non-UTF-8 locales.
    import io
    sys.stderr = io.TextIOWrapper(
        sys.stderr.detach(), encoding="UTF-8", line_buffering=True)

Changed in ubiquity (Ubuntu Quantal):
assignee: Canonical Foundations Team (canonical-foundations) → Colin Watson (cjwatson)
Revision history for this message
Colin Watson (cjwatson) wrote :

Actually not - we're opening sys.stderr ourselves anyway. The problem is actually that we need to force ourselves into a UTF-8 locale.

Changed in ubiquity (Ubuntu Quantal):
status: New → Fix Committed
Revision history for this message
Launchpad Janitor (janitor) wrote :

This bug was fixed in the package ubiquity - 2.11.2

---------------
ubiquity (2.11.2) quantal; urgency=low

  [ Colin Watson ]
  * If ubiquity is started up in a non-UTF-8 locale, force it into C.UTF-8
    and fail immediately if that's unavailable (LP: #1003851).
  * KDE fails to round-trip strings containing U+FEFF ZERO WIDTH NO-BREAK
    SPACE, such as the translations of a few language names. Strip these
    from language name translations.
  * Install debconf-set from debian-installer-utils, useful for preseeding.

  [ Evan Dandrea ]
  * Remove migration-assistant following foundations-q-testing-
    migration-assistant. Thanks Dmitrijs Ledkovs!
  * Automatic update of included source packages: base-installer
    1.122ubuntu8, flash-kernel 2.28ubuntu43.
 -- Evan Dandrea <email address hidden> Fri, 25 May 2012 15:47:47 +0100

Changed in ubiquity (Ubuntu Quantal):
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.