system-image-cli hangs indefinitely at "Running group download reactor"

Bug #1244211 reported by Michał Sawicz
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
system-image (Ubuntu)
Invalid
Undecided
Unassigned

Bug Description

My current state:

$ system-image-cli -i
current build number: 4
device name: mako
channel: trusty-proposed
last update: 2013-10-24 10:34:55
version version: 4
version ubuntu: 20131023
version device: 20131015

Trying to downgrade to the stable channel results in system-image-cli hanging indefinitely:

$ system-image-cli -c stable -n -v
[systemimage] Oct 24 12:52:36 2013 (5326) Looking for blacklist: https://system-image.ubuntu.com/gpg/blacklist.ta
r.xz
[systemimage] Oct 24 12:52:36 2013 (5326) Requesting group download:
        https://system-image.ubuntu.com/gpg/blacklist.tar.xz -> /var/lib/system-image/keyring.tar.xz
        https://system-image.ubuntu.com/gpg/blacklist.tar.xz.asc -> /var/lib/system-image/keyring.tar.xz.asc

[systemimage] Oct 24 12:52:36 2013 (5326) Running group download reactor
^C[systemimage] Oct 24 12:52:38 2013 (5326) uncaught exception in state machine
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/systemimage/state.py", line 138, in run_until
    step()
  File "/usr/lib/python3/dist-packages/systemimage/state.py", line 187, in _get_blacklist_1
    get_keyring('blacklist', url, 'image-master')
  File "/usr/lib/python3/dist-packages/systemimage/keyring.py", line 107, in get_keyring
    (ascxz_src, ascxz_dst),
  File "/usr/lib/python3/dist-packages/systemimage/download.py", line 177, in get_files
    self._reactor.run()
  File "/usr/lib/python3/dist-packages/systemimage/reactor.py", line 93, in run
    self._loop.run()
  File "/usr/lib/python3/dist-packages/gi/overrides/GLib.py", line 523, in run
    raise KeyboardInterrupt
KeyboardInterrupt

ProblemType: Bug
DistroRelease: Ubuntu 14.04
Package: system-image-cli 1.9.1-0ubuntu1
Uname: Linux 3.4.0-3-mako armv7l
ApportVersion: 2.12.5-0ubuntu2
Architecture: armhf
Date: Thu Oct 24 12:46:57 2013
InstallationDate: Installed on 2013-10-23 (0 days ago)
InstallationMedia: Ubuntu Trusty Tahr (development branch) - armhf (20131023)
MarkForUpload: True
PackageArchitecture: all
SourcePackage: system-image
UpgradeStatus: No upgrade log present (probably fresh install)

Revision history for this message
Michał Sawicz (saviq) wrote :
Revision history for this message
Barry Warsaw (barry) wrote :

That looks like a problem with the download service not sending us the necessary signals. I'll bet it's unreproducible right? ;)

Eventually, the reactor would timeout anyway (default is 10 minutes), but that probably wouldn't help you debug this much. If you wanted to, you could set the environment variable SYSTEMIMAGE_REACTOR_TIMEOUT to some huge number of seconds and see if it's just a slow network connection. While you're doing that, tail /var/log/system-image/client.log for details about system-image-dbus and (I think) /home/phablet/.cache/ubuntu-download-manager/ubuntu-download-manager/ubuntu-download-manager.log (!) for details about what's happening in the dl service.

Best guess is that it's just an intermittent networking problem.

Changed in system-image (Ubuntu):
status: New → Incomplete
Revision history for this message
Michał Sawicz (saviq) wrote : Re: [Bug 1244211] Re: system-image-cli hangs indefinitely at "Running group download reactor"

On 08.11.2013 20:43, Barry Warsaw wrote:
> That looks like a problem with the download service not sending us the
> necessary signals. I'll bet it's unreproducible right?;)
>
> Eventually, the reactor would timeout anyway (default is 10 minutes),
> but that probably wouldn't help you debug this much. If you wanted to,
> you could set the environment variable SYSTEMIMAGE_REACTOR_TIMEOUT to
> some huge number of seconds and see if it's just a slow network
> connection. While you're doing that, tail /var/log/system-
> image/client.log for details about system-image-dbus and (I think)
> /home/phablet/.cache/ubuntu-download-manager/ubuntu-download-manager
> /ubuntu-download-manager.log (!) for details about what's happening in
> the dl service.
>
> Best guess is that it's just an intermittent networking problem.

Probably, yes. Are we getting progress/error reports from the reactor
during the download? Even with --verbose, you just have to hope that
it's actually downloading and not stuck - would be enough to just
forward some updates from the reactor to the user.

Revision history for this message
Barry Warsaw (barry) wrote :

Oh, one other thing. In s-i-cli -v (single verbosity), you don't get the progress indications coming from u-d-m. So if it's taking a long time to download all the data files, it'll look like s-i-cli is waiting in the download reactor, but things *are* actually happening.

You have two options currently. run s-i-cli -vv (verbosity 2) but then you'll see *a ton* of activity as every progress signal coming from u-d-m is echoed to the console (and log file).

Or, you can tail u-d-m's log file, which I think is in /home/phablet/.cache/ubuntu-download-manager/ubuntu-download-manager.log

Revision history for this message
Michał Sawicz (saviq) wrote :

I'll mark this as invalid and will reopen if I can reproduce without it being caused by slow network and such.

Changed in system-image (Ubuntu):
status: Incomplete → Invalid
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.