add installer status message for "Wiping Swap Space"

Bug #432422 reported by tankdriver
68
This bug affects 14 people
Affects Status Importance Assigned to Milestone
ubiquity (Ubuntu)
Invalid
Wishlist
Evan
Declined for Karmic by Dustin Kirkland 
Lucid
Invalid
Wishlist
Evan
Maverick
Invalid
Wishlist
Evan
user-setup (Ubuntu)
Fix Released
Wishlist
Dustin Kirkland 
Declined for Karmic by Dustin Kirkland 
Lucid
Fix Released
Wishlist
Evan
Maverick
Fix Released
Wishlist
Dustin Kirkland 

Bug Description

Please allow a UI freeze exception for the following change. This provides a new progress message for the already-existing behavior of user-setup dding over any swap devices because the encrypt-home option was selected.

http://launchpadlibrarian.net/40241877/432422.patch

Original report follows:
Binary package hint: ubiquity

steps to reproduce:
- run karmic alpha 6 desktop live session
- install Ubuntu with encrypted $HOME (and manual partitioning)

- the installer progress bar stops at 83% for a very long time
- installation finished successfully

at 83% gnome-system-monitor says that the command "dd if=/dev/zero of=/dev/sda2" is running.
(I think wiping partition or something)

the Problem is: There is NO FEEDBACK at all during that command.
(Is the machine alive or dead?)

ProblemType: Bug
Architecture: amd64
Date: Fri Sep 18 13:14:27 2009
DistroRelease: Ubuntu 9.10
NonfreeKernelModules: nvidia
Package: ubiquity (not installed)
ProcEnviron:
 LANG=de_AT.UTF-8
 SHELL=/bin/bash
ProcVersionSignature: Ubuntu 2.6.31-10.34-generic
SourcePackage: ubiquity
Uname: Linux 2.6.31-10-generic x86_64

Revision history for this message
Evan (ev) wrote :

Is /dev/sda1 your swap partition? Can you please attach /var/log/installer/syslog and /var/log/installer/partman to this bug report?

Thanks!

Changed in ubiquity (Ubuntu):
importance: Undecided → Medium
status: New → Incomplete
Revision history for this message
tankdriver (stoneraider-deactivatedaccount) wrote :
Revision history for this message
tankdriver (stoneraider-deactivatedaccount) wrote :
Revision history for this message
tankdriver (stoneraider-deactivatedaccount) wrote :

sry typo, it should be sda2 (root) and sda4 (swap)

description: updated
Revision history for this message
Francisco Panis Kaseker (apterix) wrote :

I had the same problem: 82% installation stopped for long time.

Message: "creating user"

I installed karmic alpha 6 in the asus 1101ha with crypt in /home and ext4 system to / and /home and used swap-area to /swap

I booted by pendrive in my eeepc

After long time my installation concluded.

Changed in ubiquity (Ubuntu):
status: Incomplete → Confirmed
Revision history for this message
tankdriver (stoneraider-deactivatedaccount) wrote :

I think this dd command should erase all data on / or accordingly /home to prevent any possible unintentional data recovery of stuff that were on the machine before encrypting first.

the command is not the problem. Security first.
But there is NO visual FEEDBACK of the installation progress, which is alienating.

Revision history for this message
Evan (ev) wrote :

The installer is writing over any swap partitions to be used by Ubuntu with zeros, to prevent leaking of data that could enter swap before the encrypted swap was set up. The solution, as mentioned, is to provide a progress message for this operation.

Revision history for this message
Joachim Sauer (saua) wrote :

I have also noticed this behaviour and it's rather perplexing. First of all (as others have noted) there isn't any feedback at all that this operation might take a long time (I personally expected "Creating user" to be a rather quick operation). Second: why *does* it take so long? Even with a big swap partition it should not take 15 minutes to zero it out. Might providing a bigger block-size to the dd command increase the speed? As this is time the user usually spends waiting before being able to use his new and shiny Ubuntu installation it is a really bad first impression.

Revision history for this message
Mikko Ohtamaa (mikko-red-innovation) wrote :

Still present in 8.10 Karmic Koala beta netbook-remix.

Related discussion:

http://ubuntuforums.org/showthread.php?p=7975573#post7975573

This might make the user to quit the installer so I think it's quite a showstopper. Should this be nominated for a release blocker?

Revision history for this message
Znet (anton-znetlive) wrote :

Ubuntu Karmic 9.10 alternate cd installer hangs with home partition encrypted at 26% setting up users and passwords stage

I am using:
encrypted disk partition with LVM

tried several times with private home partition and install constantly hangs

Worked flawlesly after I disabled the private home partition

Revision history for this message
Claudio de Oliveira (claudio+de+oliveira) wrote :

I'm having the same issue here. Stucked at 26% for almost an hour. Tested with beta and October 14th daily build of karmic 9.10 AMD64 alternate.

Revision history for this message
Dustin Kirkland  (kirkland) wrote : Re: [Bug 432422] Re: [karmic alpha6] Installing System with encrypted $HOME: Installer hangs at 83% for ~15 minutes

If you drop to tty4 with ctrl-alt-F4, what do you see there?

:-Dustin

Changed in user-setup (Ubuntu):
status: New → Incomplete
importance: Undecided → Medium
Revision history for this message
John Gilmore (gnu-gilmore) wrote : Re: [karmic alpha6] Installing System with encrypted $HOME: Installer hangs at 83% for ~15 minutes

I edited /usr/lib/ubiquity/user-setup/user-setup-apply in the karmic beta UNR liveCD, while Ubiquity was running (still copying files). I changed:

  dd if=/dev/zero of=$device 2>/dev/null || true

to

  dd bs=16m if=/dev/zero of=$device 2>/dev/null || true

The original command was reading 512 bytes of zeroes, writing 512 bytes of zeroes to the disk, and looping. Very slow -- one sector at a time. Adding "bs=16m" means that each write zeroes 16 megabytes of disk. It's about 1000x as fast. Totally eliminates the problem. If you're concerned that in small-memory machines there isn't enough RAM to briefly allocate 16MB for this, change it to 8MB or 4MB, it'll be almost as fast.

With this fix, I saw no perceptible problem with the speed of ubiquity installing around 80%, despite having a swap area of 5GB.

Revision history for this message
Claudio de Oliveira (claudio+de+oliveira) wrote :

Dustin,

I don't remember what tty4 was showing at time, but I do remember that I called "ps" and I saw this process:

"dd if=/dev/zero of=/dev/sda5"

sda5 is the swap partition created with automated partition, using the whole disk. It's a 250GB disk, and I have 4GB of RAM on this machine, so swap was automatically created with aprox. 10GB.

I think John's comment (https://bugs.launchpad.net/ubuntu/+source/ubiquity/+bug/432422/comments/13) could explain why this step takes so much time on my machine.

Revision history for this message
Ali (intrailnein) wrote :

I have the same thing with the Karmic final.

Ubuntu Karmic 9.10 alternate cd installer hangs with home partition encrypted at 26% setting up users and passwords stage-

I am using:
encrypted home partition.

Revision history for this message
Claudio de Oliveira (claudio+de+oliveira) wrote :

Hi Ali,

I haven't tested 9.10 final yet, but RC had the same issue. In fact, the installer is not really "hanged" - after 80 (!) minutes, the installation was finished.

The problem here is that installer displays no feedback to user about what's going on. Annoying, yes, but after some (big) time installation is successfully finished.

tags: added: iso-testing
Revision history for this message
Dustin Kirkland  (kirkland) wrote :

Marking wishlist, triaged, assigning to Evan (for now, feel free to update, Evan).

Also, updating bug title.

The installer should note in the status bar what's going on here...that it's cleaning out the swap space due to the encrypted-swap setup. Quibble over the text, but I think the best way of solving this is making it clearer what's actually going on.

summary: - [karmic alpha6] Installing System with encrypted $HOME: Installer hangs
- at 83% for ~15 minutes
+ add installer status message for "Wiping Swap Space"
Changed in ubiquity (Ubuntu):
importance: Medium → Wishlist
Changed in user-setup (Ubuntu):
importance: Medium → Wishlist
Changed in ubiquity (Ubuntu):
status: Confirmed → Triaged
Changed in user-setup (Ubuntu):
status: Incomplete → Triaged
Changed in ubiquity (Ubuntu):
assignee: nobody → Evan Dandrea (evand)
Changed in user-setup (Ubuntu):
assignee: nobody → Evan Dandrea (evand)
Revision history for this message
Dustin Kirkland  (kirkland) wrote :

Evan-

Any chance we could get something into Lucid's d-i and ubiquity that prints a message about "Wiping swap space for security...this may take several minutes..." ?

Revision history for this message
Evan (ev) wrote :

Absolutely. I'll work on that once we're in FF next month.

Changed in ubiquity (Ubuntu Lucid):
milestone: none → ubuntu-10.04-beta-1
Changed in user-setup (Ubuntu Lucid):
milestone: none → ubuntu-10.04-beta-1
Revision history for this message
Evan (ev) wrote :
description: updated
Colin Watson (cjwatson)
Changed in user-setup (Ubuntu Lucid):
status: Triaged → Fix Committed
Evan (ev)
Changed in ubiquity (Ubuntu Lucid):
status: Triaged → Invalid
Revision history for this message
Launchpad Janitor (janitor) wrote :

This bug was fixed in the package user-setup - 1.28ubuntu5

---------------
user-setup (1.28ubuntu5) lucid; urgency=low

  * Provide a progress message for wiping swap space (LP: #432422).
 -- Evan Dandrea <email address hidden> Fri, 05 Mar 2010 11:51:32 +0000

Changed in user-setup (Ubuntu Lucid):
status: Fix Committed → Fix Released
Revision history for this message
Dustin Kirkland  (kirkland) wrote : Re: [Bug 432422] Re: add installer status message for "Wiping Swap Space"

/me high fives Evan!

Revision history for this message
coryblount@gmail.com (coryblount) wrote :

Wiping Swap space for security (this may take a while)... This is a understatement. Two hours later I am still waiting. Even at 512k at a time it shouldn't take this long. I have 250g so that would be a 5g or 10g swap. It should only take an hour at the most. I'm going to let it set and see if it is acually working or if it is indeed hung up. Doing encrypted LVM with encrypted home. It is currently stuck at 22%. I will post an update later today.

Revision history for this message
coryblount@gmail.com (coryblount) wrote :

I should add that I am also setting it up as a ltsp-standalone server.

Revision history for this message
coryblount@gmail.com (coryblount) wrote :

lol. Okay it just finished at just under 2 hours. This is something that still needs to be addressed cause most people won't wait that long.

Revision history for this message
Dustin Kirkland  (kirkland) wrote :

If you want to want to encrypt your system, and you actually want to
protect your keys, then your swap space must be wiped. Or, you need
to run with no swap space.

Revision history for this message
John Gilmore (gnu-gilmore) wrote :

OK, so now we have a message, that's progress, but it still hangs for minutes after printing the message. How about fixing the underlying bug, which is that a shell script is doing *512-byte* writes from /dev/zero to the swap partition using dd! See comment #13 above. Making it run 1000x as fast, with full security, is *trivial* - just add a bs=16m parameter - but nobody's done it in the year since that comment.

Changed in user-setup (Ubuntu Maverick):
status: Fix Released → In Progress
milestone: ubuntu-10.04-beta-1 → none
assignee: Evan Dandrea (ev) → Dustin Kirkland (kirkland)
Revision history for this message
Dustin Kirkland  (kirkland) wrote :

Thanks, John.

Looks like Evan did inadvertently miss this part of the fix. Our apologies. No one has really monitored this bug since it was marked "fix-released".

In the future, when you see an obvious bug with an equally obvious fix, I recommend doing two simple things:
 1) file a NEW bug against the package (adding information to an old bug is always a bad idea), and attach a patch (this marks the bug in a special way)
 2) poke a developer in #ubuntu-devel in IRC

If you do those two things, I bet you'd get your fix committed within a day or two. Perhaps within the hour, as I'm uploading the change now.

:-Dustin

Revision history for this message
Launchpad Janitor (janitor) wrote :

This bug was fixed in the package user-setup - 1.28ubuntu8

---------------
user-setup (1.28ubuntu8) maverick; urgency=low

  * user-setup-apply.py: when wiping the swap space, use a large (16M)
    block size rather than the default (512-byte), to speed up the slow-but-
    necessary operation, LP: #432422
 -- Dustin Kirkland <email address hidden> Tue, 24 Aug 2010 14:25:33 -0400

Changed in user-setup (Ubuntu Maverick):
status: In Progress → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Duplicates of this bug

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.