quickstart devmode.sh fails on OVB deployment on the "Run virt-customize on the provided image" task

Bug #1730997 reported by Attila Darazs
12
This bug affects 2 people
Affects Status Importance Assigned to Milestone
tripleo
Fix Released
High
Sagi (Sergey) Shnaidman

Bug Description

devmode is throwing the following error:

TASK [modify-image : Run virt-customize on the provided image]
 *****************
 task path: /home/hpokorny/.quickstart/usr/local/share/ansible/roles/
modify-image/tasks/libguestfs.yml:40
 Wednesday 08 November 2017 08:25:34 -0400 (0:00:00.107)
  0:26:31.748 ****
 fatal: [undercloud]: FAILED! => {"changed": true, "cmd":
"virt-customize -m 4096 --smp 4 -v --run /home/stack/repo_setup.sh -a
$HOME/ironic-python-agent.initramfs > /home/stack/_home_stack_repo_setup.sh.log
2>&1", "delta": "0:00:05.223714", "end": "2017-11-08 12:25:41.560509",
"failed": true, "rc": 1, "start": "2017-11-08 12:25:36.336795", "stderr":
"", "stdout": "", "stdout_lines": [], "warnings": []}

This is probably due to some error with running virt-customize within the OVB instance. We still need more logs (mostly /home/stack/_home_stack_repo_setup.sh.log) but I'm creating this bug to track the issue.

We can probably work around this by installing the built packages the same way upstream jobs do: https://github.com/openstack-infra/tripleo-ci/blob/master/toci-quickstart/config/testenv/ovb.yml#L37

When trying to reproduce, this related change should be also used, if it's not merged already: https://review.openstack.org/518336

Please add more logs if you reproduce the problem. Otherwise I will start reproducing it tomorrow and look for a fix.

Tags: quickstart
Revision history for this message
Julie Pichon (jpichon) wrote :

I posted the requested log output at http://paste.openstack.org/show/625860/ . The following bit might be relevant:

commandrvf: mount -o ro /dev/sda /sysroot/
[ 3.004369] SGI XFS with ACLs, security attributes, no debug enabled
mount: unknown filesystem type '(null)'
guestfsd: error: /dev/sda on / (options: 'ro'): mount: unknown filesystvirt-customize: error: no operating systems were found in the guest image

(Note: I had to apply both https://review.openstack.org/518336 (to get past ssh errors) and https://review.openstack.org/#/c/512798/ (to get past IMPI errors) to get this far in the first place.)

Hope this helps, please let me know what other logs may be useful if any.

Revision history for this message
Ronelle Landy (rlandy) wrote :

https://review.openstack.org/#/c/512798/ has merged.

Rebased https://review.openstack.org/518336 and ran devmode with that change.
I can reproduce the virt-customize error - and jpichon's posted log.

Revision history for this message
Ronelle Landy (rlandy) wrote :

Updated https://review.openstack.org/#/c/518336/ to avoid running virt-customize on initramfs

Changed in tripleo:
assignee: nobody → Sagi (Sergey) Shnaidman (sshnaidm)
status: Triaged → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to tripleo-quickstart (master)

Related fix proposed to branch: master
Review: https://review.openstack.org/518800

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on tripleo-quickstart-extras (master)

Change abandoned by Sagi Shnaidman (<email address hidden>) on branch: master
Review: https://review.openstack.org/518336

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to tripleo-quickstart-extras (master)

Reviewed: https://review.openstack.org/518336
Committed: https://git.openstack.org/cgit/openstack/tripleo-quickstart-extras/commit/?id=a05e1f762230889e8e4d27c13134c77c6acc9544
Submitter: Zuul
Branch: master

commit a05e1f762230889e8e4d27c13134c77c6acc9544
Author: Ronelle Landy <email address hidden>
Date: Wed Nov 8 14:18:39 2017 -0500

    Fix devmode run of quickstart

    Set undercloud inventory before it's used in next playbook.
    Fix images update issues and set centos images to newest.
    Set 'libguestfs_mode: false' to avoid running virt-customize
    on initramfs.

    Closes-bug: #1730997

    Change-Id: I46dce77166ecb828d4186b3f2ffa56cf9aa9d31e

Changed in tripleo:
status: In Progress → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to tripleo-quickstart (master)

Reviewed: https://review.openstack.org/518800
Committed: https://git.openstack.org/cgit/openstack/tripleo-quickstart/commit/?id=41986b64c6da266f07e44c2463eca05cf3639525
Submitter: Zuul
Branch: master

commit 41986b64c6da266f07e44c2463eca05cf3639525
Author: Sagi Shnaidman <email address hidden>
Date: Thu Nov 9 23:14:51 2017 +0200

    Don't force injection of repos into image

    Injection of built repos into image will be managed during
    the playbook run.

    Related-Bug: #1730997
    Change-Id: Ie2629643c150037ebebc370e4fc61d6f72569d06

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/tripleo-quickstart-extras 2.1.1

This issue was fixed in the openstack/tripleo-quickstart-extras 2.1.1 release.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.