node install error Unexpected error command: ['curtin', 'block-meta', 'simple']

Worked with Danny, attaching latest sosreport from this MAAS server.

Hi David,

Followed your procedure and were able to login to failed node and collected all needed logs. Also I'm leaving this system into this stage, if you or someone else like to take a look will be good.

Failed deployment logs before running your procedure:

before-pod-cloud-installer-debug-2015-1215-174421.log
before-sosreport-Bootstrap-POD2-20151215184400.tar.xz

Failed deployment logs after running your procedure:

after-pod-cloud-installer-debug-2015-1215-190750.log
after-sosreport-Bootstrap-POD2-20151215193619.tar.xz
log-files.tar.gz

Please let us know if need any further info.

Thanks, Arun

/var/lib is missing from the log file bundle on the openstack node, could you please upload that?

Please check this one.

fix committed in revno 322.

Hi David,
1) Will this curtin fix below (curtin to recognize internal / embedded
drives) make it to Installer v0.16?

2) Will Installer v0.16 includes latest VPP code for VMS 2.x? Will the
VPP compiled on Haswell UCS?

I am ccing Wojciech and Dave for the 2nd question above.

Regards,
Cliff P

On 12/17/15, 9:03 AM, "Scott Moser" <email address hidden> wrote:

>fix committed in revno 322.
>
>
>** Changed in: curtin
> Importance: Undecided => Medium
>
>** Changed in: curtin
> Status: Confirmed => Fix Committed
>
>** Also affects: curtin (Ubuntu)
> Importance: Undecided
> Status: New
>
>** Changed in: curtin (Ubuntu)
> Status: New => Confirmed
>
>** Changed in: curtin (Ubuntu)
> Importance: Undecided => Medium
>
>--
>You received this bug notification because you are subscribed to the bug
>report.
>https://bugs.launchpad.net/bugs/1526127
>
>Title:
> node install error Unexpected error command: ['curtin', 'block-meta',
> 'simple']
>
>Status in curtin:
> Fix Committed
>Status in curtin package in Ubuntu:
> Confirmed
>
>Bug description:
> From the MAAS Gui, the logfile states the following:
>
> 'utf8' codec can't decode byte 0x80 in position 1799: invalid start byte
> Installation failed with exception: Unexpected error while running
>command.
> Command: ['curtin', 'block-meta', 'simple']
> Exit code: 3
> Reason: -
> Stdout: "'utf8' codec can't decode byte 0x80 in position 1799: invalid
>start byte\n"
> Stderr: ''
>
> After proceeding further with the following debugging commands:
>
>
> /var/lib/cloud/instance/scripts/part-001 info
> sudo su -
> cd /curtin
> bin/curtin -vv <long command returned by part-001 info>
>
> We found the lsblk command was returning things that curtin does not
> like. Curtin should probably be more flexible and not choke on a UUID
> field that contains garbage
>
>To manage notifications about this bug go to:
>https://bugs.launchpad.net/curtin/+bug/1526127/+subscriptions

Hi David,
How are you? I am following up on this email thread.

Is you know the answer to the two questions, pls let us know.

Thank you,
Cliff P

On 12/18/15, 2:52 PM, "Cliff Pangtono (wpangton)" <email address hidden>
wrote:

>Hi David,
>1) Will the curtin fix for https://bugs.launchpad.net/bugs/1526127
>(curtin to recognize internal / embedded
>drives) make it to Installer v0.16?
>
>2) Will Installer v0.16 includes latest VPP code for VMS 2.x? Will the
>VPP compiled on Haswell UCS?
>
>I am ccing Wojciech and Dave for the 2nd question above.
>
>Regards,
>Cliff P
>
>
>On 12/17/15, 9:03 AM, "Scott Moser" <email address hidden> wrote:
>
>>fix committed in revno 322.
>>
>>
>>** Changed in: curtin
>> Importance: Undecided => Medium
>>
>>** Changed in: curtin
>> Status: Confirmed => Fix Committed
>>
>>** Also affects: curtin (Ubuntu)
>> Importance: Undecided
>> Status: New
>>
>>** Changed in: curtin (Ubuntu)
>> Status: New => Confirmed
>>
>>** Changed in: curtin (Ubuntu)
>> Importance: Undecided => Medium
>>
>>--
>>You received this bug notification because you are subscribed to the bug
>>report.
>>https://bugs.launchpad.net/bugs/1526127
>>
>>Title:
>> node install error Unexpected error command: ['curtin', 'block-meta',
>> 'simple']
>>
>>Status in curtin:
>> Fix Committed
>>Status in curtin package in Ubuntu:
>> Confirmed
>>
>>Bug description:
>> From the MAAS Gui, the logfile states the following:
>>
>> 'utf8' codec can't decode byte 0x80 in position 1799: invalid start
>>byte
>> Installation failed with exception: Unexpected error while running
>>command.
>> Command: ['curtin', 'block-meta', 'simple']
>> Exit code: 3
>> Reason: -
>> Stdout: "'utf8' codec can't decode byte 0x80 in position 1799: invalid
>>start byte\n"
>> Stderr: ''
>>
>> After proceeding further with the following debugging commands:
>>
>>
>> /var/lib/cloud/instance/scripts/part-001 info
>> sudo su -
>> cd /curtin
>> bin/curtin -vv <long command returned by part-001 info>
>>
>> We found the lsblk command was returning things that curtin does not
>> like. Curtin should probably be more flexible and not choke on a UUID
>> field that contains garbage
>>
>>To manage notifications about this bug go to:
>>https://bugs.launchpad.net/curtin/+bug/1526127/+subscriptions
>

This bug was fixed in the package curtin - 0.1.0~bzr351-0ubuntu1

---------------
curtin (0.1.0~bzr351-0ubuntu1) xenial; urgency=medium

  * New upstream snapshot.
    * partitioning: limited support for odd ordering of partition
      numbers (LP: #1543263). Specifically targetted at MAAS and
      powerVM support.
    * many upstream test improvements (LP: #1533770)
    * general upstream code improvements
    * use mkfs.vfat rather than mkfs.fat to support precise.
    * use removable devices for installation if no non-removable devices are
      found [Robert Clark] (LP: #1532062)
    * mkfs: fix for lack of uuid in btrfs tools on precise or trusty
    * added 'curtin mkfs' command for easily making filesystems.
    * mdadm: fix issues exposed by use via block_meta (LP: #1531520)
    * improvements and small bug fix for oauth on systems with bad clock
    * support bcache installation on precise
    * fix bug in install_grub to partition when storage_config
      provided. (LP: #1523779)
    * url_helper: raise import error on lack of oauth only when oauth used
    * block_meta: handle 'preserve' flag for raid devices (LP: #1522147)
    * close file descriptors from --config= arguments
    * xenial: disable update-motd during an apt-get update (LP: #1527710)
    * curthooks: know kernel mapping for xenial (4.4.0)
    * fix python executable selection when 'curtin --help' is called
    * subp: add decode parameter, defaulting to replace (LP: #1526127)
    * support passing an integer or valid float to human2bytes
    * Use /proc/mounts to find missing mountpoints

 -- Scott Moser <email address hidden> Fri, 12 Feb 2016 17:07:33 -0500

This bug is believed to be fixed in curtin in 17.1. If this is still a problem for you, please make a comment and set the state back to New

Thank you.