Error launching RHEL 6 instance

Bug #806289 reported by Sudhir
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack Compute (nova)
New
Undecided
Unassigned

Bug Description

  I am using a setup of a cloud controller with one compute node, able to run ubuntu prepackaged & custom images successfully without any issues. Able to ping & ssh the instance, get euca-get-console-output, while trying to launch custom built RHEL6 image getting following error :

euca-describe-images

IMAGE aki-0000008f buck/vmlinuz-2.6.32-131.0.15.el6.x86_64.manifest.xml available public x86_64 kernel
IMAGE ari-00000090 buck/initramfs-2.6.32-131.0.15.el6.x86_64.img.manifest.xml available public x86_64 ramdisk
IMAGE ami-00000091 buck/hatfinal.img.manifest.xml available public x86_64 machine aki-0000008f ari-00000090

euca-describe-instances

RESERVATION r-l92081x9 proj default
INSTANCE i-000000a7 ami-00000091 192.168.3.3 192.168.3.3 running None (proj, in01emt17) 0 m1.small 2011-07-05T19:06:41Z nova
RESERVATION r-lmgaq69f proj default
INSTANCE i-000000a6 ami-0000008e 192.168.3.4 192.168.3.4 running None (proj, in01emt17) 0 m1.small 2011-07-05T18:12:43Z nova

1. euca-get-console-output i-000000a7
UnknownError: An unknown error has occurred. Please try your request again.

2. Nova-compute.log error :

Red Hat Enterprise Linux Server release 6.1 (Santiago)\r\nKernel 2.6.32-131.0.15.el6.x86_64 on an x86_64\r\n\r\nlocalhost.localdomain login: '
2011-07-06 00:47:47,671 ERROR nova [-] Exception during message handling
(nova): TRACE: Traceback (most recent call last):
(nova): TRACE: File "/usr/lib/pymodules/python2.7/nova/rpc.py", line 190, in _receive
(nova): TRACE: msg_reply(msg_id, rval, None)
(nova): TRACE: File "/usr/lib/pymodules/python2.7/nova/rpc.py", line 296, in msg_reply
(nova): TRACE: publisher.send({'result': reply, 'failure': failure})
(nova): TRACE: File "/usr/lib/pymodules/python2.7/carrot/messaging.py", line 765, in send
(nova): TRACE: serializer=serializer)
(nova): TRACE: File "/usr/lib/pymodules/python2.7/carrot/messaging.py", line 690, in create_message
(nova): TRACE: serializer=serializer)
(nova): TRACE: File "/usr/lib/pymodules/python2.7/carrot/serialization.py", line 144, in encode
(nova): TRACE: payload = encoder(data)
(nova): TRACE: File "/usr/lib/pymodules/python2.7/anyjson/__init__.py", line 123, in <lambda>
(nova): TRACE: serialize = lambda value: implementation.serialize(value)
(nova): TRACE: File "/usr/lib/pymodules/python2.7/anyjson/__init__.py", line 83, in serialize
(nova): TRACE: return self._encode(data)
(nova): TRACE: File "/usr/lib/python2.7/dist-packages/simplejson/__init__.py", line 261, in dumps
(nova): TRACE: return _default_encoder.encode(obj)
(nova): TRACE: File "/usr/lib/python2.7/dist-packages/simplejson/encoder.py", line 214, in encode
(nova): TRACE: chunks = self.iterencode(o, _one_shot=True)
(nova): TRACE: File "/usr/lib/python2.7/dist-packages/simplejson/encoder.py", line 282, in iterencode
(nova): TRACE: return _iterencode(o, 0)
(nova): TRACE: UnicodeDecodeError: 'utf8' codec can't decode byte 0xff in position 10422: invalid start byte
(nova): TRACE:
2011-07-06 00:47:47,672 ERROR nova.rpc [-] Returning exception 'utf8' codec can't decode byte 0xff in position 10422: invalid start byte to caller
2011-07-06 00:47:47,672 ERROR nova.rpc [-] ['Traceback (most recent call last):\n', ' File "/usr/lib/pymodules/python2.7/nova/rpc.py", line 190, in _receive\n msg_reply(msg_id, rval, None)\n', ' File "/usr/lib/pymodules/python2.7/nova/rpc.py", line 296, in msg_reply\n publisher.send({\'result\': reply, \'failure\': failure})\n', ' File "/usr/lib/pymodules/python2.7/carrot/messaging.py", line 765, in send\n serializer=serializer)\n', ' File "/usr/lib/pymodules/python2.7/carrot/messaging.py", line 690, in create_message\n serializer=serializer)\n', ' File "/usr/lib/pymodules/python2.7/carrot/serialization.py", line 144, in encode\n payload = encoder(data)\n', ' File "/usr/lib/pymodules/python2.7/anyjson/__init__.py", line 123, in <lambda>\n serialize = lambda value: implementation.serialize(value)\n', ' File "/usr/lib/pymodules/python2.7/anyjson/__init__.py", line 83, in serialize\n return self._encode(data)\n', ' File "/usr/lib/python2.7/dist-packages/simplejson/__init__.py", line 261, in dumps\n return _default_encoder.encode(obj)\n', ' File "/usr/lib/python2.7/dist-packages/simplejson/encoder.py", line 214, in encode\n chunks = self.iterencode(o, _one_shot=True)\n', ' File "/usr/lib/python2.7/dist-packages/simplejson/encoder.py", line 282, in iterencode\n return _iterencode(o, 0)\n', "UnicodeDecodeError: 'utf8' codec can't decode byte 0xff in position 10422: invalid start byte\n"]

  Any suggestion/help is welcome & appreciated. Please help me fix this issue.

Thanks,
Sudhir

Revision history for this message
Vish Ishaya (vishvananda) wrote : Re: [Bug 806289] [NEW] Error launching RHEL 6 instance
Download full text (9.9 KiB)

This was fixed soon after cactus:

https://bugs.launchpad.net/nova/+bug/758054

On Jul 5, 2011, at 7:46 PM, Sudhir wrote:

> Public bug reported:
>
> I am using a setup of a cloud controller with one compute node, able
> to run ubuntu prepackaged & custom images successfully without any
> issues. Able to ping & ssh the instance, get euca-get-console-output,
> while trying to launch custom built RHEL6 image getting following error
> :
>
> euca-describe-images
>
> IMAGE aki-0000008f buck/vmlinuz-2.6.32-131.0.15.el6.x86_64.manifest.xml available public x86_64 kernel
> IMAGE ari-00000090 buck/initramfs-2.6.32-131.0.15.el6.x86_64.img.manifest.xml available public x86_64 ramdisk
> IMAGE ami-00000091 buck/hatfinal.img.manifest.xml available public x86_64 machine aki-0000008f ari-00000090
>
> euca-describe-instances
>
> RESERVATION r-l92081x9 proj default
> INSTANCE i-000000a7 ami-00000091 192.168.3.3 192.168.3.3 running None (proj, in01emt17) 0 m1.small 2011-07-05T19:06:41Z nova
> RESERVATION r-lmgaq69f proj default
> INSTANCE i-000000a6 ami-0000008e 192.168.3.4 192.168.3.4 running None (proj, in01emt17) 0 m1.small 2011-07-05T18:12:43Z nova
>
> 1. euca-get-console-output i-000000a7
> UnknownError: An unknown error has occurred. Please try your request again.
>
> 2. Nova-compute.log error :
>
> Red Hat Enterprise Linux Server release 6.1 (Santiago)\r\nKernel 2.6.32-131.0.15.el6.x86_64 on an x86_64\r\n\r\nlocalhost.localdomain login: '
> 2011-07-06 00:47:47,671 ERROR nova [-] Exception during message handling
> (nova): TRACE: Traceback (most recent call last):
> (nova): TRACE: File "/usr/lib/pymodules/python2.7/nova/rpc.py", line 190, in _receive
> (nova): TRACE: msg_reply(msg_id, rval, None)
> (nova): TRACE: File "/usr/lib/pymodules/python2.7/nova/rpc.py", line 296, in msg_reply
> (nova): TRACE: publisher.send({'result': reply, 'failure': failure})
> (nova): TRACE: File "/usr/lib/pymodules/python2.7/carrot/messaging.py", line 765, in send
> (nova): TRACE: serializer=serializer)
> (nova): TRACE: File "/usr/lib/pymodules/python2.7/carrot/messaging.py", line 690, in create_message
> (nova): TRACE: serializer=serializer)
> (nova): TRACE: File "/usr/lib/pymodules/python2.7/carrot/serialization.py", line 144, in encode
> (nova): TRACE: payload = encoder(data)
> (nova): TRACE: File "/usr/lib/pymodules/python2.7/anyjson/__init__.py", line 123, in <lambda>
> (nova): TRACE: serialize = lambda value: implementation.serialize(value)
> (nova): TRACE: File "/usr/lib/pymodules/python2.7/anyjson/__init__.py", line 83, in serialize
> (nova): TRACE: return self._encode(data)
> (nova): TRACE: File "/usr/lib/python2.7/dist-packages/simplejson/__init__.py", line 261, in dumps
> (nova): TRACE: return _default_encoder.encode(obj)
> (nova): TRACE: File "/usr/lib/python2.7/dist-packages/simplejson/encoder.py", line 214, in encode
> (nova): TRACE: chunks = self.iterencode(o, _one_shot=True)
> (nova): TRACE: File "/usr/lib/python2.7/dist-packages/simplejson/encoder.py", line 282, in iterencode
> (nova): TRACE: return _iterencode(o, 0)
> (nova): TRACE: UnicodeDecodeError: 'utf8' codec can't decode byte 0xff in position 10422: invalid start byte
> (nova): TRACE:
> 2011-...

Revision history for this message
Sudhir (av-sudhir) wrote :
Download full text (3.5 KiB)

Hi Vish,

 As you pointed out I applied nova.console_enc.diff available on https://bugs.launchpad.net/nova/+bug/758054, but the issue was not fixed. Still getting the same error :

2011-07-08 16:36:38,939 ERROR nova [-] Exception during message handling
(nova): TRACE: Traceback (most recent call last):
(nova): TRACE: File "/usr/lib/pymodules/python2.7/nova/rpc.py", line 190, in _receive
(nova): TRACE: msg_reply(msg_id, rval, None)
(nova): TRACE: File "/usr/lib/pymodules/python2.7/nova/rpc.py", line 296, in msg_reply
(nova): TRACE: publisher.send({'result': reply, 'failure': failure})
(nova): TRACE: File "/usr/lib/pymodules/python2.7/carrot/messaging.py", line 765, in send
(nova): TRACE: serializer=serializer)
(nova): TRACE: File "/usr/lib/pymodules/python2.7/carrot/messaging.py", line 690, in create_message
(nova): TRACE: serializer=serializer)
(nova): TRACE: File "/usr/lib/pymodules/python2.7/carrot/serialization.py", line 144, in encode
(nova): TRACE: payload = encoder(data)
(nova): TRACE: File "/usr/lib/pymodules/python2.7/anyjson/__init__.py", line 123, in <lambda>
(nova): TRACE: serialize = lambda value: implementation.serialize(value)
(nova): TRACE: File "/usr/lib/pymodules/python2.7/anyjson/__init__.py", line 83, in serialize
(nova): TRACE: return self._encode(data)
(nova): TRACE: File "/usr/lib/python2.7/dist-packages/simplejson/__init__.py", line 261, in dumps
(nova): TRACE: return _default_encoder.encode(obj)
(nova): TRACE: File "/usr/lib/python2.7/dist-packages/simplejson/encoder.py", line 214, in encode
(nova): TRACE: chunks = self.iterencode(o, _one_shot=True)
(nova): TRACE: File "/usr/lib/python2.7/dist-packages/simplejson/encoder.py", line 282, in iterencode
(nova): TRACE: return _iterencode(o, 0)
(nova): TRACE: UnicodeDecodeError: 'utf8' codec can't decode byte 0xff in position 10422: invalid start byte
(nova): TRACE:
2011-07-08 16:36:38,940 ERROR nova.rpc [-] Returning exception 'utf8' codec can't decode byte 0xff in position 10422: invalid start byte to caller
2011-07-08 16:36:38,941 ERROR nova.rpc [-] ['Traceback (most recent call last):\n', ' File "/usr/lib/pymodules/python2.7/nova/rpc.py", line 190, in _receive\n msg_reply(msg_id, rval, None)\n', ' File "/usr/lib/pymodules/python2.7/nova/rpc.py", line 296, in msg_reply\n publisher.send({\'result\': reply, \'failure\': failure})\n', ' File "/usr/lib/pymodules/python2.7/carrot/messaging.py", line 765, in send\n serializer=serializer)\n', ' File "/usr/lib/pymodules/python2.7/carrot/messaging.py", line 690, in create_message\n serializer=serializer)\n', ' File "/usr/lib/pymodules/python2.7/carrot/serialization.py", line 144, in encode\n payload = encoder(data)\n', ' File "/usr/lib/pymodules/python2.7/anyjson/__init__.py", line 123, in <lambda>\n serialize = lambda value: implementation.serialize(value)\n', ' File "/usr/lib/pymodules/python2.7/anyjson/__init__.py", line 83, in serialize\n return self._encode(data)\n', ' File "/usr/lib/python2.7/dist-packages/simplejson/__init__.py", line 261, in dumps\n return _default_encoder.encode(obj)\n', ' File "/usr/lib/python2.7/dist-packages/s...

Read more...

Revision history for this message
Vish Ishaya (vishvananda) wrote : Re: [Bug 806289] Re: Error launching RHEL 6 instance
Download full text (9.0 KiB)

The diff that actually made it into trunk is here:

https://code.launchpad.net/~yorik-sar/nova/lp758054/+merge/59344/+preview-diff/+files/preview.diff

It should be as simple as adding that to your compute hosts and restarting nova-compute

Vish

On Jul 8, 2011, at 4:11 AM, Sudhir wrote:

> *** This bug is a duplicate of bug 758054 ***
> https://bugs.launchpad.net/bugs/758054
>
> Hi Vish,
>
> As you pointed out I applied nova.console_enc.diff available on
> https://bugs.launchpad.net/nova/+bug/758054, but the issue was not
> fixed. Still getting the same error :
>
> 2011-07-08 16:36:38,939 ERROR nova [-] Exception during message handling
> (nova): TRACE: Traceback (most recent call last):
> (nova): TRACE: File "/usr/lib/pymodules/python2.7/nova/rpc.py", line 190, in _receive
> (nova): TRACE: msg_reply(msg_id, rval, None)
> (nova): TRACE: File "/usr/lib/pymodules/python2.7/nova/rpc.py", line 296, in msg_reply
> (nova): TRACE: publisher.send({'result': reply, 'failure': failure})
> (nova): TRACE: File "/usr/lib/pymodules/python2.7/carrot/messaging.py", line 765, in send
> (nova): TRACE: serializer=serializer)
> (nova): TRACE: File "/usr/lib/pymodules/python2.7/carrot/messaging.py", line 690, in create_message
> (nova): TRACE: serializer=serializer)
> (nova): TRACE: File "/usr/lib/pymodules/python2.7/carrot/serialization.py", line 144, in encode
> (nova): TRACE: payload = encoder(data)
> (nova): TRACE: File "/usr/lib/pymodules/python2.7/anyjson/__init__.py", line 123, in <lambda>
> (nova): TRACE: serialize = lambda value: implementation.serialize(value)
> (nova): TRACE: File "/usr/lib/pymodules/python2.7/anyjson/__init__.py", line 83, in serialize
> (nova): TRACE: return self._encode(data)
> (nova): TRACE: File "/usr/lib/python2.7/dist-packages/simplejson/__init__.py", line 261, in dumps
> (nova): TRACE: return _default_encoder.encode(obj)
> (nova): TRACE: File "/usr/lib/python2.7/dist-packages/simplejson/encoder.py", line 214, in encode
> (nova): TRACE: chunks = self.iterencode(o, _one_shot=True)
> (nova): TRACE: File "/usr/lib/python2.7/dist-packages/simplejson/encoder.py", line 282, in iterencode
> (nova): TRACE: return _iterencode(o, 0)
> (nova): TRACE: UnicodeDecodeError: 'utf8' codec can't decode byte 0xff in position 10422: invalid start byte
> (nova): TRACE:
> 2011-07-08 16:36:38,940 ERROR nova.rpc [-] Returning exception 'utf8' codec can't decode byte 0xff in position 10422: invalid start byte to caller
> 2011-07-08 16:36:38,941 ERROR nova.rpc [-] ['Traceback (most recent call last):\n', ' File "/usr/lib/pymodules/python2.7/nova/rpc.py", line 190, in _receive\n msg_reply(msg_id, rval, None)\n', ' File "/usr/lib/pymodules/python2.7/nova/rpc.py", line 296, in msg_reply\n publisher.send({\'result\': reply, \'failure\': failure})\n', ' File "/usr/lib/pymodules/python2.7/carrot/messaging.py", line 765, in send\n serializer=serializer)\n', ' File "/usr/lib/pymodules/python2.7/carrot/messaging.py", line 690, in create_message\n serializer=serializer)\n', ' File "/usr/lib/pymodules/python2.7/carrot/serialization.py", line 144, in encode\n payload = encoder(da...

Read more...

Revision history for this message
Sudhir (av-sudhir) wrote :

Hi Vish,

  The patch you suggested fixed the utf-8 error. Thanks for the help.

Regards,
Sudhir

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.