nova-api will not run (upgraded install)

Looks like the ppa paste config needs to be updated. I guess it is shipping its own?

On Feb 1, 2012, at 8:28 PM, Paul Pettigrew wrote:

> Public bug reported:
>
> Hi all
>
> I have been running without issue using PPA application of nova trunk code (installed ~4 days ago), per:
> # add-apt-repository ppa:nova-core/trunk
>
> But since an update applied ~20hours ago, despite severl updates from
> PPA, I have not been able to NOT get the below issue which is
> reproducable 100% per:
>
> root@server:~# service nova-api start
> nova-api start/running, process 27370
>
>
> root@server:~# cat /var/log/nova/nova-api.log
> .
> .
> 2012-02-02 14:24:12,222 DEBUG nova.utils [-] Inner Exception: No module named admin from (pid=27371) import_class /usr/lib/python2.7/dist-packages/nova/utils.py:66
> 2012-02-02 14:24:12,223 CRITICAL nova [-] Class AdminController could not be found: No module named admin
> (nova): TRACE: Traceback (most recent call last):
> (nova): TRACE: File "/usr/bin/nova-api", line 51, in <module>
> (nova): TRACE: servers.append(service.WSGIService(api))
> (nova): TRACE: File "/usr/lib/python2.7/dist-packages/nova/service.py", line 328, in __init__
> (nova): TRACE: self.app = self.loader.load_app(name)
> (nova): TRACE: File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 388, in load_app
> (nova): TRACE: return deploy.loadapp("config:%s" % self.config_path, name=name)
> (nova): TRACE: File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
> (nova): TRACE: return loadobj(APP, uri, name=name, **kw)
> (nova): TRACE: File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 272, in loadobj
> (nova): TRACE: return context.create()
> (nova): TRACE: File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 710, in create
> (nova): TRACE: return self.object_type.invoke(self)
> (nova): TRACE: File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 144, in invoke
> (nova): TRACE: **context.local_conf)
> (nova): TRACE: File "/usr/lib/python2.7/dist-packages/paste/deploy/util.py", line 56, in fix_call
> (nova): TRACE: val = callable(*args, **kw)
> (nova): TRACE: File "/usr/lib/python2.7/dist-packages/paste/urlmap.py", line 25, in urlmap_factory
> (nova): TRACE: app = loader.get_app(app_name, global_conf=global_conf)
> (nova): TRACE: File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 350, in get_app
> (nova): TRACE: name=name, global_conf=global_conf).create()
> (nova): TRACE: File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 710, in create
> (nova): TRACE: return self.object_type.invoke(self)
> (nova): TRACE: File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 207, in invoke
> (nova): TRACE: app = filter(app)
> (nova): TRACE: File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 244, in _factory
> (nova): TRACE: return cls(app, **local_config)
> (nova): TRACE: File "/usr/lib/python2.7/dist-packages/nova/api/ec2/__init__.py", line 303, in __init__
> (nova): TRACE: self.controller = utils.import_class(controller)()
> (no...

G'day all

I located the cause (thanks to Vish's pointer in the right direction, that this was api paste related).

Turns out that the single line:
  /services/Admin: ec2admin

That was removed from the [composite:ec2] stanza within Nova's api-paste.ini file during commit 638ea66969 caused nova-api to not run per the initial bug report below.

The fix was to simply remove the "/services/Admin: ec2admin" line and restart the nova-api service, voila - Nova is running again :-)

I hope this information helps others.

Cheers

Paul

-----Original Message-----
From: <email address hidden> [mailto:<email address hidden>] On Behalf Of Vish Ishaya
Sent: Thursday, 2 February 2012 5:40 PM
To: Paul Pettigrew
Subject: Re: [Bug 925278] [NEW] nova-api will not run (some change in trunk PPA over past 48hrs)

Looks like the ppa paste config needs to be updated. I guess it is shipping its own?

On Feb 1, 2012, at 8:28 PM, Paul Pettigrew wrote:

-----Original Message-----
From: <email address hidden> [mailto:<email address hidden>] On Behalf Of Dave Walker
Sent: Thursday, 2 February 2012 8:03 PM
To: Paul Pettigrew
Subject: [Bug 925278] Re: nova-api will not run (some change in trunk PPA over past 48hrs)

** Also affects: nova (Ubuntu)
   Importance: Undecided
       Status: New

** Changed in: nova (Ubuntu)
   Importance: Undecided => High

--
You received this bug notification because you are subscribed to the bug report.
https://bugs.launchpad.net/bugs/925278

Title:
  nova-api will not run (some change in trunk PPA over past 48hrs)

Status in OpenStack PPAs:
  Confirmed
Status in “nova” package in Ubuntu:
  New

Bug description:
  Hi all

  I have been running without issue using PPA application of nova trunk code (installed ~4 days ago), per:
  # add-apt-repository ppa:nova-core/trunk

  But since an update applied ~20hours ago, despite severl updates from
  PPA, I have not been able to NOT get the below issue which is
  reproducable 100% per:

  root@server:~# service nova-api start
  nova-api start/running, process 27370

  root@server:~# cat /var/log/nova/nova-api.log
  .
  .
  2012-02-02 14:24:12,222 DEBUG nova.utils [-] Inner Exception: No module named admin from (pid=27371) import_class /usr/lib/python2.7/dist-packages/nova/utils.py:66
  2012-02-02 14:24:12,223 CRITICAL nova [-] Class AdminController could not be found: No module named admin
  (nova): TRACE: Traceback (most recent call last):
  (nova): TRACE: File "/usr/bin/nova-api", line 51, in <module>
  (nova): TRACE: servers.append(service.WSGIService(api))
  (nova): TRACE: File "/usr/lib/python2.7/dist-packages/nova/service.py", line 328, in __init__
  (nova): TRACE: self.app = self.loader.load_app(name)
  (nova): TRACE: File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 388, in load_app
  (nova): TRACE: return deploy.loadapp("config:%s" % self.config_path, name=name)
  (nova): TRACE: File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
  (nova): TRACE: return loadobj(APP, uri, name=name, **kw)
  (nova): TRACE: File "/usr/lib/python2.7/dist-pa...

Looks like an update issue to me: the contents of the file is correct on a new install. The file in /etc was modified, so the upgrade probably prompted you about the changes in the conffile ?

G'day Thierry, no there was no prompt when the upgrade was applied.
Cheers, Paul

The PPA is unmaintained, please reopen the bug if you can reproduce on official Ubuntu packages.