Juju Charms Collection
nova-compute package

In cloud-compute-relation-changed: SystemError: E:Problem renaming the file /var/cache/apt/srcpkgcache.bin.QeVQku to /var/cache/apt/srcpkgcache.bin

Bug #1354471 reported by Björn Tillenius
16
This bug affects 3 people
Affects Status Importance Assigned to Milestone
nova-compute (Juju Charms Collection)
Fix Released
High
Liam Young

Bug Description

I got the following error when deploying a cloud:

2014-08-08 14:06:28 INFO cloud-compute-relation-changed File "/var/lib/juju/agents/unit-nova-compute-2/charm/hooks/charmhelpers/contrib/openstack/context.py", line 353, in __call__
2014-08-08 14:06:28 INFO cloud-compute-relation-changed ensure_packages(['ceph-common'])
2014-08-08 14:06:28 INFO cloud-compute-relation-changed File "/var/lib/juju/agents/unit-nova-compute-2/charm/hooks/charmhelpers/contrib/openstack/context.py", line 54, in ensure_packages
2014-08-08 14:06:28 INFO cloud-compute-relation-changed required = filter_installed_packages(packages)
2014-08-08 14:06:28 INFO cloud-compute-relation-changed File "/var/lib/juju/agents/unit-nova-compute-2/charm/hooks/charmhelpers/fetch/__init__.py", line 117, in filter_installed_packages
2014-08-08 14:06:28 INFO cloud-compute-relation-changed cache = apt_pkg.Cache()
2014-08-08 14:06:28 INFO cloud-compute-relation-changed SystemError: E:Problem renaming the file /var/cache/apt/srcpkgcache.bin.QeVQku to /var/cache/apt/srcpkgcache.bin - rename (2: No such file or directory), E:The package lists or status file could not be parsed or opened.
2014-08-08 14:06:28 ERROR juju.worker.uniter uniter.go:486 hook failed: exit status 1

This is cs:trusty/nova-compute-3. Looking the fetch/__init__.py, it has code to build the
cache in memory, but it seems like it's not working as intended.

See original description

Related branches

lp:~gnuoy/charms/trusty/nova-compute/stable-charm-sync
Chris Glass (community): Approve
Diff: 311 lines (+165/-13)
8 files modified
.bzrignore (+2/-0)
Makefile (+7/-2)
hooks/charmhelpers/contrib/openstack/context.py (+9/-4)
hooks/charmhelpers/contrib/storage/linux/utils.py (+4/-0)
hooks/charmhelpers/core/fstab.py (+116/-0)
hooks/charmhelpers/core/host.py (+24/-6)
hooks/charmhelpers/fetch/__init__.py (+1/-0)
hooks/charmhelpers/fetch/bzrurl.py (+2/-1)
lp:~gnuoy/charm-helpers/stable-central-apt-cache-function
Corey Bryant (community): Approve
OpenStack Charmers: Pending requested
Diff: 84 lines (+16/-22)
3 files modified
charmhelpers/contrib/openstack/utils.py (+3/-8)
charmhelpers/core/host.py (+2/-6)
charmhelpers/fetch/__init__.py (+11/-8)
lp:~gnuoy/charms/trusty/ceilometer/stable-charm-sync
charmers: Pending requested
Diff: 844 lines (+430/-94)
13 files modified
.bzrignore (+2/-0)
Makefile (+8/-2)
charm-helpers.yaml (+1/-1)
hooks/charmhelpers/contrib/openstack/context.py (+10/-5)
hooks/charmhelpers/contrib/openstack/neutron.py (+17/-1)
hooks/charmhelpers/contrib/openstack/utils.py (+6/-4)
hooks/charmhelpers/contrib/storage/linux/lvm.py (+1/-1)
hooks/charmhelpers/contrib/storage/linux/utils.py (+32/-5)
hooks/charmhelpers/core/fstab.py (+116/-0)
hooks/charmhelpers/core/hookenv.py (+98/-1)
hooks/charmhelpers/core/host.py (+34/-6)
hooks/charmhelpers/fetch/__init__.py (+103/-67)
hooks/charmhelpers/fetch/bzrurl.py (+2/-1)
lp:~gnuoy/charms/trusty/ceilometer-agent/stable-charm-sync
Chris Glass (community): Approve
charmers: Pending requested
Diff: 843 lines (+430/-94)
13 files modified
.bzrignore (+2/-0)
Makefile (+8/-2)
charm-helpers.yaml (+1/-1)
hooks/charmhelpers/contrib/openstack/context.py (+10/-5)
hooks/charmhelpers/contrib/openstack/neutron.py (+17/-1)
hooks/charmhelpers/contrib/openstack/utils.py (+6/-4)
hooks/charmhelpers/contrib/storage/linux/lvm.py (+1/-1)
hooks/charmhelpers/contrib/storage/linux/utils.py (+32/-5)
hooks/charmhelpers/core/fstab.py (+116/-0)
hooks/charmhelpers/core/hookenv.py (+98/-1)
hooks/charmhelpers/core/host.py (+34/-6)
hooks/charmhelpers/fetch/__init__.py (+103/-67)
hooks/charmhelpers/fetch/bzrurl.py (+2/-1)
lp:~gnuoy/charms/trusty/cinder-ceph/stable-charm-sync
charmers: Pending requested
Diff: 855 lines (+434/-94)
13 files modified
.bzrignore (+2/-0)
Makefile (+7/-2)
charm-helpers.yaml (+1/-1)
hooks/charmhelpers/contrib/openstack/context.py (+14/-5)
hooks/charmhelpers/contrib/openstack/neutron.py (+17/-1)
hooks/charmhelpers/contrib/openstack/utils.py (+7/-4)
hooks/charmhelpers/contrib/storage/linux/lvm.py (+1/-1)
hooks/charmhelpers/contrib/storage/linux/utils.py (+32/-5)
hooks/charmhelpers/core/fstab.py (+116/-0)
hooks/charmhelpers/core/hookenv.py (+98/-1)
hooks/charmhelpers/core/host.py (+34/-6)
hooks/charmhelpers/fetch/__init__.py (+103/-67)
hooks/charmhelpers/fetch/bzrurl.py (+2/-1)
lp:~gnuoy/charms/trusty/heat/stable-charm-sync
Chris Glass (community): Approve
charmers: Pending requested
Diff: 845 lines (+430/-94)
13 files modified
.bzrignore (+2/-0)
Makefile (+8/-2)
charm-helpers.yaml (+1/-1)
hooks/charmhelpers/contrib/openstack/context.py (+10/-5)
hooks/charmhelpers/contrib/openstack/neutron.py (+17/-1)
hooks/charmhelpers/contrib/openstack/utils.py (+6/-4)
hooks/charmhelpers/contrib/storage/linux/lvm.py (+1/-1)
hooks/charmhelpers/contrib/storage/linux/utils.py (+32/-5)
hooks/charmhelpers/core/fstab.py (+116/-0)
hooks/charmhelpers/core/hookenv.py (+98/-1)
hooks/charmhelpers/core/host.py (+34/-6)
hooks/charmhelpers/fetch/__init__.py (+103/-67)
hooks/charmhelpers/fetch/bzrurl.py (+2/-1)
lp:~gnuoy/charms/trusty/cinder/stable-charmhelper-sync
Chris Glass (community): Approve
Diff: 84 lines (+16/-22)
3 files modified
hooks/charmhelpers/contrib/openstack/utils.py (+3/-8)
hooks/charmhelpers/core/host.py (+2/-6)
hooks/charmhelpers/fetch/__init__.py (+11/-8)
lp:~gnuoy/charms/trusty/glance/stable-charmhelper-sync
Chris Glass (community): Approve
Diff: 84 lines (+16/-22)
3 files modified
hooks/charmhelpers/contrib/openstack/utils.py (+3/-8)
hooks/charmhelpers/core/host.py (+2/-6)
hooks/charmhelpers/fetch/__init__.py (+11/-8)
lp:~gnuoy/charms/trusty/keystone/stable-charmhelper-sync
Chris Glass (community): Approve
Diff: 84 lines (+16/-22)
3 files modified
hooks/charmhelpers/contrib/openstack/utils.py (+3/-8)
hooks/charmhelpers/core/host.py (+2/-6)
hooks/charmhelpers/fetch/__init__.py (+11/-8)
lp:~gnuoy/charms/trusty/nova-cloud-controller/stable-charmhelper-sync
Chris Glass (community): Approve
Diff: 84 lines (+16/-22)
3 files modified
hooks/charmhelpers/contrib/openstack/utils.py (+3/-8)
hooks/charmhelpers/core/host.py (+2/-6)
hooks/charmhelpers/fetch/__init__.py (+11/-8)
lp:~gnuoy/charms/trusty/nova-compute/stable-charmhelper-sync
Chris Glass (community): Approve
Diff: 84 lines (+16/-22)
3 files modified
hooks/charmhelpers/contrib/openstack/utils.py (+3/-8)
hooks/charmhelpers/core/host.py (+2/-6)
hooks/charmhelpers/fetch/__init__.py (+11/-8)
lp:~gnuoy/charms/trusty/openstack-dashboard/stable-charmhelper-sync
Chris Glass (community): Approve
Diff: 84 lines (+16/-22)
3 files modified
hooks/charmhelpers/contrib/openstack/utils.py (+3/-8)
hooks/charmhelpers/core/host.py (+2/-6)
hooks/charmhelpers/fetch/__init__.py (+11/-8)
lp:~gnuoy/charms/trusty/quantum-gateway/stable-charmhelper-sync
Chris Glass (community): Approve
Diff: 84 lines (+16/-22)
3 files modified
hooks/charmhelpers/contrib/openstack/utils.py (+3/-8)
hooks/charmhelpers/core/host.py (+2/-6)
hooks/charmhelpers/fetch/__init__.py (+11/-8)
lp:~gnuoy/charms/trusty/swift-proxy/stable-charmhelper-sync
Chris Glass (community): Approve
Diff: 84 lines (+16/-22)
3 files modified
hooks/charmhelpers/contrib/openstack/utils.py (+3/-8)
hooks/charmhelpers/core/host.py (+2/-6)
hooks/charmhelpers/fetch/__init__.py (+11/-8)
lp:~gnuoy/charms/trusty/swift-storage/stable-charmhelper-sync
Chris Glass (community): Approve
Diff: 84 lines (+16/-22)
3 files modified
hooks/charmhelpers/contrib/openstack/utils.py (+3/-8)
hooks/charmhelpers/core/host.py (+2/-6)
hooks/charmhelpers/fetch/__init__.py (+11/-8)
lp:~gnuoy/charms/trusty/ceph-radosgw/next-charmhelper-sync
Chris Glass (community): Approve
Diff: 934 lines (+672/-38)
11 files modified
.bzrignore (+1/-0)
Makefile (+8/-2)
hooks/charmhelpers/contrib/storage/linux/utils.py (+3/-0)
hooks/charmhelpers/core/hookenv.py (+41/-16)
hooks/charmhelpers/core/host.py (+36/-7)
hooks/charmhelpers/core/services/__init__.py (+2/-0)
hooks/charmhelpers/core/services/base.py (+313/-0)
hooks/charmhelpers/core/services/helpers.py (+125/-0)
hooks/charmhelpers/core/templating.py (+51/-0)
hooks/charmhelpers/fetch/__init__.py (+51/-12)
hooks/charmhelpers/fetch/archiveurl.py (+41/-1)
lp:~tribaal/charms/trusty/ceph-radosgw/resync-stable-charm-helpers
Liam Young (community): Approve
Diff: 107 lines (+26/-15)
5 files modified
.bzrignore (+1/-0)
Makefile (+8/-2)
hooks/charmhelpers/contrib/storage/linux/utils.py (+4/-0)
hooks/charmhelpers/core/host.py (+2/-6)
hooks/charmhelpers/fetch/__init__.py (+11/-7)
lp:~openstack-charmers-archive/charms/trusty/ceph/next
lp:~openstack-charmers-archive/charms/trusty/ceph-osd/next
lp:~gnuoy/charms/trusty/ceph/stable-charmhelper-sync
David Britton (community): Approve
Chris Glass (community): Approve
Diff: 212 lines (+35/-37)
8 files modified
.bzrignore (+1/-0)
Makefile (+8/-2)
hooks/ceph.py (+4/-18)
hooks/charmhelpers/contrib/storage/linux/utils.py (+4/-0)
hooks/charmhelpers/core/host.py (+2/-6)
hooks/charmhelpers/fetch/__init__.py (+11/-7)
hooks/hooks.py (+4/-3)
templates/ceph.conf (+1/-1)
lp:~gnuoy/charms/trusty/ceph-osd/stable-charmhelper-sync
David Britton (community): Approve
Chris Glass (community): Approve
Diff: 213 lines (+35/-37)
8 files modified
.bzrignore (+1/-0)
Makefile (+8/-2)
hooks/ceph.py (+4/-18)
hooks/charmhelpers/contrib/storage/linux/utils.py (+4/-0)
hooks/charmhelpers/core/host.py (+2/-6)
hooks/charmhelpers/fetch/__init__.py (+11/-7)
hooks/hooks.py (+4/-3)
templates/ceph.conf (+1/-1)
lp:~gnuoy/charms/trusty/ceph-radosgw/stable-pkgrevno-from-charmhelpers
Chris Glass (community): Approve
Diff: 77 lines (+5/-19)
3 files modified
hooks/ceph.py (+0/-15)
hooks/hooks.py (+4/-3)
templates/ceph.conf (+1/-1)
Björn Tillenius (bjornt)
tags: added: cloud-installer landscape
Liam Young (gnuoy)
Changed in nova-compute (Juju Charms Collection):
assignee: nobody → Liam Young (gnuoy)
Liam Young (gnuoy)
Changed in nova-compute (Juju Charms Collection):
importance: Undecided → High
Revision history for this message
Liam Young (gnuoy) wrote :

I wasn't able to reproduce it but I think the likely cause is that filter_installed_packages builds the package cache in memory but the src package cache on disk. I have a mp to charm helpers to fix this

Chris Glass (tribaal)
Changed in nova-compute (Juju Charms Collection):
status: New → In Progress
Revision history for this message
Liam Young (gnuoy) wrote :

As tribaal pointed out there were other functions in charmhelpers which suffered from this bug so I've updated charmhelpers and created mps which contain the latest update.

Revision history for this message
James Page (james-page) wrote :

All branches are now landed into stable.

Changed in nova-compute (Juju Charms Collection):
status: In Progress → Fix Released
Revision history for this message
Chad Smith (chad.smith) wrote :

It seems we also have an omission here. I just hit this issue with ceph-radosgw today. It still uses apt.Cache() directly instead of using charmhelpers for this.

Revision history for this message
Liam Young (gnuoy) wrote :

Agreed, ceph-radosgw was missed. I'll get that updated

David Britton (dpb)
description: updated
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.