lxc-start-ephemeral stops working with kernel 3.18 - overlayfs change?

Bug #1409425 reported by Martin Pitt
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
linux (Ubuntu)
Invalid
High
Unassigned
lxc (Ubuntu)
Fix Released
High
Unassigned

Bug Description

With the previous vivid kernel 3.16.0-28-generic,"lxc-start-ephemeral -o containername" works fine. With the current 3.18.0-8-generic it fails with "the container failed to start". This is reproducible in a clean cloud VM:

$ sudo apt install lxc
$ sudo lxc-create -t busybox -n c1

# works fine under all kernels:
$ sudo lxc-start -n c1 -F

$ sudo lxc-start-ephemeral -o c1
The container 'c1-0twqb553' failed to start.

It happens with both the above busybox as well as with a full ubuntu OS container, so I don't think that's relevant.

Unfortunately lxc-start-ephemeral has no --logfile or --logpriority or similar debugging tools, and even with -k it doesn't keep a container or logs around for inspection.

dmesg might have something worth noting, look at the third line:

[ 465.694541] device vethQLD78J entered promiscuous mode
[ 465.694611] IPv6: ADDRCONF(NETDEV_UP): vethQLD78J: link is not ready
[ 465.726758] overlayfs: missing upperdir or lowerdir or workdir
[ 465.744501] eth0: renamed from vethWRSY7B
[ 465.745673] IPv6: ADDRCONF(NETDEV_CHANGE): vethQLD78J: link becomes ready
[ 465.745693] lxcbr0: port 1(vethQLD78J) entered forwarding state
[ 465.745697] lxcbr0: port 1(vethQLD78J) entered forwarding state
[ 465.746618] lxcbr0: port 1(vethQLD78J) entered disabled state
[ 465.747134] device vethQLD78J left promiscuous mode
[ 465.747140] lxcbr0: port 1(vethQLD78J) entered disabled state

So maybe overlayfs changed its semantics somehow in the new kernel?

ProblemType: Bug
DistroRelease: Ubuntu 15.04
Package: lxc 1.1.0~alpha3-0ubuntu1
ProcVersionSignature: Ubuntu 3.16.0-28.38-generic 3.16.7-ckt1
Uname: Linux 3.16.0-28-generic x86_64
ApportVersion: 2.15.1-0ubuntu2
Architecture: amd64
CurrentDesktop: Unity
Date: Sun Jan 11 12:45:06 2015
EcryptfsInUse: Yes
InstallationDate: Installed on 2014-11-20 (52 days ago)
InstallationMedia: Ubuntu 15.04 "Vivid Vervet" - Alpha amd64 (20141119)
SourcePackage: lxc
UpgradeStatus: No upgrade log present (probably fresh install)
defaults.conf:
 lxc.network.type = veth
 lxc.network.link = lxcbr0
 lxc.network.flags = up
 lxc.network.hwaddr = 00:16:3e:xx:xx:xx
lxc.conf: lxc.lxcpath = /srv/lxc
modified.conffile..etc.apparmor.d.abstractions.lxc.start.container: [modified]
mtime.conffile..etc.apparmor.d.abstractions.lxc.start.container: 2015-01-08T13:09:02.545927

Revision history for this message
Martin Pitt (pitti) wrote :
summary: - lxc-start-ephemeral stops working with kernel 3.18
+ lxc-start-ephemeral stops working with kernel 3.18 - overlayfs change?
Changed in lxc (Ubuntu):
importance: Undecided → High
tags: added: regression-release
tags: added: bot-stop-nagging
Revision history for this message
Martin Pitt (pitti) wrote :

Adding linux tasks. This overlayfs change might be due to its upstreamization, or unintended, so please invalidate if appropriate. Thanks!

Revision history for this message
Brad Figg (brad-figg) wrote : Missing required logs.

This bug is missing log files that will aid in diagnosing the problem. From a terminal window please run:

apport-collect 1409425

and then change the status of the bug to 'Confirmed'.

If, due to the nature of the issue you have encountered, you are unable to run this command, please add a comment stating that fact and change the bug status to 'Confirmed'.

This change has been made by an automated script, maintained by the Ubuntu Kernel Team.

Changed in linux (Ubuntu):
status: New → Incomplete
tags: added: utopic
Martin Pitt (pitti)
Changed in linux (Ubuntu):
status: Incomplete → Confirmed
Changed in linux (Ubuntu):
importance: Undecided → High
Changed in lxc (Ubuntu):
status: New → Confirmed
Revision history for this message
Martin Pitt (pitti) wrote :

Initially I suspected that this is https://github.com/lxc/lxc/commit/7fb1bef22a but we apparently already have that commit.

Revision history for this message
Martin Pitt (pitti) wrote :

hallyn | stgraber: i was thinking lcx-start-ephemeral used the api more than it does.
hallyn | stgraber: lcx-start-ephemeral needs to be updated the same way the api did, for the new overlayfs options

Revision history for this message
Martin Pitt (pitti) wrote :

It seems Serge knows what's going on, so tentatively closing the linux task.

Changed in linux (Ubuntu):
status: Confirmed → Invalid
Revision history for this message
Serge Hallyn (serge-hallyn) wrote :

The fix is in lxc git HEAD. It should show up in lxc 1.1 soon.

Changed in lxc (Ubuntu):
status: Confirmed → Fix Committed
Changed in lxc (Ubuntu):
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.