Ubuntu
linux package

mount.cifs occasionally causes GPF error/kernel panic when mounting at boot [crypto_larval_kill+0x2b/0x90]

Bug #1114673 reported by Phil Richardson
28
This bug affects 5 people
Affects Status Importance Assigned to Milestone
linux (Ubuntu)
Expired
High
Unassigned

Bug Description

Seeing the same as in bug #1070256

Linux phil-server 3.2.0-37-generic #58-Ubuntu SMP Thu Jan 24 15:28:10 UTC 2013 x86_64 x86_64 x86_64 GNU/Linux
Description: Ubuntu 12.04.2 LTS
Release: 12.04
Ubuntu 3.2.0-37.58-generic 3.2.35

Following kernel update via apt-get dist-upgrade specifially this time, and in all other recent events of any apt-get upgrade, I am seeing the following (I cannot confirm it is only upgrades, but this tends to be the only point of any reboot).

On boot, my CIFS mounts are not mounted and all fail.
2x point to CIFS shares on one machine, one with anan access, one with login credentials
1x points to a CIFS share with annon access
All CIFS shares are Samba which I cannot provide specifics on as they are on a factory locked NAS

Jan 31 11:34:12 phil-server kernel: [ 14.665041] ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
Jan 31 11:34:14 phil-server kernel: [ 16.368487] CIFS: Unknown mount option codepage
Jan 31 11:34:14 phil-server kernel: [ 16.368492] CIFS: Unknown mount option unicode
Jan 31 11:34:14 phil-server kernel: [ 16.378538] CIFS: Unknown mount option codepage
Jan 31 11:34:14 phil-server kernel: [ 16.378542] CIFS: Unknown mount option unicode
Jan 31 11:34:14 phil-server kernel: [ 16.379324] CIFS VFS: default security mechanism requested. The default security mechanism will be upgraded from ntlm to ntlmv2 in kernel release 3.3
Jan 31 11:34:14 phil-server kernel: [ 16.384315] CIFS: Unknown mount option codepage
Jan 31 11:34:14 phil-server kernel: [ 16.384319] CIFS: Unknown mount option unicode
Jan 31 11:34:14 phil-server kernel: [ 16.385850] init: failsafe main process (742) killed by TERM signal
Jan 31 11:34:14 phil-server kernel: [ 16.541394] general protection fault: 0000 [#1] SMP
Jan 31 11:34:14 phil-server kernel: [ 16.541442] CPU 0
Jan 31 11:34:14 phil-server kernel: [ 16.541457] Modules linked in: des_generic md4 nls_utf8 cifs ext2 snd_hda_codec_analog snd_hda_intel snd_hda_codec dcdbas snd_hwdep snd_pcm ppdev mei(C) i915 drm_kms_helper drm psmouse lp i2c_algo_bit serio_raw video snd_timer snd soundcore snd_page_alloc mac_hid parport_pc parport e1000e
Jan 31 11:34:14 phil-server kernel: [ 16.541729]
Jan 31 11:34:14 phil-server kernel: [ 16.541743] Pid: 924, comm: mount.cifs Tainted: G C 3.2.0-36-generic #57-Ubuntu Dell Inc. OptiPlex 755 /0PU052
Jan 31 11:34:14 phil-server kernel: [ 16.541811] RIP: 0010:[<ffffffff812de70f>] [<ffffffff812de70f>] crypto_larval_kill+0x2f/0x90
Jan 31 11:34:14 phil-server kernel: [ 16.541860] RSP: 0018:ffff88003b33d988 EFLAGS: 00010292
Jan 31 11:34:14 phil-server kernel: [ 16.541889] RAX: dead000000200200 RBX: ffff88003b8fb800 RCX: 000000000000156a
Jan 31 11:34:14 phil-server kernel: [ 16.541923] RDX: ffff88003b8f9c00 RSI: 00000000000166a0 RDI: ffffffff81c63b40
Jan 31 11:34:14 phil-server kernel: [ 16.541957] RBP: ffff88003b33d998 R08: ffffea0000ee3e00 R09: ffffffff812deca0
Jan 31 11:34:14 phil-server kernel: [ 16.541990] R10: dead000000200200 R11: 0000000000000001 R12: ffff88003ad81e00
Jan 31 11:34:14 phil-server kernel: [ 16.542022] R13: 0000000000000004 R14: ffffffffa024a0de R15: ffff88003afcae00
Jan 31 11:34:14 phil-server kernel: [ 16.542057] FS: 00007fc20103e700(0000) GS:ffff88003e200000(0000) knlGS:0000000000000000
Jan 31 11:34:14 phil-server kernel: [ 16.542105] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Jan 31 11:34:14 phil-server kernel: [ 16.542133] CR2: 00007f1e6a409000 CR3: 000000003b229000 CR4: 00000000000006f0
Jan 31 11:34:14 phil-server kernel: [ 16.542166] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Jan 31 11:34:14 phil-server kernel: [ 16.543625] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Jan 31 11:34:14 phil-server kernel: [ 16.544983] Process mount.cifs (pid: 924, threadinfo ffff88003b33c000, task ffff88003afcae00)
Jan 31 11:34:14 phil-server kernel: [ 16.545363] Stack:
Jan 31 11:34:14 phil-server kernel: [ 16.545363] ffff88003b8fb800 ffff88003ad81e00 ffff88003b33d9b8 ffffffff812def6b
Jan 31 11:34:14 phil-server kernel: [ 16.545363] ffff88003adb4df6 000000000000008f ffff88003b33da08 ffffffff812df001
Jan 31 11:34:14 phil-server kernel: [ 16.545363] 0000000000000000 0000000000000000 0000000000000000 ffff88003adb4df6
Jan 31 11:34:14 phil-server kernel: [ 16.545363] Call Trace:
Jan 31 11:34:14 phil-server kernel: [ 16.545363] [<ffffffff812def6b>] crypto_alg_mod_lookup+0x6b/0x90
Jan 31 11:34:14 phil-server kernel: [ 16.545363] [<ffffffff812df001>] crypto_alloc_base+0x41/0xb0
Jan 31 11:34:14 phil-server kernel: [ 16.545363] [<ffffffffa02310f9>] smbhash+0x49/0x130 [cifs]
Jan 31 11:34:14 phil-server kernel: [ 16.545363] [<ffffffffa023120d>] E_P24+0x2d/0x80 [cifs]
Jan 31 11:34:14 phil-server kernel: [ 16.545363] [<ffffffffa02316b7>] SMBNTencrypt+0xb7/0xe0 [cifs]
Jan 31 11:34:14 phil-server kernel: [ 16.545363] [<ffffffffa0235b4a>] setup_ntlm_response+0x8a/0x200 [cifs]
Jan 31 11:34:14 phil-server kernel: [ 16.545363] [<ffffffffa0238e6f>] CIFS_SessSetup+0x49f/0xde0 [cifs]
Jan 31 11:34:14 phil-server kernel: [ 16.545363] [<ffffffffa022fd4a>] ? cifs_buf_release+0x1a/0x30 [cifs]
Jan 31 11:34:14 phil-server kernel: [ 16.545363] [<ffffffffa022197f>] cifs_setup_session+0x6f/0x1e0 [cifs]
Jan 31 11:34:14 phil-server kernel: [ 16.545363] [<ffffffffa0221e03>] cifs_get_smb_ses+0x313/0x4a0 [cifs]
Jan 31 11:34:14 phil-server kernel: [ 16.545363] [<ffffffffa0222039>] cifs_mount+0xa9/0x5f0 [cifs]
Jan 31 11:34:14 phil-server kernel: [ 16.545363] [<ffffffffa020f961>] ? cifs_do_mount+0x91/0x280 [cifs]
Jan 31 11:34:14 phil-server kernel: [ 16.545363] [<ffffffffa020f985>] cifs_do_mount+0xb5/0x280 [cifs]
Jan 31 11:34:14 phil-server kernel: [ 16.545363] [<ffffffff8117cf83>] mount_fs+0x43/0x1b0
Jan 31 11:34:14 phil-server kernel: [ 16.545363] [<ffffffff811978fa>] vfs_kern_mount+0x6a/0xc0
Jan 31 11:34:14 phil-server kernel: [ 16.545363] [<ffffffff81198e04>] do_kern_mount+0x54/0x110
Jan 31 11:34:14 phil-server kernel: [ 16.545363] [<ffffffff8119a964>] do_mount+0x1a4/0x260
Jan 31 11:34:14 phil-server kernel: [ 16.545363] [<ffffffff8119ae40>] sys_mount+0x90/0xe0
Jan 31 11:34:14 phil-server kernel: [ 16.545363] [<ffffffff81665a02>] system_call_fastpath+0x16/0x1b
Jan 31 11:34:14 phil-server kernel: [ 16.545363] Code: 53 48 83 ec 08 66 66 66 66 90 48 89 fb 48 c7 c7 40 3b c6 81 e8 a3 df 37 00 48 8b 13 48 8b 43 08 48 c7 c7 40 3b c6 81 48 89 42 08 <48> 89 10 48 b8 00 01 10 00 00 00 ad de 48 ba 00 02 20 00 00 00
Jan 31 11:34:14 phil-server kernel: [ 16.545363] RIP [<ffffffff812de70f>] crypto_larval_kill+0x2f/0x90
Jan 31 11:34:14 phil-server kernel: [ 16.545363] RSP <ffff88003b33d988>
Jan 31 11:34:14 phil-server kernel: [ 16.581332] ---[ end trace 5cee33813b791082 ]---
---
AlsaVersion: Advanced Linux Sound Architecture Driver Version 1.0.24.
AplayDevices: Error: [Errno 2] No such file or directory
ApportVersion: 2.0.1-0ubuntu17.1
Architecture: amd64
ArecordDevices: Error: [Errno 2] No such file or directory
AudioDevicesInUse: Error: command ['fuser', '-v', '/dev/snd/by-path', '/dev/snd/controlC0', '/dev/snd/hwC0D0', '/dev/snd/pcmC0D0c', '/dev/snd/pcmC0D0p', '/dev/snd/pcmC0D1p', '/dev/snd/seq', '/dev/snd/timer'] failed with exit code 1:
CRDA: Error: [Errno 2] No such file or directory
Card0.Amixer.info: Error: [Errno 2] No such file or directory
Card0.Amixer.values: Error: [Errno 2] No such file or directory
CurrentDmesg:
 [ 1018.822877] ACPI Warning: Incorrect checksum in table [TCPA] - 0x00, should be 0x87 (20110623/tbutils-314)
 [ 1018.823032] ACPI Warning: Incorrect checksum in table [TCPA] - 0x00, should be 0x87 (20110623/tbutils-314)
 [ 1029.391508] ACPI Warning: Incorrect checksum in table [TCPA] - 0x00, should be 0x87 (20110623/tbutils-314)
 [ 1029.391667] ACPI Warning: Incorrect checksum in table [TCPA] - 0x00, should be 0x87 (20110623/tbutils-314)
DistroRelease: Ubuntu 12.04
HibernationDevice: RESUME=UUID=32ef8b44-2ff2-49cb-95d4-1d6c088b49bd
InstallationMedia: Ubuntu-Server 12.04 LTS "Precise Pangolin" - Release amd64 (20120424.1)
IwConfig:
 lo no wireless extensions.

 eth0 no wireless extensions.
MachineType: Dell Inc. OptiPlex 755
MarkForUpload: True
Package: linux (not installed)
ProcEnviron:
 LANGUAGE=en_GB:en
 TERM=xterm
 PATH=(custom, no user)
 LANG=en_GB.UTF-8
 SHELL=/bin/bash
ProcFB: 0 inteldrmfb
ProcKernelCmdLine: BOOT_IMAGE=/vmlinuz-3.2.0-37-generic root=/dev/mapper/username--server-root ro
ProcVersionSignature: Ubuntu 3.2.0-37.58-generic 3.2.35
RelatedPackageVersions:
 linux-restricted-modules-3.2.0-37-generic N/A
 linux-backports-modules-3.2.0-37-generic N/A
 linux-firmware 1.79.1
RfKill: Error: [Errno 2] No such file or directory
StagingDrivers: mei
Tags: precise staging
Uname: Linux 3.2.0-37-generic x86_64
UpgradeStatus: No upgrade log present (probably fresh install)
UserGroups: adm cdrom dip lpadmin plugdev sambashare sudo
dmi.bios.date: 08/04/2008
dmi.bios.vendor: Dell Inc.
dmi.bios.version: A11
dmi.board.name: 0PU052
dmi.board.vendor: Dell Inc.
dmi.chassis.type: 15
dmi.chassis.vendor: Dell Inc.
dmi.modalias: dmi:bvnDellInc.:bvrA11:bd08/04/2008:svnDellInc.:pnOptiPlex755:pvr:rvnDellInc.:rn0PU052:rvr:cvnDellInc.:ct15:cvr:
dmi.product.name: OptiPlex 755
dmi.sys.vendor: Dell Inc.

See original description
Revision history for this message
Brad Figg (brad-figg) wrote : Missing required logs.

This bug is missing log files that will aid in diagnosing the problem. From a terminal window please run:

apport-collect 1114673

and then change the status of the bug to 'Confirmed'.

If, due to the nature of the issue you have encountered, you are unable to run this command, please add a comment stating that fact and change the bug status to 'Confirmed'.

This change has been made by an automated script, maintained by the Ubuntu Kernel Team.

Changed in linux (Ubuntu):
status: New → Incomplete
tags: added: precise
Revision history for this message
Phil Richardson (ppslim) wrote : AcpiTables.txt

apport information

tags: added: apport-collected staging
description: updated
Revision history for this message
Phil Richardson (ppslim) wrote : AlsaDevices.txt

apport information

Revision history for this message
Phil Richardson (ppslim) wrote : BootDmesg.txt

apport information

Revision history for this message
Phil Richardson (ppslim) wrote : Card0.Codecs.codec.0.txt

apport information

Revision history for this message
Phil Richardson (ppslim) wrote : Lspci.txt

apport information

Revision history for this message
Phil Richardson (ppslim) wrote : Lsusb.txt

apport information

Revision history for this message
Phil Richardson (ppslim) wrote : PciMultimedia.txt

apport information

Revision history for this message
Phil Richardson (ppslim) wrote : ProcCpuinfo.txt

apport information

Revision history for this message
Phil Richardson (ppslim) wrote : ProcInterrupts.txt

apport information

Revision history for this message
Phil Richardson (ppslim) wrote : ProcModules.txt

apport information

Revision history for this message
Phil Richardson (ppslim) wrote : UdevDb.txt

apport information

Revision history for this message
Phil Richardson (ppslim) wrote : UdevLog.txt

apport information

Revision history for this message
Phil Richardson (ppslim) wrote : WifiSyslog.txt

apport information

Changed in linux (Ubuntu):
status: Incomplete → Confirmed
Revision history for this message
Phil Richardson (ppslim) wrote :

Of note, it took three systems reboots to allow CIFS operation following report generation.

CPU load was spiralling out of control an with each passing second was picking up at a linear pace.

Unfortunately, I have not debugs what process was requiring so many resources before rebooting out of the problem.

Revision history for this message
Phil Richardson (ppslim) wrote :

fstab config

# Mount the NAS drives
//192.168.0.200/Volume_1 /media/verbatim cifs guest,uid=1000,iocharset=utf8,codepage=unicode,unicode 0 0
//192.168.0.199/store /media/a cifs guest,uid=1000,iocharset=utf8,codepage=unicode,unicode 0 0
//192.168.0.199/pvt /media/pvt cifs credentials=/root/.smbmountcred,uid=1000,iocharset=utf8,codepage=unicode,unicode 0 0

Revision history for this message
Dave Gilbert (ubuntu-treblig) wrote :

Phil:
  Could you try following the instructions here:

https://wiki.ubuntu.com/Kernel/BugTriage/Responses#Please_Test_Latest_Upstream

to see if it happens on the latest upstream kernel.

tags: added: needs-upstream-testing
Changed in linux (Ubuntu):
importance: Undecided → High
Revision history for this message
Dave Gilbert (ubuntu-treblig) wrote :

High: Lots of people seeing these oops on samba stuff
Incomplete: Asking for upstream testing

Changed in linux (Ubuntu):
status: Confirmed → Incomplete
Revision history for this message
Phil Richardson (ppslim) wrote :

I will try, but that page is by far the most confusing thing I have ever read.

I get the process of conducting the install, of which files I need due to arch and stuff, but the process of determining which is the upstream one to use ?!?!

Given I am on 3.2.0-37.58, does that mean I use the one in the current directory of daily, or use the lookup take to use the next one 3.2.38?

Other than tagging on completion, is there no other debug output needed?

Revision history for this message
Dave Gilbert (ubuntu-treblig) wrote :

Take the one right at the bottom of http://kernel.ubuntu.com/~kernel-ppa/mainline/ (currently v3.8-rc7-raring/)

If it works reliably then no, doesn't need any other debug; if it oopses or breaks in any other way just say what happened;
all I'm trying to do here is see if the very latest bleeding edge has fixed your bug or if it's still broken.

Revision history for this message
Phil Richardson (ppslim) wrote :
Download full text (5.1 KiB)

Whole host of additional hassle from this, as fstab adjustments were required (already aware of these from second system on 12.10).

Feb 11 19:10:59 phil-server kernel: [ 20.417424] CIFS VFS: cifs_mount failed w/return code = -13
Feb 11 19:10:59 phil-server kernel: [ 20.513764] general protection fault: 0000 [#1] SMP
Feb 11 19:10:59 phil-server kernel: [ 20.513816] Modules linked in: arc4 md4 nls_utf8 cifs fscache ext2 snd_hda_codec_analog coretemp i915 snd_hda_intel snd_hda_codec drm_kms_helper snd_hwdep drm snd_pcm psmouse snd_timer dcdbas ppdev snd microcode soundcore serio_raw snd_page_alloc i2c_algo_bit mei mac_hid lpc_ich parport_pc video lp parport e1000e
Feb 11 19:10:59 phil-server kernel: [ 20.514085] CPU 0
Feb 11 19:10:59 phil-server kernel: [ 20.514101] Pid: 917, comm: mount.cifs Not tainted 3.8.0-030800rc7-generic #201302081635 Dell Inc. OptiPlex 755 /0PU052
Feb 11 19:10:59 phil-server kernel: [ 20.514158] RIP: 0010:[<ffffffff813155ef>] [<ffffffff813155ef>] crypto_larval_kill+0x2f/0x90
Feb 11 19:10:59 phil-server kernel: [ 20.514205] RSP: 0018:ffff88003a47ba18 EFLAGS: 00010296
Feb 11 19:10:59 phil-server kernel: [ 20.514237] RAX: dead000000200200 RBX: ffff88003b4a5200 RCX: 0000000000001df7
Feb 11 19:10:59 phil-server kernel: [ 20.514269] RDX: ffff88003b4a5400 RSI: ffff88003b4a5400 RDI: ffffffff81c71f40
Feb 11 19:10:59 phil-server kernel: [ 20.514302] RBP: ffff88003a47ba28 R08: 0000000000016d80 R09: ffffea0000ed2900
Feb 11 19:10:59 phil-server kernel: [ 20.514333] R10: ffffffff813150f0 R11: 0000000000000000 R12: ffffffffa00ea120
Feb 11 19:10:59 phil-server kernel: [ 20.514366] R13: 0000000000000004 R14: ffffffffa02e88a4 R15: ffff88003ad50000
Feb 11 19:10:59 phil-server kernel: [ 20.515597] FS: 00007fb9db81f700(0000) GS:ffff88003e200000(0000) knlGS:0000000000000000
Feb 11 19:10:59 phil-server kernel: [ 20.516047] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Feb 11 19:10:59 phil-server kernel: [ 20.516047] CR2: 00007fd0bbe6f000 CR3: 000000003b53e000 CR4: 00000000000007f0
Feb 11 19:10:59 phil-server kernel: [ 20.516047] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Feb 11 19:10:59 phil-server kernel: [ 20.516047] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Feb 11 19:10:59 phil-server kernel: [ 20.516047] Process mount.cifs (pid: 917, threadinfo ffff88003a47a000, task ffff88003ad50000)
Feb 11 19:10:59 phil-server kernel: [ 20.516047] Stack:
Feb 11 19:10:59 phil-server kernel: [ 20.516047] ffff88003b4a5200 ffffffffa00ea120 ffff88003a47ba48 ffffffff81315acb
Feb 11 19:10:59 phil-server kernel: [ 20.516047] ffff88003b4a3a00 000000000000008f ffff88003a47ba98 ffffffff81315b61
Feb 11 19:10:59 phil-server kernel: [ 20.516047] ffff88003a47baa8 ffff88003b4a3a00 ffff880036fe6a00 ffff88003b4a3a00
Feb 11 19:10:59 phil-server kernel: [ 20.516047] Call Trace:
Feb 11 19:10:59 phil-server kernel: [ 20.516047] [<ffffffff81315acb>] crypto_alg_mod_lookup+0x6b/0x90
Feb 11 19:10:59 phil-server kernel: [ 20.516047] [<ffffffff81315b61>] crypto_alloc_base+0x41/0xb0
Feb 11 19:10:59 phil-server kernel: [ 20.516047] [<ffffffffa02b7768>] calc...

Read more...

tags: added: kernel-bug-exists-upstream kernel-bug-exists-upstream-v3.8-rc7
removed: needs-upstream-testing
Changed in linux (Ubuntu):
status: Incomplete → Confirmed
Revision history for this message
Dave Gilbert (ubuntu-treblig) wrote :

Triaged: Tested upstream - still fails

Thanks for trying that Phil; ok, so that means it still fails upstream.

Changed in linux (Ubuntu):
status: Confirmed → Triaged
Revision history for this message
Phil Richardson (ppslim) wrote :

To add, this kernel caused me to pain. On removing it, it failed during removal an a spontaneous reboot left me with a system that would not boot as it could not find the kernel.

As it's headless, finally managed to get on an boot to old kernel. When loaded, completed the removal and rebuild Grub. Also noted that CIFS had mounted correctly.

Rebooted again to get verify clean boot. All as expected, all mounted.

Ran apt-get to install the updates since the 3rd, but no kernel due as already on latest.

Lo and behold, the failed to mount on boot. This seems to be a pretty regular pattern in that reboots following updates, causes the problem. Right now again, system load is climbing at a linear pace and not I have a few mins spare to investigate, there are no processes using resource. There is absolutely nothing queueing to cause this load to increase.

I an however see the login prompt, which is warning me mountall as disconnected from Plymouth.

Rebooting out of the problem again and it took 4 reboots to return to normal

Revision history for this message
Mikael Hjelm (j-m-hjelm) wrote :

This bug is not confined to cifs mounts in fstab.
I can get a kernel crash if i mount it manually but too soon after boot. I have a rather fast boot since i am running on an ssd and lubuntu so i think there might be some timing. issue, either network isn't properly up or some other process is doing something fishy.
To me it also sometimes occur if the connection to the smaba server is interrupted somehow. We had a maintenance of the VPN tunnel between two sites and that killed the mounts with fatal results.

Revision history for this message
penalvch (penalvch) wrote :

Phil Richardson, as per http://www.dell.com/support/drivers/us/en/19/Product/optiplex-755 an update is available for your BIOS (A22). If you update to this following https://help.ubuntu.com/community/BiosUpdate , does it change anything? If it doesn't, could you please both specify what happened, and just provide the output of the following terminal command:
sudo dmidecode -s bios-version && sudo dmidecode -s bios-release-date

For more on BIOS updates and linux, please see https://help.ubuntu.com/community/ReportingBugs#Bug_reporting_etiquette .

Thank you for your understanding.

tags: added: bios-outdated-a22
Changed in linux (Ubuntu):
status: Triaged → Incomplete
Revision history for this message
Launchpad Janitor (janitor) wrote :

[Expired for linux (Ubuntu) because there has been no activity for 60 days.]

Changed in linux (Ubuntu):
status: Incomplete → Expired
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.