Kernel panic when rebooting panda board

Bug #745737 reported by Mattias Backman
12
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Linaro Linux
Fix Released
High
Unassigned
linux-linaro-omap (Ubuntu)
Fix Released
Undecided
John Rigby

Bug Description

I got this when rebooting the panda board. Using hwpack_linaro-panda_20110329-0_armel_supported.tar.gz and linaro-natty-nano-tar-20110329-0.tar.gz

[ 3.487396] Unhandled fault: imprecise external abort (0x1406) at 0x401a98da
[ 3.497894] Internal error: : 1406 [#1] SMP
[ 3.505310] last sysfs file:
[ 3.511474] Modules linked in:
[ 3.517700] CPU: 0 Not tainted (2.6.38-1001-linaro-omap #2-Ubuntu)
[ 3.527648] PC is at configure_dispc+0x22/0x194
[ 3.535491] LR is at configure_dispc+0x27/0x194
[ 3.543334] pc : [<c02aef72>] lr : [<c02aef77>] psr: 200000b3
[ 3.543334] sp : da849e60 ip : ffffffff fp : 00000000
[ 3.561676] r10: c06a0b90 r9 : da849e6d r8 : da849e6a
[ 3.570404] r7 : 00000003 r6 : 00000003 r5 : 00000000 r4 : 00000001
[ 3.580505] r3 : 02100004 r2 : 00000005 r1 : 80000093 r0 : 00000001
[ 3.590545] Flags: nzCv IRQs off FIQs on Mode SVC_32 ISA Thumb Segment kernel
[ 3.604705] Control: 50c53c7d Table: 8000404a DAC: 00000015
[ 3.613922] Process swapper (pid: 1, stack limit = 0xda8482f8)
[ 3.623260] Stack: (0xda849e60 to 0xda84a000)
[ 3.631011] 9e60: c006a4cd c068f610 80000093 c006001f c078e608 00000000 c078f978 c078f984
[ 3.646087] 9e80: 68008000 d9d809c0 00000088 c06a0b90 00000000 c02af267 c078f9c4 000001e0
[ 3.661285] 9ea0: 00000080 c078f984 00000000 00000000 00000000 60000013 da82c23c d9dec000
[ 3.676452] 9ec0: c078faf8 c06a3f70 00000003 d9dec488 00000000 00000000 00000000 c02b32c1
[ 3.691589] 9ee0: da056c30 00000000 c06b7410 c06a3f70 c06a3f78 c0793dc4 c06b7410 c06a3f70
[ 3.706939] 9f00: 00000000 c0024119 00000000 c02d92f9 c02d92e9 c02d8817 c06a4040 c06a3f70
[ 3.722442] 9f20: c06b7410 c06a3fa4 00000000 c02d8a0f 00000000 c06a3f70 c06b7410 c02d8a67
[ 3.738037] 9f40: c06b7410 c02d8a1d 00000000 c02d7fd9 da82c13c daa78db4 c06b7410 c06bcaf0
[ 3.753906] 9f60: d9e74900 c02d8523 c059bd90 c0038da8 da848000 c06b7410 c0038da8 da848000
[ 3.769958] 9f80: 00000000 c0024119 00000000 c02d8bb1 c06d3f80 c0038da8 da848000 00000000
[ 3.786315] 9fa0: c0024119 c0024139 00000000 c00514e1 c0038cb4 c0038da8 da806300 00000033
[ 3.802886] 9fc0: 00000000 00000000 c0038d88 c0038da8 da806300 00000033 00000000 00000000
[ 3.819732] 9fe0: 00000000 c0008a8d 00000000 c000899d c00568a9 c00568a9 00000000 ffffffff
[ 3.836730] [<c02aef72>] (configure_dispc+0x22/0x194) from [<c02af267>] (omap_dss_mgr_apply+0x183/0x378)
[ 3.855285] [<c02af267>] (omap_dss_mgr_apply+0x183/0x378) from [<c02b32c1>] (omapfb_probe+0x1c1/0x2e8)
[ 3.873779] [<c02b32c1>] (omapfb_probe+0x1c1/0x2e8) from [<c02d92f9>] (platform_drv_probe+0x11/0x14)
[ 3.892150] [<c02d92f9>] (platform_drv_probe+0x11/0x14) from [<c02d8817>] (really_probe+0x43/0xfc)
[ 3.910308] [<c02d8817>] (really_probe+0x43/0xfc) from [<c02d8a0f>] (driver_probe_device+0x3b/0x48)
[ 3.928619] [<c02d8a0f>] (driver_probe_device+0x3b/0x48) from [<c02d8a67>] (__driver_attach+0x4b/0x4c)
[ 3.947235] [<c02d8a67>] (__driver_attach+0x4b/0x4c) from [<c02d7fd9>] (bus_for_each_dev+0x29/0x44)
[ 3.965576] [<c02d7fd9>] (bus_for_each_dev+0x29/0x44) from [<c02d8523>] (bus_add_driver+0x117/0x1a0)
[ 3.984008] [<c02d8523>] (bus_add_driver+0x117/0x1a0) from [<c02d8bb1>] (driver_register+0x3d/0xc8)
[ 4.002410] [<c02d8bb1>] (driver_register+0x3d/0xc8) from [<c0024139>] (omapfb_init+0x21/0x38)
[ 4.020355] [<c0024139>] (omapfb_init+0x21/0x38) from [<c00514e1>] (do_one_initcall+0x25/0x118)
[ 4.038391] [<c00514e1>] (do_one_initcall+0x25/0x118) from [<c0008a8d>] (kernel_init+0xf1/0x160)
[ 4.056579] [<c0008a8d>] (kernel_init+0xf1/0x160) from [<c00568a9>] (kernel_thread_exit+0x1/0x8)
[ 4.074737] Code: f10d 080a 4625 4620 (f7fb)
[ 4.083770] ---[ end trace 89be6e8a3639468f ]---
[ 4.093048] usb 1-1: new high speed USB device using ehci-omap and address 2
[ 4.104919] Kernel panic - not syncing: Attempted to kill init!
[ 4.115539] [<c005af11>] (unwind_backtrace+0x1/0x9c) from [<c0454d71>] (panic+0x51/0x12c)
[ 4.132720] [<c0454d71>] (panic+0x51/0x12c) from [<c0087f23>] (forget_original_parent+0x1a7/0x1a8)
[ 4.150756] [<c0087f23>] (forget_original_parent+0x1a7/0x1a8) from [<c0087f31>] (exit_notify+0xd/0xe8)
[ 4.169158] [<c0087f31>] (exit_notify+0xd/0xe8) from [<c008868d>] (do_exit+0x131/0x27c)
[ 4.186157] [<c008868d>] (do_exit+0x131/0x27c) from [<c0058a87>] (die+0xa3/0xc0)
[ 4.202514] [<c0058a87>] (die+0xa3/0xc0) from [<c0051353>] (do_DataAbort+0x6f/0x70)
[ 4.219116] [<c0051353>] (do_DataAbort+0x6f/0x70) from [<c005574b>] (__dabt_svc+0x4b/0x80)
[ 4.236358] Exception stack(0xda849e18 to 0xda849e60)
[ 4.245910] 9e00: 00000001 80000093
[ 4.262756] 9e20: 00000005 02100004 00000001 00000000 00000003 00000003 da849e6a da849e6d
[ 4.279510] 9e40: c06a0b90 00000000 ffffffff da849e60 c02aef77 c02aef72 200000b3 ffffffff
[ 4.296234] [<c005574b>] (__dabt_svc+0x4b/0x80) from [<c02aef72>] (configure_dispc+0x22/0x194)
[ 4.313415] [<c02aef72>] (configure_dispc+0x22/0x194) from [<c02af267>] (omap_dss_mgr_apply+0x183/0x378)
[ 4.331542] [<c02af267>] (omap_dss_mgr_apply+0x183/0x378) from [<c02b32c1>] (omapfb_probe+0x1c1/0x2e8)
[ 4.349670] [<c02b32c1>] (omapfb_probe+0x1c1/0x2e8) from [<c02d92f9>] (platform_drv_probe+0x11/0x14)
[ 4.367736] [<c02d92f9>] (platform_drv_probe+0x11/0x14) from [<c02d8817>] (really_probe+0x43/0xfc)
[ 4.385681] [<c02d8817>] (really_probe+0x43/0xfc) from [<c02d8a0f>] (driver_probe_device+0x3b/0x48)
[ 4.403747] [<c02d8a0f>] (driver_probe_device+0x3b/0x48) from [<c02d8a67>] (__driver_attach+0x4b/0x4c)
[ 4.422058] [<c02d8a67>] (__driver_attach+0x4b/0x4c) from [<c02d7fd9>] (bus_for_each_dev+0x29/0x44)
[ 4.440124] [<c02d7fd9>] (bus_for_each_dev+0x29/0x44) from [<c02d8523>] (bus_add_driver+0x117/0x1a0)
[ 4.458282] [<c02d8523>] (bus_add_driver+0x117/0x1a0) from [<c02d8bb1>] (driver_register+0x3d/0xc8)
[ 4.476348] [<c02d8bb1>] (driver_register+0x3d/0xc8) from [<c0024139>] (omapfb_init+0x21/0x38)
[ 4.493988] [<c0024139>] (omapfb_init+0x21/0x38) from [<c00514e1>] (do_one_initcall+0x25/0x118)
[ 4.511840] [<c00514e1>] (do_one_initcall+0x25/0x118) from [<c0008a8d>] (kernel_init+0xf1/0x160)
[ 4.530059] [<c0008a8d>] (kernel_init+0xf1/0x160) from [<c00568a9>] (kernel_thread_exit+0x1/0x8)
[ 4.548278] CPU1: stopping
[ 4.555511] [<c005af11>] (unwind_backtrace+0x1/0x9c) from [<c00512cf>] (do_IPI+0xbf/0xd4)
[ 4.572875] [<c00512cf>] (do_IPI+0xbf/0xd4) from [<c00557b3>] (__irq_svc+0x33/0x100)
[ 4.589782] Exception stack(0xda861f90 to 0xda861fd8)
[ 4.599426] 1f80: 00000020 c067abec da861fd8 00000000
[ 4.616577] 1fa0: da860000 c06d4044 c045b0f4 c067fb7c c067fd1c 411fc092 00000000 00000000
[ 4.633666] 1fc0: 00000001 da861fd8 c00568ed c00568ee 60000133 ffffffff
[ 4.644897] [<c00557b3>] (__irq_svc+0x33/0x100) from [<c00568ee>] (default_idle+0x1a/0x1c)
[ 4.661987] [<c00568ee>] (default_idle+0x1a/0x1c) from [<c0056a7b>] (cpu_idle+0x8f/0xb4)
[ 4.678863] [<c0056a7b>] (cpu_idle+0x8f/0xb4) from [<80452b4d>] (0x80452b4d)

Revision history for this message
John Rigby (jcrigby) wrote :

Looks like the hwpack does not have the latest kernel. I noticed the meta was building on Friday not sure what is up.

Revision history for this message
John Rigby (jcrigby) wrote :

Just verified that the latest kernel is in so that is not the problem. Testing on my panda now.

Revision history for this message
John Rigby (jcrigby) wrote :

Unable to reproduce this on my panda so it is not the old problem that failed every time on every panda board.

Changed in linux-linaro:
status: New → Incomplete
Revision history for this message
John Rigby (jcrigby) wrote :

Mattias, if you have more details on how to reproduce this that would be helpful. If memory serves me right there may be an issue with init order that could cause this. If the display init happens before the clocks are set up then you would get a fault trying to access the display controller registers. This is just a wild guess.

Revision history for this message
John Rigby (jcrigby) wrote :

Marking duplicate because lool is seeing the old bug on the latest kernel as well.

Revision history for this message
John Rigby (jcrigby) wrote :

This is not a duplicate because it occurs only about 20% of the time and it has nothing to do with CONFIG_OMAP_DSS_SDI.

Revision history for this message
John Rigby (jcrigby) wrote :

Before the attached patch I got the error 9 of 54 resets. After the patch I reset 50 times with no occurance of the bug. I will apply the patch to the packaged kernel as a "SAUCE" patch. The patch is an updated version of one Anand posted as a possible fix for the other panda display crash bug.

Changed in linux-linaro:
status: Incomplete → Confirmed
Changed in linux-linaro-omap (Ubuntu):
status: New → In Progress
assignee: nobody → John Rigby (jcrigby)
Revision history for this message
Loïc Minier (lool) wrote :

Awesome, thanks!

Revision history for this message
Mattias Backman (mabac) wrote :
Download full text (6.9 KiB)

I saw this again on first boot with image from 2011-04-07. Not sure that the stack i exactly the same so, I'll repost it here.

So far, I've seen it once, will check if it happens as often as stated above.

[ 3.427764] Unhandled fault: imprecise external abort (0x1406) at 0x8766e6d8
[ 3.438354] Internal error: : 1406 [#1] SMP
[ 3.445861] last sysfs file:
[ 3.452056] Modules linked in:
[ 3.458312] CPU: 0 Not tainted (2.6.38-1001-linaro-omap #2-Ubuntu)
[ 3.468353] PC is at configure_dispc+0x22/0x194
[ 3.476287] LR is at configure_dispc+0x27/0x194
[ 3.484191] pc : [<c02aef72>] lr : [<c02aef77>] psr: 200000b3
[ 3.484191] sp : da849e60 ip : ffffffff fp : 00000000
[ 3.502777] r10: c06a0b90 r9 : da849e6d r8 : da849e6a
[ 3.511535] r7 : 00000003 r6 : 00000003 r5 : 00000000 r4 : 00000001
[ 3.521667] r3 : 02100004 r2 : 00000005 r1 : 80000093 r0 : 00000001
[ 3.531707] Flags: nzCv IRQs off FIQs on Mode SVC_32 ISA Thumb Segment kernel
[ 3.545959] Control: 50c53c7d Table: 8000404a DAC: 00000015
[ 3.555236] Process swapper (pid: 1, stack limit = 0xda8482f8)
[ 3.564605] Stack: (0xda849e60 to 0xda84a000)
[ 3.572448] 9e60: c006a4cd c068f610 80000093 c006001f c078e608 00000000 c078f978 c078f984
[ 3.587615] 9e80: 68008000 d9d759c0 00000088 c06a0b90 00000000 c02af267 c078f9c4 000001e0
[ 3.602813] 9ea0: 00000080 c078f984 00000000 00000000 00000000 60000013 da82c23c d9dec000
[ 3.617980] 9ec0: c078faf8 c06a3f70 00000003 d9dec488 00000000 00000000 00000000 c02b32c1
[ 3.633209] 9ee0: daa78c30 00000000 c06b7410 c06a3f70 c06a3f78 c0793dc4 c06b7410 c06a3f70
[ 3.648651] 9f00: 00000000 c0024119 00000000 c02d92f9 c02d92e9 c02d8817 c06a4040 c06a3f70
[ 3.664184] 9f20: c06b7410 c06a3fa4 00000000 c02d8a0f 00000000 c06a3f70 c06b7410 c02d8a67
[ 3.679779] 9f40: c06b7410 c02d8a1d 00000000 c02d7fd9 da82c13c daa6ecf4 c06b7410 c06bcaf0
[ 3.695617] 9f60: d9e73900 c02d8523 c059bd90 c0038da8 da848000 c06b7410 c0038da8 da848000
[ 3.711669] 9f80: 00000000 c0024119 00000000 c02d8bb1 c06d3f80 c0038da8 da848000 00000000
[ 3.728057] 9fa0: c0024119 c0024139 00000000 c00514e1 00000000 271beb3a da82a6c0 c06a8dd0
[ 3.744598] 9fc0: 00000192 da806300 c0038d88 c0038da8 da806300 00000033 00000000 00000000
[ 3.761474] 9fe0: 00000000 c0008a8d 00000000 c000899d c00568a9 c00568a9 af3a9fb8 15020484
[ 3.778472] [<c02aef72>] (configure_dispc+0x22/0x194) from [<c02af267>] (omap_dss_mgr_apply+0x183/0x378)
[ 3.796997] [<c02af267>] (omap_dss_mgr_apply+0x183/0x378) from [<c02b32c1>] (omapfb_probe+0x1c1/0x2e8)
[ 3.815521] [<c02b32c1>] (omapfb_probe+0x1c1/0x2e8) from [<c02d92f9>] (platform_drv_probe+0x11/0x14)
[ 3.833862] [<c02d92f9>] (platform_drv_probe+0x11/0x14) from [<c02d8817>] (really_probe+0x43/0xfc)
[ 3.852050] [<c02d8817>] (really_probe+0x43/0xfc) from [<c02d8a0f>] (driver_probe_device+0x3b/0x48)
[ 3.870330] [<c02d8a0f>] (driver_probe_device+0x3b/0x48) from [<c02d8a67>] (__driver_attach+0x4b/0x4c)
[ 3.888946] [<c02d8a67>] (__driver_attach+0x4b/0x4c) from [<c02d7fd9>] (bus_for_each_dev+0x29/0x44)
[ 3.907287] [<c02d7fd9>] (bus_for_each_dev+0x29/0x44) from [<c02d8523>] (bus_...

Read more...

Revision history for this message
Mattias Backman (mabac) wrote :

I have logged 7 failed boots out of 32 attempts.

Revision history for this message
Tom Gall (tom-gall) wrote :
Download full text (6.1 KiB)

Just encountered on the 04142011 panda hwpack while attempting to test out alip.

[ 3.526947] Unhandled fault: imprecise external abort (0x1406) at 0xe7706ffb
[ 3.537536] Internal error: : 1406 [#1] SMP
[ 3.545074] last sysfs file:
[ 3.551269] Modules linked in:
[ 3.557525] CPU: 0 Not tainted (2.6.38-1001-linaro-omap #2-Ubuntu)
[ 3.567565] PC is at configure_dispc+0x22/0x194
[ 3.575531] LR is at configure_dispc+0x27/0x194
[ 3.583435] pc : [<c02aef72>] lr : [<c02aef77>] psr: 200000b3
[ 3.583435] sp : da849e60 ip : ffffffff fp : 00000000
[ 3.602020] r10: c06a0b90 r9 : da849e6d r8 : da849e6a
[ 3.610778] r7 : 00000003 r6 : 00000003 r5 : 00000000 r4 : 00000001
[ 3.620910] r3 : 02102004 r2 : 00000005 r1 : 80000093 r0 : 00000001
[ 3.630950] Flags: nzCv IRQs off FIQs on Mode SVC_32 ISA Thumb Segment kernl
[ 3.645233] Control: 50c53c7d Table: 8000404a DAC: 00000015
[ 3.654510] Process swapper (pid: 1, stack limit = 0xda8482f8)
[ 3.663879] Stack: (0xda849e60 to 0xda84a000)
[ 3.671691] 9e60: c006a4cd c068f610 80000093 c006001f c078e608 00000000 c078f9784
[ 3.686889] 9e80: 68008000 d9dfa9c0 00000088 c06a0b90 00000000 c02af267 c078f9c40
[ 3.702087] 9ea0: 00000080 c078f984 00000000 00000000 00000000 60000013 da82c23c0
[ 3.717254] 9ec0: c078faf8 c06a3f70 00000002 d9e2c484 00000000 00000000 000000001
[ 3.732482] 9ee0: da045c30 00000000 c06b7410 c06a3f70 c06a3f78 c0793dc4 c06b74100
[ 3.747894] 9f00: 00000000 c0024119 00000000 c02d92f9 c02d92e9 c02d8817 c06a40400
[ 3.763427] 9f20: c06b7410 c06a3fa4 00000000 c02d8a0f 00000000 c06a3f70 c06b74107
[ 3.779022] 9f40: c06b7410 c02d8a1d 00000000 c02d7fd9 da82c13c daa89cf4 c06b74100
[ 3.794891] 9f60: d9ef8900 c02d8523 c059bd90 c0038da8 da848000 c06b7410 c0038da80
[ 3.810943] 9f80: 00000000 c0024119 00000000 c02d8bb1 c06d3f80 c0038da8 da8480000
[ 3.827331] 9fa0: c0024119 c0024139 00000000 c00514e1 00000000 271beb3a da82a6c00
[ 3.843872] 9fc0: 00000192 da806300 c0038d88 c0038da8 da806300 00000033 000000000
[ 3.860748] 9fe0: 00000000 c0008a8d 00000000 c000899d c00568a9 c00568a9 ffffffff0
[ 3.877746] [<c02aef72>] (configure_dispc+0x22/0x194) from [<c02af267>] (omap_ds)
[ 3.896270] [<c02af267>] (omap_dss_mgr_apply+0x183/0x378) from [<c02b32c1>] (oma)
[ 3.914794] [<c02b32c1>] (omapfb_probe+0x1c1/0x2e8) from [<c02d92f9>] (platform_)
[ 3.933135] [<c02d92f9>] (platform_drv_probe+0x11/0x14) from [<c02d8817>] (reall)
[ 3.951324] [<c02d8817>] (really_probe+0x43/0xfc) from [<c02d8a0f>] (driver_prob)
[ 3.969604] [<c02d8a0f>] (driver_probe_device+0x3b/0x48) from [<c02d8a67>] (__dr)
[ 3.988220] [<c02d8a67>] (__driver_attach+0x4b/0x4c) from [<c02d7fd9>] (bus_for_)
[ 4.006591] [<c02d7fd9>] (bus_for_each_dev+0x29/0x44) from [<c02d8523>] (bus_add)
[ 4.025054] [<c02d8523>] (bus_add_driver+0x117/0x1a0) from [<c02d8bb1>] (driver_)
[ 4.043457] [<c02d8bb1>] (driver_register+0x3d/0xc8) from [<c0024139>] (omapfb_i)
[ 4.061401] [<c0024139>] (omapfb_init+0x21/0x38) from [<c00514e1>] (do_one_initc)
[ 4.079467] [<c00514e1>] (do_one_initcall+0x25/0x118) from [<c0008a8d>] (kernel_)
[ 4.097656] [<c00...

Read more...

Revision history for this message
warmcat (andy-warmcat) wrote :

It's a different issue. This will solve it -->

http://git.linaro.org/gitweb?p=people/andygreen/kernel-tilt.git;a=patch;h=1b0d6d49516d29bf2d723e2789e6f0fcd483f7b7

On OMAP, if you try to touch any peripheral unit that is not clocked, it'll blow a bus abort which shows up as one of these "imprecise external aborts". MUSB has recently taken on runtime_pm which means units are unclocked more often when out of use, and evidently it's not 100% yet.

Changed in linux-linaro:
importance: Undecided → High
Revision history for this message
Nicolas Pitre (npitre) wrote : Re: [Bug 745737] Re: Kernel panic when rebooting panda board

On Thu, 14 Apr 2011, warmcat wrote:

> It's a different issue. This will solve it -->
>
> http://git.linaro.org/gitweb?p=people/andygreen/kernel-
> tilt.git;a=patch;h=1b0d6d49516d29bf2d723e2789e6f0fcd483f7b7

Merged in linaro-2.6.38

Changed in linux-linaro:
status: Confirmed → Fix Committed
John Rigby (jcrigby)
Changed in linux-linaro-omap (Ubuntu):
status: In Progress → Fix Committed
Revision history for this message
Launchpad Janitor (janitor) wrote :

This bug was fixed in the package linux-linaro-omap - 2.6.38-1002.3

---------------
linux-linaro-omap (2.6.38-1002.3) natty; urgency=low

  [ Upstream Fixes ]

  * MUSB: shutdown: Make sure block is awake before doing shutdown
    - LP: #745737
  * Fixed gpio polarity of gpio USB-phy reset.
    - LP: #747639

  [ Andy Green ]

  * LINARO: SAUCE: disable CONFIG_OMAP_RESET_CLOCKS
    - LP: #752900

  [ John Rigby ]

  * Rebase to new upstreams:
    Linux v2.6.38.1
    linaro-linux-2.6.38-upstream-29Mar2011
    Ubuntu-2.6.38-7.35
  * SAUCE: OMAP4: clock: wait for module to become accessible on
    a clk enable
    - LP: #745737
  * Rebase to new upstreams:
    Linux v2.6.38.2
    linaro-linux-2.6.38-upstream-5Apr2011
    Ubuntu-2.6.38-8.41
    - LP: #732842
  * Update configs for device tree, dvfs and lttng
  * LINARO: add building of dtb's
  * LINARO: SAUCE: Disable lowest operating freqs on omap34xx
    - LP: #732912
 -- John Rigby <email address hidden> Thu, 14 Apr 2011 12:16:06 -0600

Changed in linux-linaro-omap (Ubuntu):
status: Fix Committed → Fix Released
Tom Gall (tom-gall)
Changed in linux-linaro:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.