Dear all,
I’m looking for suggestions for this kernel oops.
I recently discovered that when pushing the CPU too high (scaling_governor set to performance, audio processes taking 100%) I often encounter a kernel oops (reported on bottom) after several lines of:
omap_i2c 48060000.i2c: controller timed out
Looking at sysfs I see that 48060000.i2c is related to the SD card slot. Am I right?
So maybe the problem with my system is that the I2C controller gets crazy (maybe because of delays caused by the high CPU load? Or maybe because of the heat? One month ago the same configuration did work well, but even putting a fan in front of the board doesn’t help now).
I’m working on a debian Wheezy version from Robert Nelson rcn-ee:
Linux debian-BB1 3.13.3-armv7-x10 #1 SMP Sat Feb 15 01:03:40 UTC 2014 armv7l GNU/Linux
BeagleBoard xM, rev.c
The kern.log output. At 193 the jack is started and ALSA allocates the buffers. After some time the controller timed out messages start. I can reproduce the bug by forcing a bit the CPU (e.g. running top and cat from a big file).
Jun 12 15:44:00 debian-BB1 kernel: [ 193.192321] omap-dma-engine 48056000.dma-controller: allocating channel for 33
Jun 12 15:44:00 debian-BB1 kernel: [ 193.214355] omap-dma-engine 48056000.dma-controller: allocating channel for 34
Jun 12 15:44:24 debian-BB1 kernel: [ 216.959320] [sched_delayed] sched: RT throttling activated
Jun 12 15:44:33 debian-BB1 kernel: [ 225.959625] omap_i2c 48060000.i2c: controller timed out
Jun 12 15:44:44 debian-BB1 kernel: [ 236.979858] omap_i2c 48060000.i2c: controller timed out
Jun 12 15:44:56 debian-BB1 kernel: [ 248.949737] omap_i2c 48060000.i2c: controller timed out
Jun 12 15:45:04 debian-BB1 kernel: [ 256.098236] Unhandled fault: external abort on non-linefetch (0x1028) at 0xfa060004
Jun 12 15:45:04 debian-BB1 kernel: [ 256.106933] Internal error: : 1028 [#1] SMP ARM
Jun 12 15:45:04 debian-BB1 kernel: [ 256.112091] Modules linked in: leds_pwm smsc95xx usbnet gpio_keys rtc_twl omap_aes uio_pdrv_genirq uio
Jun 12 15:45:04 debian-BB1 kernel: [ 256.122863] CPU: 0 PID: 25 Comm: irq/77-48060000 Not tainted 3.13.3-armv7-x10 #1
Jun 12 15:45:04 debian-BB1 kernel: [ 256.131225] task: df1bcb00 ti: df1c6000 task.ti: df1c6000
Jun 12 15:45:04 debian-BB1 kernel: [ 256.137359] PC is at omap_i2c_isr_thread+0x38/0x378
Jun 12 15:45:04 debian-BB1 kernel: [ 256.142913] LR is at omap_i2c_isr_thread+0x10/0x378
Jun 12 15:45:04 debian-BB1 kernel: [ 256.148437] pc : [] lr : [] psr: 60000093
Jun 12 15:45:04 debian-BB1 kernel: [ 256.148437] sp : df1c7f08 ip : 00000000 fp : 00000001
Jun 12 15:45:04 debian-BB1 kernel: [ 256.161376] r10: 00000010 r9 : 00000004 r8 : 00000266
Jun 12 15:45:04 debian-BB1 kernel: [ 256.167297] r7 : df1c6000 r6 : 60000013 r5 : 00000065 r4 : df1b1410
Jun 12 15:45:04 debian-BB1 kernel: [ 256.174652] r3 : fa060004 r2 : fa060000 r1 : 00000001 r0 : 60000013
Jun 12 15:45:04 debian-BB1 kernel: [ 256.182037] Flags: nZCv IRQs off FIQs on Mode SVC_32 ISA ARM Segment kernel
Jun 12 15:45:04 debian-BB1 kernel: [ 256.190399] Control: 10c5387d Table: 9e7e4019 DAC: 00000015
Jun 12 15:45:04 debian-BB1 kernel: [ 256.196899] Process irq/77-48060000 (pid: 25, stack limit = 0xdf1c6248)
Jun 12 15:45:04 debian-BB1 kernel: [ 256.204376] Stack: (0xdf1c7f08 to 0xdf1c8000)
Jun 12 15:45:04 debian-BB1 kernel: [ 256.209320] 7f00: df1a74c0 df007a80 df1c6000 df1c6000 df1a74e0 00000000
Jun 12 15:45:04 debian-BB1 kernel: [ 256.218597] 7f20: c007d78c c007d7a8 df007a80 df1a74c0 df1c6000 c007d524 00000000 c007d6d4
Jun 12 15:45:04 debian-BB1 kernel: [ 256.227844] 7f40: df1c7f50 df1a7500 00000000 df1a74c0 c007d48c 00000000 00000000 00000000
Jun 12 15:45:04 debian-BB1 kernel: [ 256.237091] 7f60: 00000000 c0058bd4 00900800 00000000 02e02408 df1a74c0 00000000 00000000
Jun 12 15:45:04 debian-BB1 kernel: [ 256.246337] 7f80: df1c7f80 df1c7f80 00000000 00000000 df1c7f90 df1c7f90 df1c7fac df1a7500
Jun 12 15:45:04 debian-BB1 kernel: [ 256.255584] 7fa0: c0058b0c 00000000 00000000 c000db98 00000000 00000000 00000000 00000000
Jun 12 15:45:04 debian-BB1 kernel: [ 256.264831] 7fc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
Jun 12 15:45:04 debian-BB1 kernel: [ 256.274108] 7fe0: 00000000 00000000 00000000 00000000 00000013 00000000 80200800 00050040
Jun 12 15:45:04 debian-BB1 kernel: [ 256.283386] [] (omap_i2c_isr_thread+0x38/0x378) from [] (irq_thread_fn+0x1c/0x40)
Jun 12 15:45:04 debian-BB1 kernel: [ 256.293823] [] (irq_thread_fn+0x1c/0x40) from [] (irq_thread+0x98/0x160)
Jun 12 15:45:04 debian-BB1 kernel: [ 256.303405] [] (irq_thread+0x98/0x160) from [] (kthread+0xc8/0xdc)
Jun 12 15:45:04 debian-BB1 kernel: [ 256.312377] [] (kthread+0xc8/0xdc) from [] (ret_from_fork+0x14/0x3c)
Jun 12 15:45:04 debian-BB1 kernel: [ 256.321533] Code: e5942008 e5d31001 e5943010 e0823311 (e1d320b0)
Jun 12 15:45:04 debian-BB1 kernel: [ 256.328430] —[ end trace 1fdabfaa8c4b6ef5 ]—
Jun 12 15:45:04 debian-BB1 kernel: [ 256.333740] In-band Error seen by MPU at address 0
Jun 12 15:45:04 debian-BB1 kernel: [ 256.339263] ------------[ cut here ]------------
Jun 12 15:45:04 debian-BB1 kernel: [ 256.344543] WARNING: CPU: 0 PID: 25 at drivers/bus/omap_l3_smx.c:162 omap3_l3_app_irq+0xd4/0x118()
Jun 12 15:45:04 debian-BB1 kernel: [ 256.354644] Modules linked in: leds_pwm smsc95xx usbnet gpio_keys rtc_twl omap_aes uio_pdrv_genirq uio
Jun 12 15:45:04 debian-BB1 kernel: [ 256.365386] CPU: 0 PID: 25 Comm: irq/77-48060000 Tainted: G D 3.13.3-armv7-x10 #1
Jun 12 15:45:04 debian-BB1 kernel: [ 256.374877] [] (unwind_backtrace+0x0/0xe0) from [] (show_stack+0x10/0x14)
Jun 12 15:45:04 debian-BB1 kernel: [ 256.384582] [] (show_stack+0x10/0x14) from [] (dump_stack+0x68/0x84)
Jun 12 15:45:04 debian-BB1 kernel: [ 256.393768] [] (dump_stack+0x68/0x84) from [] (warn_slowpath_common+0x64/0x84)
Jun 12 15:45:04 debian-BB1 kernel: [ 256.403930] [] (warn_slowpath_common+0x64/0x84) from [] (warn_slowpath_null+0x18/0x1c)
Jun 12 15:45:04 debian-BB1 kernel: [ 256.414855] [] (warn_slowpath_null+0x18/0x1c) from [] (omap3_l3_app_irq+0xd4/0x118)
Jun 12 15:45:04 debian-BB1 kernel: [ 256.425537] [] (omap3_l3_app_irq+0xd4/0x118) from [] (handle_irq_event_percpu+0x7c/0x230)
Jun 12 15:45:04 debian-BB1 kernel: [ 256.436767] [] (handle_irq_event_percpu+0x7c/0x230) from [] (handle_irq_event+0x44/0x64)
Jun 12 15:45:04 debian-BB1 kernel: [ 256.447875] [] (handle_irq_event+0x44/0x64) from [] (handle_level_irq+0xcc/0xf4)
Jun 12 15:45:04 debian-BB1 kernel: [ 256.458221] [] (handle_level_irq+0xcc/0xf4) from [] (generic_handle_irq+0x20/0x30)
Jun 12 15:45:05 debian-BB1 kernel: [ 256.468780] [] (generic_handle_irq+0x20/0x30) from [] (handle_IRQ+0x64/0x8c)
Jun 12 15:45:05 debian-BB1 kernel: [ 256.478729] [] (handle_IRQ+0x64/0x8c) from [] (omap3_intc_handle_irq+0x60/0x74)
Jun 12 15:45:05 debian-BB1 kernel: [ 256.488952] [] (omap3_intc_handle_irq+0x60/0x74) from [] (__irq_svc+0x40/0x50)
Jun 12 15:45:05 debian-BB1 kernel: [ 256.499053] Exception stack(0xdf1c7d10 to 0xdf1c7d58)
Jun 12 15:45:05 debian-BB1 kernel: [ 256.504791] 7d00: 00000000 0000001b df162f40 00000504
Jun 12 15:45:05 debian-BB1 kernel: [ 256.514038] 7d20: df1c2580 df1c6000 0000000b 00000000 00000001 00000008 c05a4ee4 00000000
Jun 12 15:45:05 debian-BB1 kernel: [ 256.523284] 7d40: 00000000 df1c7d58 c009a984 c009aa8c 40000113 ffffffff
Jun 12 15:45:05 debian-BB1 kernel: [ 256.530822] [] (__irq_svc+0x40/0x50) from [] (acct_collect+0x1ac/0x1b0)
Jun 12 15:45:05 debian-BB1 kernel: [ 256.540313] [] (acct_collect+0x1ac/0x1b0) from [] (do_exit+0x210/0x980)
Jun 12 15:45:05 debian-BB1 kernel: [ 256.549774] [] (do_exit+0x210/0x980) from [] (die+0x3a0/0x3f0)
Jun 12 15:45:05 debian-BB1 kernel: [ 256.558380] [] (die+0x3a0/0x3f0) from [] (do_DataAbort+0x84/0x98)
Jun 12 15:45:05 debian-BB1 kernel: [ 256.567230] [] (do_DataAbort+0x84/0x98) from [] (__dabt_svc+0x38/0x60)
Jun 12 15:45:05 debian-BB1 kernel: [ 256.576568] Exception stack(0xdf1c7ec0 to 0xdf1c7f08)
Jun 12 15:45:05 debian-BB1 kernel: [ 256.582305] 7ec0: 60000013 00000001 fa060000 fa060004 df1b1410 00000065 60000013 df1c6000
Jun 12 15:45:05 debian-BB1 kernel: [ 256.591552] 7ee0: 00000266 00000004 00000010 00000001 00000000 df1c7f08 c05a4ebc c05a4ee4
Jun 12 15:45:05 debian-BB1 kernel: [ 256.600799] 7f00: 60000093 ffffffff
Jun 12 15:45:05 debian-BB1 kernel: [ 256.604797] [] (__dabt_svc+0x38/0x60) from [] (omap_i2c_isr_thread+0x38/0x378)
Jun 12 15:45:05 debian-BB1 kernel: [ 256.614959] [] (omap_i2c_isr_thread+0x38/0x378) from [] (irq_thread_fn+0x1c/0x40)
Jun 12 15:45:05 debian-BB1 kernel: [ 256.625366] [] (irq_thread_fn+0x1c/0x40) from [] (irq_thread+0x98/0x160)
Jun 12 15:45:05 debian-BB1 kernel: [ 256.634918] [] (irq_thread+0x98/0x160) from [] (kthread+0xc8/0xdc)
Jun 12 15:45:05 debian-BB1 kernel: [ 256.643920] [] (kthread+0xc8/0xdc) from [] (ret_from_fork+0x14/0x3c)
Jun 12 15:45:05 debian-BB1 kernel: [ 256.653045] —[ end trace 1fdabfaa8c4b6ef6 ]—
Jun 12 15:45:05 debian-BB1 kernel: [ 256.660217] Unable to handle kernel paging request at virtual address ffffffec
Jun 12 15:45:05 debian-BB1 kernel: [ 256.669799] pgd = c0004000
Jun 12 15:45:05 debian-BB1 kernel: [ 256.674163] [ffffffec] *pgd=9fefd821, *pte=00000000, *ppte=00000000
Jun 12 15:45:05 debian-BB1 kernel: [ 256.682922] Internal error: Oops: 17 [#2] SMP ARM
Jun 12 15:45:05 debian-BB1 kernel: [ 256.688232] Modules linked in: leds_pwm smsc95xx usbnet gpio_keys rtc_twl omap_aes uio_pdrv_genirq uio
Jun 12 15:45:05 debian-BB1 kernel: [ 256.699005] CPU: 0 PID: 25 Comm: irq/77-48060000 Tainted: G D W 3.13.3-armv7-x10 #1
Jun 12 15:45:05 debian-BB1 kernel: [ 256.708435] task: df1bcb00 ti: df1c6000 task.ti: df1c6000
Jun 12 15:45:05 debian-BB1 kernel: [ 256.714569] PC is at kthread_data+0x4/0xc
Jun 12 15:45:05 debian-BB1 kernel: [ 256.719146] LR is at irq_thread_dtor+0x50/0xb8
Jun 12 15:45:05 debian-BB1 kernel: [ 256.724212] pc : [] lr : [] psr: 20000113
Jun 12 15:45:05 debian-BB1 kernel: [ 256.724212] sp : df1c7d48 ip : 00000000 fp : 00000000
Jun 12 15:45:05 debian-BB1 kernel: [ 256.737152] r10: c05a4ee4 r9 : 00000008 r8 : 00000001
Jun 12 15:45:05 debian-BB1 kernel: [ 256.743041] r7 : c0c3b0b4 r6 : 00000000 r5 : df1bcb00 r4 : df1bcb00
Jun 12 15:45:05 debian-BB1 kernel: [ 256.750427] r3 : 00000000 r2 : df1c7d48 r1 : 00000000 r0 : df1bcb00
Jun 12 15:45:05 debian-BB1 kernel: [ 256.757812] Flags: nzCv IRQs on FIQs on Mode SVC_32 ISA ARM Segment user
Jun 12 15:45:05 debian-BB1 kernel: [ 256.765869] Control: 10c5387d Table: 9e7e4019 DAC: 00000015
Jun 12 15:45:05 debian-BB1 kernel: [ 256.772369] Process irq/77-48060000 (pid: 25, stack limit = 0xdf1c6248)
Jun 12 15:45:05 debian-BB1 kernel: [ 256.779846] Stack: (0xdf1c7d48 to 0xdf1c8000)
Jun 12 15:45:05 debian-BB1 kernel: [ 256.784790] 7d40: c007d6d4 df1bcb00 df1bcf04 c00562f8 000000a1 df1bcb00
Jun 12 15:45:05 debian-BB1 kernel: [ 256.794067] 7d60: 00000000 c05a4ee6 df1c7df2 c003e0b0 00000000 c07909dc c09e687c df1c7d94
Jun 12 15:45:05 debian-BB1 kernel: [ 256.803314] 7d80: 8c4b6ef5 df1c7ec0 0000000b c05a4ee6 df1c7df2 00000000 00000008 c05a4ee4
Jun 12 15:45:05 debian-BB1 kernel: [ 256.812561] 7da0: 00000000 c00114c0 df1c6248 0000000b 00000000 c09d84b7 00000000 60000193
Jun 12 15:45:05 debian-BB1 kernel: [ 256.821838] 7dc0: 6500020f 32343935 20383030 33643565 31303031 39356520 31303334 30652030
Jun 12 15:45:05 debian-BB1 kernel: [ 256.831085] 7de0: 33333238 28203131 33643165 30623032 00002029 c07909dc c09d9d39 00001028
Jun 12 15:45:05 debian-BB1 kernel: [ 256.840332] 7e00: c0b9e358 fa060004 df1c7ec0 00000266 00000004 00000010 00000001 c00083d8
Jun 12 15:45:05 debian-BB1 kernel: [ 256.849578] 7e20: 00000000 60000193 00000007 00000000 00000000 fa060004 c11460c0 df1bcc98
Jun 12 15:45:05 debian-BB1 kernel: [ 256.858856] 7e40: 2e451771 00000037 00000008 c1146108 df070b48 df070b48 c11460c0 df1a74e0
Jun 12 15:45:05 debian-BB1 kernel: [ 256.868103] 7e60: c0009718 df080000 00000002 c079d414 df08001c df1bcb00 ddbda1c0 00000000
Jun 12 15:45:05 debian-BB1 kernel: [ 256.877349] 7e80: c0b8e0c0 df1bcb00 ddbda1c0 00000000 df1c7f34 c0798780 df1c7ed0 80000093
Jun 12 15:45:05 debian-BB1 kernel: [ 256.886627] 7ea0: df1a74e0 df1b1420 df1b142c c05a4ee4 60000093 ffffffff df1c7ef4 c079bad8
Jun 12 15:45:05 debian-BB1 kernel: [ 256.895874] 7ec0: 60000013 00000001 fa060000 fa060004 df1b1410 00000065 60000013 df1c6000
Jun 12 15:45:05 debian-BB1 kernel: [ 256.905120] 7ee0: 00000266 00000004 00000010 00000001 00000000 df1c7f08 c05a4ebc c05a4ee4
Jun 12 15:45:05 debian-BB1 kernel: [ 256.914398] 7f00: 60000093 ffffffff df1a74c0 df007a80 df1c6000 df1c6000 df1a74e0 00000000
Jun 12 15:45:05 debian-BB1 kernel: [ 256.923645] 7f20: c007d78c c007d7a8 df007a80 df1a74c0 df1c6000 c007d524 00000000 c007d6d4
Jun 12 15:45:05 debian-BB1 kernel: [ 256.932891] 7f40: df1c7f50 df1a7500 00000000 df1a74c0 c007d48c 00000000 00000000 00000000
Jun 12 15:45:05 debian-BB1 kernel: [ 256.942169] 7f60: 00000000 c0058bd4 00900800 00000000 02e02408 df1a74c0 00000000 00000000
Jun 12 15:45:05 debian-BB1 kernel: [ 256.951416] 7f80: df1c7f80 df1c7f80 00000001 00010001 df1c7f90 df1c7f90 df1c7fac df1a7500
Jun 12 15:45:05 debian-BB1 kernel: [ 256.960662] 7fa0: c0058b0c 00000000 00000000 c000db98 00000000 00000000 00000000 00000000
Jun 12 15:45:05 debian-BB1 kernel: [ 256.969909] 7fc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
Jun 12 15:45:05 debian-BB1 kernel: [ 256.979156] 7fe0: 00000000 00000000 00000000 00000000 00000013 00000000 80200800 00050040
Jun 12 15:45:05 debian-BB1 kernel: [ 256.988433] [] (kthread_data+0x4/0xc) from [] (irq_thread_dtor+0x50/0xb8)
Jun 12 15:45:05 debian-BB1 kernel: [ 256.998107] [] (irq_thread_dtor+0x50/0xb8) from [] (task_work_run+0xb8/0xcc)
Jun 12 15:45:05 debian-BB1 kernel: [ 257.008056] [] (task_work_run+0xb8/0xcc) from [] (do_exit+0x450/0x980)
Jun 12 15:45:05 debian-BB1 kernel: [ 257.017456] [] (do_exit+0x450/0x980) from [] (die+0x3a0/0x3f0)
Jun 12 15:45:05 debian-BB1 kernel: [ 257.026031] [] (die+0x3a0/0x3f0) from [] (do_DataAbort+0x84/0x98)
Jun 12 15:45:05 debian-BB1 kernel: [ 257.034912] [] (do_DataAbort+0x84/0x98) from [] (__dabt_svc+0x38/0x60)
Jun 12 15:45:05 debian-BB1 kernel: [ 257.044219] Exception stack(0xdf1c7ec0 to 0xdf1c7f08)
Jun 12 15:45:05 debian-BB1 kernel: [ 257.049987] 7ec0: 60000013 00000001 fa060000 fa060004 df1b1410 00000065 60000013 df1c6000
Jun 12 15:45:05 debian-BB1 kernel: [ 257.059234] 7ee0: 00000266 00000004 00000010 00000001 00000000 df1c7f08 c05a4ebc c05a4ee4
Jun 12 15:45:05 debian-BB1 kernel: [ 257.068450] 7f00: 60000093 ffffffff
Jun 12 15:45:05 debian-BB1 kernel: [ 257.072479] [] (__dabt_svc+0x38/0x60) from [] (omap_i2c_isr_thread+0x38/0x378)
Jun 12 15:45:05 debian-BB1 kernel: [ 257.082611] [] (omap_i2c_isr_thread+0x38/0x378) from [] (irq_thread_fn+0x1c/0x40)
Jun 12 15:45:05 debian-BB1 kernel: [ 257.093048] [] (irq_thread_fn+0x1c/0x40) from [] (irq_thread+0x98/0x160)
Jun 12 15:45:05 debian-BB1 kernel: [ 257.102600] [] (irq_thread+0x98/0x160) from [] (kthread+0xc8/0xdc)
Jun 12 15:45:05 debian-BB1 kernel: [ 257.111572] [] (kthread+0xc8/0xdc) from [] (ret_from_fork+0x14/0x3c)
Jun 12 15:45:05 debian-BB1 kernel: [ 257.120727] Code: e513001c e7e00150 e12fff1e e5903290 (e5130014)
Jun 12 15:45:05 debian-BB1 kernel: [ 257.129425] —[ end trace 1fdabfaa8c4b6ef7 ]—
Jun 12 15:45:05 debian-BB1 kernel: [ 257.135742] Fixing recursive fault but reboot is needed!
From now on it will go on with the
[ 236.979858] omap_i2c 48060000.i2c: controller timed out