BB AI task blocked

I see

[ 242.657917] INFO: task kworker/0:0:3 blocked for more than 120 seconds.
[ 242.665199] Tainted: G W O 4.14.108-ti-rt-r122 #1
[ 242.673861] “echo 0 > /proc/sys/kernel/hung_task_timeout_secs” disables this message.
[ 242.683700] INFO: task kworker/u4:0:5 blocked for more than 120 seconds.
[ 242.691800] Tainted: G W O 4.14.108-ti-rt-r122 #1
[ 242.698581] “echo 0 > /proc/sys/kernel/hung_task_timeout_secs” disables this message.
[ 242.707629] INFO: task kworker/0:2:142 blocked for more than 120 seconds.
[ 242.715996] Tainted: G W O 4.14.108-ti-rt-r122 #1
[ 242.722650] “echo 0 > /proc/sys/kernel/hung_task_timeout_secs” disables this message.
[ 242.731642] INFO: task kworker/u4:2:244 blocked for more than 120 seconds.
[ 242.739737] Tainted: G W O 4.14.108-ti-rt-r122 #1
[ 242.746484] “echo 0 > /proc/sys/kernel/hung_task_timeout_secs” disables this message.
[ 242.755801] INFO: task systemd-udevd:486 blocked for more than 120 seconds.
[ 242.763672] Tainted: G W O 4.14.108-ti-rt-r122 #1
[ 242.770142] “echo 0 > /proc/sys/kernel/hung_task_timeout_secs” disables this message.
[ 242.783125] INFO: task systemd-udevd:487 blocked for more than 120 seconds.
[ 242.790899] Tainted: G W O 4.14.108-ti-rt-r122 #1
[ 242.809218] “echo 0 > /proc/sys/kernel/hung_task_timeout_secs” disables this message.
[ 242.817941] INFO: task systemd-udevd:489 blocked for more than 120 seconds.
[ 242.825040] Tainted: G W O 4.14.108-ti-rt-r122 #1
[ 242.835339] “echo 0 > /proc/sys/kernel/hung_task_timeout_secs” disables this message.
[ 242.847988] INFO: task systemd-udevd:493 blocked for more than 120 seconds.
[ 242.855104] Tainted: G W O 4.14.108-ti-rt-r122 #1
[ 242.861346] “echo 0 > /proc/sys/kernel/hung_task_timeout_secs” disables this message.
[ 242.870140] INFO: task connmand:533 blocked for more than 120 seconds.
[ 242.876735] Tainted: G W O 4.14.108-ti-rt-r122 #1
[ 242.882991] “echo 0 > /proc/sys/kernel/hung_task_timeout_secs” disables this message.
[ 242.894217] INFO: task brcmf_wdog/mmc2:741 blocked for more than 120 seconds.
[ 242.901475] Tainted: G W O 4.14.108-ti-rt-r122 #1
[ 242.907741] “echo 0 > /proc/sys/kernel/hung_task_timeout_secs” disables this message.

on my console not long after boot. Should I be concerned?

Has 4.14.108-ti-rt-r122 been tested on BB AI?

Is there a different PREMPT_RT kernel recommended for the BB AI?

Thanks,
Andrew

debian@beaglebone:/opt/scripts/tools$ uname -a
Linux beaglebone 4.14.108-ti-r113 #1 SMP PREEMPT Wed Jul 31 00:01:10 UTC 2019 armv7l GNU/Linux

Does not seem to have the same issue.

Similar observed with

debian@ai:~$ uname -a
Linux ai 4.19.73-ti-rt-r29 #1stretch SMP PREEMPT RT Wed Oct 9 21:13:08 UTC 2019 armv7l GNU/Linux

[ 484.306447] INFO: task kworker/u4:0:7 blocked for more than 120 seconds.
[ 484.313237] Tainted: G W O 4.19.73-ti-rt-r29 #1stretch
[ 484.320145] “echo 0 > /proc/sys/kernel/hung_task_timeout_secs” disables this message.
[ 484.329172] INFO: task kworker/1:1:66 blocked for more than 120 seconds.
[ 484.336062] Tainted: G W O 4.19.73-ti-rt-r29 #1stretch
[ 484.342924] “echo 0 > /proc/sys/kernel/hung_task_timeout_secs” disables this message.
[ 484.355157] INFO: task kworker/u5:0:68 blocked for more than 120 seconds.
[ 484.362016] Tainted: G W O 4.19.73-ti-rt-r29 #1stretch
[ 484.368869] “echo 0 > /proc/sys/kernel/hung_task_timeout_secs” disables this message.

Does anyone know anything about this? I’m seeing similar behavior on kernel 4.14.108-ti-rt-r134. I can’t even ssh in anymore because something is hung at startup (I used to be able to, but I’m not sure why). After booting with a known good microSD card and checking kern.log, I see this:

[ 242.872658] INFO: task systemd-udevd:351 blocked for more than 120 seconds.
[ 242.879698] Tainted: G W O 4.14.108-ti-rt-r134 #1stretch
[ 242.886558] “echo 0 > /proc/sys/kernel/hung_task_timeout_secs” disables this message.
[ 242.894551] systemd-udevd D 0 351 332 0x00000101
[ 242.894623] [] (__schedule) from [] (schedule+0x64/0x108)
[ 242.894661] [] (schedule) from [] (__mmc_claim_host+0xb4/0x1d0)
[ 242.894700] [] (__mmc_claim_host) from [] (sdio_claim_host+0x2c/0x44)
[ 242.894737] [] (sdio_claim_host) from [] (sdio_bus_probe+0x80/0x12c)
[ 242.894783] [] (sdio_bus_probe) from [] (driver_probe_device+0x2d4/0x480)
[ 242.894826] [] (driver_probe_device) from [] (__driver_attach+0x10c/0x128)
[ 242.894867] [] (__driver_attach) from [] (bus_for_each_dev+0x8c/0xd0)
[ 242.894907] [] (bus_for_each_dev) from [] (driver_attach+0x2c/0x30)
[ 242.894945] [] (driver_attach) from [] (bus_add_driver+0x1b8/0x278)
[ 242.894986] [] (bus_add_driver) from [] (driver_register+0x88/0x104)
[ 242.895024] [] (driver_register) from [] (sdio_register_driver+0x34/0x38)
[ 242.895082] [] (sdio_register_driver) from [] (btsdio_init+0x2c/0x1000 [btsdio])
[ 242.895152] [] (btsdio_init [btsdio]) from [] (do_one_initcall+0x64/0x19c)
[ 242.895196] [] (do_one_initcall) from [] (do_init_module+0x74/0x210)
[ 242.895238] [] (do_init_module) from [] (load_module+0x22a0/0x29f8)
[ 242.895324] [] (load_module) from [] (SyS_init_module+0x1a4/0x1e0)
[ 242.895369] [] (SyS_init_module) from [] (__sys_trace_return+0x0/0x10)
[ 242.895424] INFO: task connmand:526 blocked for more than 120 seconds.
[ 242.902076] Tainted: G W O 4.14.108-ti-rt-r134 #1stretch
[ 242.908948] “echo 0 > /proc/sys/kernel/hung_task_timeout_secs” disables this message.
[ 242.916849] connmand D 0 526 1 0x00000000
[ 242.916920] [] (__schedule) from [] (schedule+0x64/0x108)
[ 242.916958] [] (schedule) from [] (__mmc_claim_host+0xb4/0x1d0)
[ 242.916995] [] (__mmc_claim_host) from [] (sdio_claim_host+0x2c/0x44)
[ 242.917206] [] (sdio_claim_host) from [] (brcmf_sdio_bus_txctl+0x134/0x1a0 [brcmfmac])
[ 242.917551] [] (brcmf_sdio_bus_txctl [brcmfmac]) from [] (brcmf_proto_bcdc_msg+0xb4/0xb8 [brcmfmac])
[ 242.917895] [] (brcmf_proto_bcdc_msg [brcmfmac]) from [] (brcmf_proto_bcdc_set_dcmd+0x38/0x100 [brcmfmac])
[ 242.918234] [] (brcmf_proto_bcdc_set_dcmd [brcmfmac]) from [] (brcmf_fil_cmd_data+0x88/0xb4 [brcmfmac])
[ 242.918572] [] (brcmf_fil_cmd_data [brcmfmac]) from [] (brcmf_fil_iovar_data_set+0x94/0xb8 [brcmfmac])
[ 242.918909] [] (brcmf_fil_iovar_data_set [brcmfmac]) from [] (brcmf_fil_iovar_int_set+0x3c/0x58 [brcmfmac])
[ 242.919241] [] (brcmf_fil_iovar_int_set [brcmfmac]) from [] (brcmf_configure_arp_nd_offload+0x50/0x70 [brcmfmac])
[ 242.919754] [] (brcmf_configure_arp_nd_offload [brcmfmac]) from [] (brcmf_cfg80211_up+0x2ec/0x3a4 [brcmfmac])
[ 242.920108] [] (brcmf_cfg80211_up [brcmfmac]) from [] (brcmf_netdev_open+0xac/0x128 [brcmfmac])
[ 242.920319] [] (brcmf_netdev_open [brcmfmac]) from [] (__dev_open+0xe4/0x15c)
[ 242.920368] [] (__dev_open) from [] (__dev_change_flags+0x1a4/0x1d0)
[ 242.920412] [] (__dev_change_flags) from [] (dev_change_flags+0x28/0x58)
[ 242.920451] [] (dev_change_flags) from [] (devinet_ioctl+0x704/0x7cc)
[ 242.920489] [] (devinet_ioctl) from [] (inet_ioctl+0x1a4/0x1d0)
[ 242.920532] [] (inet_ioctl) from [] (sock_ioctl+0x15c/0x300)
[ 242.920571] [] (sock_ioctl) from [] (do_vfs_ioctl+0xc0/0x94c)
[ 242.920604] [] (do_vfs_ioctl) from [] (SyS_ioctl+0x7c/0x8c)
[ 242.920651] [] (SyS_ioctl) from [] (ret_fast_syscall+0x0/0x5c)

It's our "lovely" non-mainline "brcmfmac" driver.. It' fub-bar'd for RT..

v4.14.x uses this 150+ patchset: https://community.cypress.com/docs/DOC-19000

Regards,

That’s the driver for Wifi chip? How can I disable that driver and anything trying to use it?

blacklist it ..

/etc/modprobe.d/brcmfmac-blacklist.conf

blacklist brcmfmac

Regards,

That did it. Thank you, Robert!