Pipeline for imx219 on BB AI-64

I need some help to get a pipeline for an imx219 on the BB AI-64 configured. I want to have an output on the screen with maybe autovideosink.

I’m using this Debian 11.3 image: https://debian.beagle.cc/images/bbai64-debian-11.3-xfce-arm64-2022-06-14-10gb.img.xz

I added the imx219-overlays in /boot/firmware/extlinux/extlinux.conf:

...
fdtdir /
fdtoverlays /overlays/BBAI64-CSI0-imx219.dtbo /overlays/BBAI64-CSI1-imx219.dtbo
...

I have read at RPi Cam V2 (Sony IMX219) w/ Edge AI Demos - #6 by RobertCNelson that there are newer overlays available, but I got so many warnings when I compiled it, that I have not installed them yet.

There are some errors in my dmesg-output, but the imx219 driver gets loaded:

$dmesg
[    0.000000] Booting Linux on physical CPU 0x0000000000 [0x411fd080]
[    0.000000] Linux version 5.10.162-ti-arm64-r99 (voodoo@bbai64-02) (gcc (Debian 10.2.1-6) 10.2.1 20210110, GNU ld (GNU Binutils for Debian) 2.35.2) #1bullseye SMP Fri Apr 7 01:02:04 UTC 2023
[    0.000000] Machine model: BeagleBoard.org BeagleBone AI-64
[    0.000000] earlycon: ns16550a0 at MMIO32 0x0000000002800000 (options '')
[    0.000000] printk: bootconsole [ns16550a0] enabled
[    0.000000] efi: UEFI not found.
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000a0000000, size 1 MiB
[    0.000000] OF: reserved mem: initialized node vision-apps-r5f-dma-memory@a0000000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000a0100000, size 15 MiB
[    0.000000] OF: reserved mem: initialized node vision-apps-r5f-memory@a0100000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000a1000000, size 1 MiB
[    0.000000] OF: reserved mem: initialized node vision-apps-r5f-dma-memory@a1000000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000a1100000, size 15 MiB
[    0.000000] OF: reserved mem: initialized node vision-apps-r5f-memory@a1100000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000a2000000, size 1 MiB
[    0.000000] OF: reserved mem: initialized node vision-apps-r5f-dma-memory@a2000000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000a2100000, size 31 MiB
[    0.000000] OF: reserved mem: initialized node vision-apps-r5f-memory@a2100000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000a4000000, size 1 MiB
[    0.000000] OF: reserved mem: initialized node vision-apps-r5f-dma-memory@a4000000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000a4100000, size 31 MiB
[    0.000000] OF: reserved mem: initialized node vision-apps-r5f-memory@a4100000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000a6000000, size 1 MiB
[    0.000000] OF: reserved mem: initialized node vision-apps-r5f-dma-memory@a6000000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000a6100000, size 15 MiB
[    0.000000] OF: reserved mem: initialized node vision-apps-r5f-memory@a6100000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000a7000000, size 1 MiB
[    0.000000] OF: reserved mem: initialized node vision-apps-r5f-dma-memory@a7000000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000a7100000, size 15 MiB
[    0.000000] OF: reserved mem: initialized node vision-apps-r5f-memory@a7100000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000a8000000, size 1 MiB
[    0.000000] OF: reserved mem: initialized node vision-apps-c66-dma-memory@a8000000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000a8100000, size 15 MiB
[    0.000000] OF: reserved mem: initialized node vision-apps-c66-memory@a8100000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000a9000000, size 1 MiB
[    0.000000] OF: reserved mem: initialized node vision-apps-c66-dma-memory@a9000000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000a9100000, size 15 MiB
[    0.000000] OF: reserved mem: initialized node vision-apps-c66-memory@a9100000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000aa000000, size 1 MiB
[    0.000000] OF: reserved mem: initialized node vision-apps-c71-dma-memory@aa000000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000aa100000, size 79 MiB
[    0.000000] OF: reserved mem: initialized node vision-apps-c71-memory@aa100000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000b2000000, size 96 MiB
[    0.000000] OF: reserved mem: initialized node vision-apps-dma-memory@b2000000, compatible id shared-dma-pool
[    0.000000] OF: reserved mem: initialized node vision_apps_shared-memories, compatible id dma-heap-carveout
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000d8000000, size 560 MiB
[    0.000000] OF: reserved mem: initialized node vision-apps-core-heap-memory-lo@d8000000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000fb000000, size 8 MiB
[    0.000000] OF: reserved mem: initialized node vision-apps-r5f-virtual-eth-queues@fb000000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x00000000fb800000, size 24 MiB
[    0.000000] OF: reserved mem: initialized node vision-apps-r5f-virtual-eth-buffers@fb800000, compatible id shared-dma-pool
[    0.000000] Reserved memory: created DMA memory pool at 0x0000000880000000, size 256 MiB
[    0.000000] OF: reserved mem: initialized node vision-apps-core-heap-memory-hi@880000000, compatible id shared-dma-pool
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x0000000080000000-0x00000000ffffffff]
[    0.000000]   DMA32    empty
[    0.000000]   Normal   [mem 0x0000000100000000-0x00000008ffffffff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000080000000-0x000000009e7fffff]
[    0.000000]   node   0: [mem 0x000000009e800000-0x00000000aeffffff]
[    0.000000]   node   0: [mem 0x00000000af000000-0x00000000afffffff]
[    0.000000]   node   0: [mem 0x00000000b0000000-0x00000000b7ffffff]
[    0.000000]   node   0: [mem 0x00000000b8000000-0x00000000d7ffffff]
[    0.000000]   node   0: [mem 0x00000000d8000000-0x00000000fcffffff]
[    0.000000]   node   0: [mem 0x00000000fd000000-0x00000000ffffffff]
[    0.000000]   node   0: [mem 0x0000000880000000-0x000000088fffffff]
[    0.000000]   node   0: [mem 0x0000000890000000-0x00000008ffffffff]
[    0.000000] Initmem setup node 0 [mem 0x0000000080000000-0x00000008ffffffff]
[    0.000000] On node 0 totalpages: 1048576
[    0.000000]   DMA zone: 8192 pages used for memmap
[    0.000000]   DMA zone: 0 pages reserved
[    0.000000]   DMA zone: 524288 pages, LIFO batch:63
[    0.000000]   Normal zone: 8192 pages used for memmap
[    0.000000]   Normal zone: 524288 pages, LIFO batch:63
[    0.000000] cma: Reserved 144 MiB at 0x0000000095800000
[    0.000000] psci: probing for conduit method from DT.
[    0.000000] psci: PSCIv1.1 detected in firmware.
[    0.000000] psci: Using standard PSCI v0.2 function IDs
[    0.000000] psci: Trusted OS migration not required
[    0.000000] psci: SMC Calling Convention v1.2
[    0.000000] percpu: Embedded 32 pages/cpu s92952 r8192 d29928 u131072
[    0.000000] pcpu-alloc: s92952 r8192 d29928 u131072 alloc=32*4096
[    0.000000] pcpu-alloc: [0] 0 [0] 1 
[    0.000000] Detected PIPT I-cache on CPU0
[    0.000000] CPU features: detected: GIC system register CPU interface
[    0.000000] CPU features: detected: EL2 vector hardening
[    0.000000] CPU features: detected: ARM errata 1165522, 1319367, or 1530923
[    0.000000] CPU features: detected: Spectre-BHB
[    0.000000] CPU features: detected: ARM erratum 1742098
[    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 1032192
[    0.000000] Kernel command line: console=ttyS2,115200n8 earlycon=ns16550a,mmio32,0x02800000 root=/dev/mmcblk1p2 ro rootfstype=ext4 rootwait net.ifnames=0
[    0.000000] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)
[    0.000000] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)
[    0.000000] mem auto-init: stack:off, heap alloc:on, heap free:off
[    0.000000] software IO TLB: mapped [mem 0x0000000091800000-0x0000000095800000] (64MB)
[    0.000000] Memory: 2063176K/4194304K available (17216K kernel code, 2268K rwdata, 5356K rodata, 3776K init, 724K bss, 1983672K reserved, 147456K cma-reserved)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=2, Nodes=1
[    0.000000] rcu: Hierarchical RCU implementation.
[    0.000000] rcu: 	RCU event tracing is enabled.
[    0.000000] rcu: 	RCU restricting CPUs from NR_CPUS=256 to nr_cpu_ids=2.
[    0.000000] 	Tracing variant of Tasks RCU enabled.
[    0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.
[    0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=2
[    0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0
[    0.000000] GICv3: GIC: Using split EOI/Deactivate mode
[    0.000000] GICv3: 960 SPIs implemented
[    0.000000] GICv3: 0 Extended SPIs implemented
[    0.000000] GICv3: Distributor has no Range Selector support
[    0.000000] GICv3: 16 PPIs implemented
[    0.000000] GICv3: CPU0: found redistributor 0 region 0:0x0000000001900000
[    0.000000] ITS [mem 0x01820000-0x0182ffff]
[    0.000000] GIC: enabling workaround for ITS: Socionext Synquacer pre-ITS
[    0.000000] ITS@0x0000000001820000: Devices Table too large, reduce ids 20->19
[    0.000000] ITS@0x0000000001820000: allocated 524288 Devices @890800000 (flat, esz 8, psz 64K, shr 0)
[    0.000000] ITS: using cache flushing for cmd queue
[    0.000000] GICv3: using LPI property table @0x00000008900d0000
[    0.000000] GIC: using cache flushing for LPI property table
[    0.000000] GICv3: CPU0: using allocated LPI pending table @0x00000008900e0000
[    0.000000] arch_timer: cp15 timer(s) running at 200.00MHz (phys).
[    0.000000] clocksource: arch_sys_counter: mask: 0xffffffffffffff max_cycles: 0x2e2049d3e8, max_idle_ns: 440795210634 ns
[    0.000002] sched_clock: 56 bits at 200MHz, resolution 5ns, wraps every 4398046511102ns
[    0.008567] Console: colour dummy device 80x25
[    0.013134] Calibrating delay loop (skipped), value calculated using timer frequency.. 400.00 BogoMIPS (lpj=800000)
[    0.023803] pid_max: default: 32768 minimum: 301
[    0.028650] LSM: Security Framework initializing
[    0.033388] Yama: becoming mindful.
[    0.037016] AppArmor: AppArmor initialized
[    0.041201] TOMOYO Linux initialized
[    0.044918] Mount-cache hash table entries: 8192 (order: 4, 65536 bytes, linear)
[    0.052496] Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes, linear)
[    0.061570] rcu: Hierarchical SRCU implementation.
[    0.067088] Platform MSI: msi-controller@1820000 domain created
[    0.073554] PCI/MSI: /bus@100000/interrupt-controller@1800000/msi-controller@1820000 domain created
[    0.082945] EFI services will not be available.
[    0.087825] smp: Bringing up secondary CPUs ...
[    0.093131] Detected PIPT I-cache on CPU1
[    0.093153] GICv3: CPU1: found redistributor 1 region 0:0x0000000001920000
[    0.093164] GICv3: CPU1: using allocated LPI pending table @0x00000008900f0000
[    0.093199] CPU1: Booted secondary processor 0x0000000001 [0x411fd080]
[    0.093257] smp: Brought up 1 node, 2 CPUs
[    0.122600] SMP: Total of 2 processors activated.
[    0.127404] CPU features: detected: 32-bit EL0 Support
[    0.132652] CPU features: detected: CRC32 instructions
[    0.137898] CPU features: detected: 32-bit EL1 Support
[    0.162900] CPU: All CPU(s) started at EL2
[    0.167126] alternatives: patching kernel code
[    0.172372] devtmpfs: initialized
[    0.187933] KASLR disabled due to lack of seed
[    0.192619] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
[    0.202601] futex hash table entries: 512 (order: 3, 32768 bytes, linear)
[    0.211778] pinctrl core: initialized pinctrl subsystem
[    0.217477] DMI not present or invalid.
[    0.221768] NET: Registered protocol family 16
[    0.227053] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations
[    0.234361] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations
[    0.242412] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations
[    0.250526] audit: initializing netlink subsys (disabled)
[    0.256221] audit: type=2000 audit(0.168:1): state=initialized audit_enabled=0 res=1
[    0.256500] thermal_sys: Registered thermal governor 'fair_share'
[    0.264140] thermal_sys: Registered thermal governor 'bang_bang'
[    0.270365] thermal_sys: Registered thermal governor 'step_wise'
[    0.276499] thermal_sys: Registered thermal governor 'user_space'
[    0.282633] thermal_sys: Registered thermal governor 'power_allocator'
[    0.289518] hw-breakpoint: found 6 breakpoint and 4 watchpoint registers.
[    0.303161] ASID allocator initialised with 65536 entries
[    0.332635] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages
[    0.339494] HugeTLB registered 32.0 MiB page size, pre-allocated 0 pages
[    0.346341] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages
[    0.353187] HugeTLB registered 64.0 KiB page size, pre-allocated 0 pages
[    0.361007] cryptd: max_cpu_qlen set to 1000
[    0.367056] raid6: skip pq benchmark and using algorithm neonx8
[    0.373157] raid6: using neon recovery algorithm
[    0.378354] k3-chipinfo 43000014.chipid: Family:J721E rev:SR2.0 JTAGID[0x1bb6402f] Detected
[    0.387172] vsys_3v3: supplied by evm_12v0
[    0.391501] vsys_5v0: supplied by evm_12v0
[    0.396122] iommu: Default domain type: Translated 
[    0.401395] SCSI subsystem initialized
[    0.405344] usbcore: registered new interface driver usbfs
[    0.410980] usbcore: registered new interface driver hub
[    0.416417] usbcore: registered new device driver usb
[    0.422004] mc: Linux media interface: v0.10
[    0.426375] videodev: Linux video capture interface: v2.00
[    0.432032] pps_core: LinuxPPS API ver. 1 registered
[    0.437102] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    0.446438] PTP clock support registered
[    0.450456] EDAC MC: Ver: 3.0.0
[    0.454673] NetLabel: Initializing
[    0.458145] NetLabel:  domain hash size = 128
[    0.462609] NetLabel:  protocols = UNLABELED CIPSOv4 CALIPSO
[    0.468420] NetLabel:  unlabeled traffic allowed by default
[    0.474394] clocksource: Switched to clocksource arch_sys_counter
[    0.796243] VFS: Disk quotas dquot_6.6.0
[    0.800313] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    0.807431] FS-Cache: Loaded
[    0.810614] CacheFiles: Loaded
[    0.813981] AppArmor: AppArmor Filesystem Enabled
[    0.822227] Carveout Heap: Exported 512 MiB at 0x00000000b8000000
[    0.828568] NET: Registered protocol family 2
[    0.833313] IP idents hash table entries: 65536 (order: 7, 524288 bytes, linear)
[    0.842093] tcp_listen_portaddr_hash hash table entries: 2048 (order: 3, 32768 bytes, linear)
[    0.851094] TCP established hash table entries: 32768 (order: 6, 262144 bytes, linear)
[    0.859526] TCP bind hash table entries: 32768 (order: 7, 524288 bytes, linear)
[    0.867278] TCP: Hash tables configured (established 32768 bind 32768)
[    0.874236] MPTCP token hash table entries: 4096 (order: 4, 98304 bytes, linear)
[    0.881913] UDP hash table entries: 2048 (order: 4, 65536 bytes, linear)
[    0.888838] UDP-Lite hash table entries: 2048 (order: 4, 65536 bytes, linear)
[    0.896283] NET: Registered protocol family 1
[    0.901148] RPC: Registered named UNIX socket transport module.
[    0.907203] RPC: Registered udp transport module.
[    0.912006] RPC: Registered tcp transport module.
[    0.916808] RPC: Registered tcp NFSv4.1 backchannel transport module.
[    0.923390] NET: Registered protocol family 44
[    0.927937] PCI: CLS 0 bytes, default 64
[    0.932057] Trying to unpack rootfs image as initramfs...
[    1.221488] Freeing initrd memory: 15440K
[    1.226168] hw perfevents: enabled with armv8_cortex_a72 PMU driver, 7 counters available
[    1.234893] kvm [1]: IPA Size Limit: 44 bits
[    1.239638] kvm [1]: vgic-v2@6f020000
[    1.243397] kvm [1]: GIC system register CPU interface enabled
[    1.249392] kvm [1]: vgic interrupt IRQ9
[    1.253463] kvm [1]: Hyp mode initialized successfully
[    1.260990] Initialise system trusted keyrings
[    1.265634] workingset: timestamp_bits=46 max_order=20 bucket_order=0
[    1.274369] zbud: loaded
[    1.278150] NFS: Registering the id_resolver key type
[    1.283357] Key type id_resolver registered
[    1.287628] Key type id_legacy registered
[    1.291784] nfs4filelayout_init: NFSv4 File Layout Driver Registering...
[    1.298633] nfs4flexfilelayout_init: NFSv4 Flexfile Layout Driver Registering...
[    1.306203] jffs2: version 2.2. (NAND) (SUMMARY)  © 2001-2006 Red Hat, Inc.
[    1.313954] fuse: init (API version 7.32)
[    1.338078] xor: measuring software checksum speed
[    1.344222]    8regs           :  7934 MB/sec
[    1.349754]    32regs          :  9072 MB/sec
[    1.355419]    arm64_neon      :  8109 MB/sec
[    1.359866] xor: using function: 32regs (9072 MB/sec)
[    1.365030] Key type asymmetric registered
[    1.369216] Asymmetric key parser 'x509' registered
[    1.374222] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 243)
[    1.381859] io scheduler mq-deadline registered
[    1.388166] pinctrl-single 4301c000.pinctrl: 94 pins, size 376
[    1.394424] pinctrl-single 11c000.pinctrl: 173 pins, size 692
[    1.403785] ti-pat 31010000.pat: Found PAT Rev 1.0 with 16384 pages
[    1.410241] debugfs: Directory '31010000.pat' with parent 'regmap' already present!
[    1.418257] ti-pat 31011000.pat: Found PAT Rev 1.0 with 16384 pages
[    1.424676] debugfs: Directory '31011000.pat' with parent 'regmap' already present!
[    1.432627] ti-pat 31012000.pat: Found PAT Rev 1.0 with 16384 pages
[    1.439057] debugfs: Directory '31012000.pat' with parent 'regmap' already present!
[    1.447001] ti-pat 31013000.pat: Found PAT Rev 1.0 with 2048 pages
[    1.453331] debugfs: Directory '31013000.pat' with parent 'regmap' already present!
[    1.461287] ti-pat 31014000.pat: Found PAT Rev 1.0 with 2048 pages
[    1.467615] debugfs: Directory '31014000.pat' with parent 'regmap' already present!
[    1.477549] Serial: 8250/16550 driver, 10 ports, IRQ sharing enabled
[    1.486298] arm-smmu-v3 36600000.iommu: ias 48-bit, oas 48-bit (features 0x00001faf)
[    1.494630] arm-smmu-v3 36600000.iommu: allocated 65536 entries for cmdq
[    1.501718] arm-smmu-v3 36600000.iommu: allocated 32768 entries for evtq
[    1.510265] arm-smmu-v3 36600000.iommu: msi_domain absent - falling back to wired irqs
[    1.523278] brd: module loaded
[    1.654440] loop: module loaded
[    1.658328] megasas: 07.714.04.00-rc1
[    1.664680] igbvf: Intel(R) Gigabit Virtual Function Network Driver
[    1.671112] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.
[    1.677197] sky2: driver version 1.30
[    1.681611] VFIO - User Level meta-driver version: 0.3
[    1.687388] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    1.694098] ehci-pci: EHCI PCI platform driver
[    1.698972] usbcore: registered new interface driver uas
[    1.704421] usbcore: registered new interface driver usb-storage
[    1.711339] i2c /dev entries driver
[    1.715038] Driver for 1-wire Dallas network protocol.
[    1.720309] DS1WM w1 busmaster driver - (c) 2004 Szabolcs Gyurko
[    1.727341] sdhci: Secure Digital Host Controller Interface driver
[    1.733660] sdhci: Copyright(c) Pierre Ossman
[    1.738340] sdhci-pltfm: SDHCI platform and OF driver helper
[    1.746597] ledtrig-cpu: registered to indicate activity on CPUs
[    1.752944] SMCCC: SOC_ID: ARCH_SOC_ID not implemented, skipping ....
[    1.759715] hid: raw HID events driver (C) Jiri Kosina
[    1.765080] usbcore: registered new interface driver usbhid
[    1.770773] usbhid: USB HID core driver
[    1.775170] optee: probing for conduit method.
[    1.779727] optee: revision 3.12 (cac3fef2)
[    1.779988] optee: initialized driver
[    1.789109] drop_monitor: Initializing network drop monitor service
[    1.795927] NET: Registered protocol family 10
[    1.815963] Segment Routing with IPv6
[    1.819809] mip6: Mobile IPv6
[    1.822841] NET: Registered protocol family 17
[    1.827483] Key type dns_resolver registered
[    1.831885] mpls_gso: MPLS GSO support
[    1.835873] registered taskstats version 1
[    1.840061] Loading compiled-in X.509 certificates
[    1.845015] zswap: loaded using pool lzo/zbud
[    1.849594] Key type .fscrypt registered
[    1.853615] Key type fscrypt-provisioning registered
[    1.862521] Btrfs loaded, crc32c=crc32c-generic
[    1.867236] AppArmor: AppArmor sha1 policy hashing enabled
[    1.881183] ti-sci 44083000.dmsc: ABI: 3.1 (firmware rev 0x0015 '21.9.1--v2021.09a (Terrific Lla')
[    1.941518] omap_i2c 40b00000.i2c: bus 0 rev0.12 at 100 kHz
[    1.947760] omap_i2c 40b10000.i2c: bus 1 rev0.12 at 100 kHz
[    1.954263] at24 2-0050: supply vcc not found, using dummy regulator
[    1.982534] at24 2-0050: 512 byte 24c04 EEPROM, writable, 1 bytes/write
[    1.989328] omap_i2c 42120000.i2c: bus 2 rev0.12 at 400 kHz
[    1.995629] omap_i2c 2000000.i2c: bus 3 rev0.12 at 400 kHz
[    2.002365] omap_i2c 2010000.i2c: bus 4 rev0.12 at 400 kHz
[    2.008627] omap_i2c 2030000.i2c: bus 5 rev0.12 at 400 kHz
[    2.015167] omap_i2c 2050000.i2c: bus 6 rev0.12 at 400 kHz
[    2.021612] ti-sci-intr bus@100000:bus@28380000:interrupt-controller2: Interrupt Router 137 domain created
[    2.031597] ti-sci-intr bus@100000:interrupt-controller0: Interrupt Router 131 domain created
[    2.040421] ti-sci-intr bus@100000:main-navss:interrupt-controller1: Interrupt Router 213 domain created
[    2.050292] ti-sci-inta 33d00000.interrupt-controller: Interrupt Aggregator domain 209 created
[    2.074724] j721e-pcie 2910000.pcie: host bridge /bus@100000/pcie@2910000 ranges:
[    2.082407] j721e-pcie 2910000.pcie:       IO 0x0018001000..0x0018010fff -> 0x0018001000
[    2.090684] j721e-pcie 2910000.pcie:      MEM 0x0018011000..0x001fffffff -> 0x0018011000
[    2.098960] j721e-pcie 2910000.pcie:   IB MEM 0x0000000000..0xffffffffffff -> 0x0000000000
[    2.108362] k3-ringacc 2b800000.ringacc: Ring Accelerator probed rings:286, gp-rings[96,20] sci-dev-id:235
[    2.118257] k3-ringacc 2b800000.ringacc: dma-ring-reset-quirk: disabled
[    2.125017] k3-ringacc 2b800000.ringacc: RA Proxy rev. 66346100, num_proxies:64
[    2.134281] k3-ringacc 3c000000.ringacc: Ring Accelerator probed rings:1024, gp-rings[440,150] sci-dev-id:211
[    2.144437] k3-ringacc 3c000000.ringacc: dma-ring-reset-quirk: disabled
[    2.151195] k3-ringacc 3c000000.ringacc: RA Proxy rev. 66346100, num_proxies:64
[    2.159221] 40a00000.serial: ttyS1 at MMIO 0x40a00000 (irq = 15, base_baud = 6000000) is a 8250
[    2.168740] 2800000.serial: ttyS2 at MMIO 0x2800000 (irq = 30, base_baud = 3000000) is a 8250
[    2.177491] printk: console [ttyS2] enabled
[    2.185929] printk: bootconsole [ns16550a0] disabled
[    2.196466] 2810000.serial: ttyS3 at MMIO 0x2810000 (irq = 31, base_baud = 3000000) is a 8250
[    2.205454] 2840000.serial: ttyS6 at MMIO 0x2840000 (irq = 32, base_baud = 3000000) is a 8250
[    2.222815] [drm] Initialized tidss 1.0.0 20180215 for 4a00000.dss on minor 0
[    2.280250] Console: switching to colour frame buffer device 240x75
[    2.302800] tidss 4a00000.dss: [drm] fb0: tidssdrmfb frame buffer device
[    2.316078] davinci_mdio 46000f00.mdio: Configuring MDIO in manual mode
[    2.362396] davinci_mdio 46000f00.mdio: davinci mdio revision 9.7, bus freq 1000000
[    2.374332] davinci_mdio 46000f00.mdio: phy[0]: device 46000f00.mdio:00, driver TI DP83867
[    2.382673] am65-cpsw-nuss 46000000.ethernet: initializing am65 cpsw nuss version 0x6BA00101, cpsw version 0x6BA80100 Ports: 2 quirks:00000000
[    2.395483] am65-cpsw-nuss 46000000.ethernet: initialized cpsw ale version 1.4
[    2.402688] am65-cpsw-nuss 46000000.ethernet: ALE Table size 64
[    2.409100] am65-cpsw-nuss 46000000.ethernet: CPTS ver 0x4e8a010a, freq:500000000, add_val:1 pps:0
[    2.419531] davinci_mdio c000f00.mdio: Configuring MDIO in manual mode
[    2.462396] davinci_mdio c000f00.mdio: davinci mdio revision 9.7, bus freq 1000000
[    2.469953] davinci_mdio c000f00.mdio: no live phy, scanning all
[    2.594584] davinci_mdio c000f00.mdio: phy[0]: device c000f00.mdio:00, driver unknown
[    2.602419] davinci_mdio c000f00.mdio: phy[1]: device c000f00.mdio:01, driver unknown
[    2.610230] davinci_mdio c000f00.mdio: phy[2]: device c000f00.mdio:02, driver unknown
[    2.618041] davinci_mdio c000f00.mdio: phy[3]: device c000f00.mdio:03, driver unknown
[    2.625852] davinci_mdio c000f00.mdio: phy[4]: device c000f00.mdio:04, driver unknown
[    2.633662] davinci_mdio c000f00.mdio: phy[5]: device c000f00.mdio:05, driver unknown
[    2.641473] davinci_mdio c000f00.mdio: phy[6]: device c000f00.mdio:06, driver unknown
[    2.649283] davinci_mdio c000f00.mdio: phy[7]: device c000f00.mdio:07, driver unknown
[    2.657096] davinci_mdio c000f00.mdio: phy[8]: device c000f00.mdio:08, driver unknown
[    2.664914] davinci_mdio c000f00.mdio: phy[9]: device c000f00.mdio:09, driver unknown
[    2.664916] davinci_mdio c000f00.mdio: phy[10]: device c000f00.mdio:0a, driver unknown
[    2.664919] davinci_mdio c000f00.mdio: phy[11]: device c000f00.mdio:0b, driver unknown
[    2.664922] davinci_mdio c000f00.mdio: phy[12]: device c000f00.mdio:0c, driver unknown
[    2.664925] davinci_mdio c000f00.mdio: phy[13]: device c000f00.mdio:0d, driver unknown
[    2.664928] davinci_mdio c000f00.mdio: phy[14]: device c000f00.mdio:0e, driver unknown
[    2.712208] davinci_mdio c000f00.mdio: phy[15]: device c000f00.mdio:0f, driver unknown
[    2.720110] davinci_mdio c000f00.mdio: phy[16]: device c000f00.mdio:10, driver unknown
[    2.728008] davinci_mdio c000f00.mdio: phy[17]: device c000f00.mdio:11, driver unknown
[    2.735905] davinci_mdio c000f00.mdio: phy[18]: device c000f00.mdio:12, driver unknown
[    2.743803] davinci_mdio c000f00.mdio: phy[19]: device c000f00.mdio:13, driver unknown
[    2.751700] davinci_mdio c000f00.mdio: phy[20]: device c000f00.mdio:14, driver unknown
[    2.759597] davinci_mdio c000f00.mdio: phy[21]: device c000f00.mdio:15, driver unknown
[    2.767493] davinci_mdio c000f00.mdio: phy[22]: device c000f00.mdio:16, driver unknown
[    2.775390] davinci_mdio c000f00.mdio: phy[23]: device c000f00.mdio:17, driver unknown
[    2.783289] davinci_mdio c000f00.mdio: phy[24]: device c000f00.mdio:18, driver unknown
[    2.791185] davinci_mdio c000f00.mdio: phy[25]: device c000f00.mdio:19, driver unknown
[    2.799082] davinci_mdio c000f00.mdio: phy[26]: device c000f00.mdio:1a, driver unknown
[    2.806979] davinci_mdio c000f00.mdio: phy[27]: device c000f00.mdio:1b, driver unknown
[    2.814877] davinci_mdio c000f00.mdio: phy[28]: device c000f00.mdio:1c, driver unknown
[    2.822773] davinci_mdio c000f00.mdio: phy[29]: device c000f00.mdio:1d, driver unknown
[    2.830670] davinci_mdio c000f00.mdio: phy[30]: device c000f00.mdio:1e, driver unknown
[    2.838567] davinci_mdio c000f00.mdio: phy[31]: device c000f00.mdio:1f, driver unknown
[    2.846539] am65-cpsw-nuss c000000.ethernet: initializing am65 cpsw nuss version 0x6BA01901, cpsw version 0x6BA80101 Ports: 9 quirks:00000000
[    2.859217] am65-cpsw-nuss c000000.ethernet: /bus@100000/ethernet@c000000/ethernet-ports/port@1 error retrieving port phy: -19
[    2.872733] am65-cpts 310d0000.cpts: CPTS ver 0x4e8a010a, freq:200000000, add_val:4 pps:0
[    2.884857] xhci-hcd xhci-hcd.0.auto: xHCI Host Controller
[    2.890355] xhci-hcd xhci-hcd.0.auto: new USB bus registered, assigned bus number 1
[    2.898116] xhci-hcd xhci-hcd.0.auto: hcc params 0x200073c9 hci version 0x100 quirks 0x0000002000010010
[    2.907508] xhci-hcd xhci-hcd.0.auto: irq 232, io mem 0x06410000
[    2.913710] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.10
[    2.921966] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    2.929184] usb usb1: Product: xHCI Host Controller
[    2.934049] usb usb1: Manufacturer: Linux 5.10.162-ti-arm64-r99 xhci-hcd
[    2.940733] usb usb1: SerialNumber: xhci-hcd.0.auto
[    2.945840] hub 1-0:1.0: USB hub found
[    2.949605] hub 1-0:1.0: 1 port detected
[    2.953661] xhci-hcd xhci-hcd.0.auto: xHCI Host Controller
[    2.959144] xhci-hcd xhci-hcd.0.auto: new USB bus registered, assigned bus number 2
[    2.966789] xhci-hcd xhci-hcd.0.auto: Host supports USB 3.0 SuperSpeed
[    2.973332] usb usb2: We don't know the algorithms for LPM for this host, disabling LPM.
[    2.981468] usb usb2: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.10
[    2.989716] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    2.996921] usb usb2: Product: xHCI Host Controller
[    3.001783] usb usb2: Manufacturer: Linux 5.10.162-ti-arm64-r99 xhci-hcd
[    3.008467] usb usb2: SerialNumber: xhci-hcd.0.auto
[    3.013517] hub 2-0:1.0: USB hub found
[    3.017271] hub 2-0:1.0: 1 port detected
[    3.124071] mmc0: CQHCI version 5.10
[    3.133306] gpio gpiochip2: gpio-line-names is length 37 but should be at most length 36
[    3.142213] vdd_mmc1: supplied by vsys_3v3
[    3.147347] omap-mailbox 31f80000.mailbox: omap mailbox rev 0x66fc7100
[    3.154265] omap-mailbox 31f81000.mailbox: omap mailbox rev 0x66fc7100
[    3.161134] omap-mailbox 31f82000.mailbox: omap mailbox rev 0x66fc7100
[    3.166407] mmc0: SDHCI controller on 4f80000.mmc [4f80000.mmc] using ADMA 64-bit
[    3.175167] omap-mailbox 31f83000.mailbox: omap mailbox rev 0x66fc7100
[    3.182044] omap-mailbox 31f84000.mailbox: omap mailbox rev 0x66fc7100
[    3.192357] j721e-pcie 2910000.pcie: host bridge /bus@100000/pcie@2910000 ranges:
[    3.199853] j721e-pcie 2910000.pcie:       IO 0x0018001000..0x0018010fff -> 0x0018001000
[    3.207935] j721e-pcie 2910000.pcie:      MEM 0x0018011000..0x001fffffff -> 0x0018011000
[    3.210406] usb 1-1: new high-speed USB device number 2 using xhci-hcd
[    3.216013] j721e-pcie 2910000.pcie:   IB MEM 0x0000000000..0xffffffffffff -> 0x0000000000
[    3.249917] mmc0: Command Queue Engine enabled
[    3.254359] mmc0: new HS200 MMC card at address 0001
[    3.259710] mmcblk0: mmc0:0001 TB2916 14.6 GiB 
[    3.264394] mmcblk0boot0: mmc0:0001 TB2916 partition 1 4.00 MiB
[    3.270398] mmcblk0boot1: mmc0:0001 TB2916 partition 2 4.00 MiB
[    3.276404] mmcblk0rpmb: mmc0:0001 TB2916 partition 3 4.00 MiB, chardev (236:0)
[    3.284808]  mmcblk0: p1 p2
[    3.370754] usb 1-1: New USB device found, idVendor=0451, idProduct=8142, bcdDevice= 1.00
[    3.378928] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=1
[    3.386046] usb 1-1: SerialNumber: 460500591EA6
[    3.391058] hub 1-1:1.0: USB hub found
[    3.394830] hub 1-1:1.0: 4 ports detected
[    3.498416] usb 2-1: new SuperSpeed Gen 1 USB device number 2 using xhci-hcd
[    3.522628] usb 2-1: New USB device found, idVendor=0451, idProduct=8140, bcdDevice= 1.00
[    3.530794] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    3.538350] hub 2-1:1.0: USB hub found
[    3.542113] hub 2-1:1.0: 4 ports detected
[    3.686402] usb 1-1.1: new high-speed USB device number 3 using xhci-hcd
[    3.790801] usb 1-1.1: New USB device found, idVendor=2357, idProduct=011e, bcdDevice= 2.00
[    3.799136] usb 1-1.1: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[    3.806428] usb 1-1.1: Product: 802.11ac WLAN Adapter 
[    3.811553] usb 1-1.1: Manufacturer: Realtek 
[    3.815897] usb 1-1.1: SerialNumber: 00e04c000001
[    3.911657] usb 2-1.2: new SuperSpeed Gen 1 USB device number 3 using xhci-hcd
[    4.023248] usb 2-1.2: New USB device found, idVendor=2109, idProduct=0813, bcdDevice=90.11
[    4.031592] usb 2-1.2: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[    4.038896] usb 2-1.2: Product: USB3.0 Hub
[    4.042990] usb 2-1.2: Manufacturer: VIA Labs, Inc.
[    4.048616] hub 2-1.2:1.0: USB hub found
[    4.052683] hub 2-1.2:1.0: 4 ports detected
[    4.102396] usb 1-1.2: new high-speed USB device number 4 using xhci-hcd
[    4.208048] usb 1-1.2: New USB device found, idVendor=2109, idProduct=2813, bcdDevice=90.11
[    4.216383] usb 1-1.2: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[    4.223674] usb 1-1.2: Product: USB2.0 Hub
[    4.227760] usb 1-1.2: Manufacturer: VIA Labs, Inc.
[    4.232780] j721e-pcie 2910000.pcie: PCI host bridge to bus 0000:00
[    4.239038] pci_bus 0000:00: root bus resource [bus 00-ff]
[    4.244513] pci_bus 0000:00: root bus resource [io  0x0000-0xffff] (bus address [0x18001000-0x18010fff])
[    4.253972] pci_bus 0000:00: root bus resource [mem 0x18011000-0x1fffffff]
[    4.260854] pci 0000:00:00.0: [104c:b00d] type 01 class 0x060400
[    4.266850] pci_bus 0000:00: 2-byte config write to 0000:00:00.0 offset 0x4 may corrupt adjacent RW1C bits
[    4.276546] pci 0000:00:00.0: supports D1
[    4.280545] pci 0000:00:00.0: PME# supported from D0 D1 D3hot
[    4.289823] pci 0000:00:00.0: bridge configuration invalid ([bus 00-00]), reconfiguring
[    4.301146] pci_bus 0000:01: busn_res: [bus 01-ff] end is updated to 01
[    4.307771] pci 0000:00:00.0: PCI bridge to [bus 01]
[    4.313081] pcieport 0000:00:00.0: PME: Signaling with IRQ 506
[    4.319125] pcieport 0000:00:00.0: AER: enabled with IRQ 506
[    4.325856] ti-udma 285c0000.dma-controller: Channels: 26 (tchan: 13, rchan: 13, gp-rflow: 8)
[    4.335385] hub 1-1.2:1.0: USB hub found
[    4.339501] hub 1-1.2:1.0: 4 ports detected
[    4.345148] ti-udma 31150000.dma-controller: Channels: 122 (tchan: 61, rchan: 61, gp-rflow: 16)
[    4.360525] spi-nor spi11.0: unrecognized JEDEC id bytes: ff ff ff ff ff ff
[    4.367497] spi-nor: probe of spi11.0 failed with error -2
[    4.376003] davinci_mdio 46000f00.mdio: Configuring MDIO in manual mode
[    4.422400] davinci_mdio 46000f00.mdio: davinci mdio revision 9.7, bus freq 1000000
[    4.434318] davinci_mdio 46000f00.mdio: phy[0]: device 46000f00.mdio:00, driver TI DP83867
[    4.442665] am65-cpsw-nuss 46000000.ethernet: initializing am65 cpsw nuss version 0x6BA00101, cpsw version 0x6BA80100 Ports: 2 quirks:00000000
[    4.455476] am65-cpsw-nuss 46000000.ethernet: initialized cpsw ale version 1.4
[    4.462682] am65-cpsw-nuss 46000000.ethernet: ALE Table size 64
[    4.469088] am65-cpsw-nuss 46000000.ethernet: CPTS ver 0x4e8a010a, freq:500000000, add_val:1 pps:0
[    4.479632] am65-cpsw-nuss 46000000.ethernet: set new flow-id-base 48
[    4.722400] usb 1-1.2.1: new low-speed USB device number 5 using xhci-hcd
[    4.886499] usb 1-1.2.1: New USB device found, idVendor=413c, idProduct=301a, bcdDevice= 1.00
[    4.895006] usb 1-1.2.1: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[    4.902479] usb 1-1.2.1: Product: Dell MS116 USB Optical Mouse
[    4.908297] usb 1-1.2.1: Manufacturer: PixArt
[    4.917106] input: PixArt Dell MS116 USB Optical Mouse as /devices/platform/bus@100000/4114000.cdns-usb/6400000.usb/xhci-hcd.0.auto/usb1/1-1/1-1.2/1-1.2.1/1-1.2.1:1.0/0003:413C:301A.0001/input/input0
[    4.934974] hid-generic 0003:413C:301A.0001: input,hidraw0: USB HID v1.11 Mouse [PixArt Dell MS116 USB Optical Mouse] on usb-xhci-hcd.0.auto-1.2.1/input0
[    5.082398] usb 1-1.2.2: new low-speed USB device number 6 using xhci-hcd
[    5.226760] mmc1: CQHCI version 5.10
[    5.226844] debugfs: Directory 'pd:27' with parent 'pm_genpd' already present!
[    5.237558] debugfs: Directory 'pd:26' with parent 'pm_genpd' already present!
[    5.246117] debugfs: Directory 'pd:242' with parent 'pm_genpd' already present!
[    5.253448] debugfs: Directory 'pd:241' with parent 'pm_genpd' already present!
[    5.257629] usb 1-1.2.2: New USB device found, idVendor=046a, idProduct=0023, bcdDevice= 2.20
[    5.260752] debugfs: Directory 'pd:240' with parent 'pm_genpd' already present!
[    5.269255] usb 1-1.2.2: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    5.276566] debugfs: Directory 'pd:239' with parent 'pm_genpd' already present!
[    5.292461] input: gpio-keys as /devices/platform/gpio-keys/input/input1
[    5.299590] of_cfs_init
[    5.302049] of_cfs_init: OK
[    6.291146] mmc1: SDHCI controller on 4fb0000.mmc [4fb0000.mmc] using ADMA 64-bit
[    6.301080] Freeing unused kernel memory: 3776K
[    6.327535] Checked W+X mappings: passed, no W+X pages found
[    6.333226] Run /init as init process
[    6.336886]   with arguments:
[    6.336888]     /init
[    6.336890]   with environment:
[    6.336892]     HOME=/
[    6.336894]     TERM=linux
[    6.365399] mmc1: new ultra high speed DDR50 SDHC card at address aaaa
[    6.372752] mmcblk1: mmc1:aaaa SB32G 29.7 GiB 
[    6.381843]  mmcblk1: p1 p2
[    6.840186] input: HID 046a:0023 as /devices/platform/bus@100000/4114000.cdns-usb/6400000.usb/xhci-hcd.0.auto/usb1/1-1/1-1.2/1-1.2.2/1-1.2.2:1.0/0003:046A:0023.0002/input/input2
[    6.918916] cherry 0003:046A:0023.0002: input,hidraw1: USB HID v1.11 Keyboard [HID 046a:0023] on usb-xhci-hcd.0.auto-1.2.2/input0
[    6.991373] input: HID 046a:0023 as /devices/platform/bus@100000/4114000.cdns-usb/6400000.usb/xhci-hcd.0.auto/usb1/1-1/1-1.2/1-1.2.2/1-1.2.2:1.1/0003:046A:0023.0003/input/input3
[    7.118657] cherry 0003:046A:0023.0003: input,hidraw2: USB HID v1.11 Device [HID 046a:0023] on usb-xhci-hcd.0.auto-1.2.2/input1
[    7.316429] remoteproc remoteproc0: b034000.pru is available
[    7.322407] remoteproc remoteproc1: b004000.rtu is available
[    7.328343] remoteproc remoteproc2: b00a000.txpru is available
[    7.334425] remoteproc remoteproc3: b038000.pru is available
[    7.340333] remoteproc remoteproc4: b006000.rtu is available
[    7.346285] remoteproc remoteproc5: b00c000.txpru is available
[    7.352358] remoteproc remoteproc6: b134000.pru is available
[    7.372255] remoteproc remoteproc7: b104000.rtu is available
[    7.378323] remoteproc remoteproc8: b10a000.txpru is available
[    7.384450] remoteproc remoteproc9: b138000.pru is available
[    7.390415] remoteproc remoteproc10: b106000.rtu is available
[    7.396502] remoteproc remoteproc11: b10c000.txpru is available
[    7.739271] EXT4-fs (mmcblk1p2): mounted filesystem with ordered data mode. Opts: (null)
[    7.885768] Not activating Mandatory Access Control as /sbin/tomoyo-init does not exist.
[    8.232439] systemd[1]: System time before build time, advancing clock.
[    8.321631] systemd[1]: systemd 247.3-7+deb11u1 running in system mode. (+PAM +AUDIT +SELINUX +IMA +APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +ZSTD +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=unified)
[    8.344766] systemd[1]: Detected architecture arm64.
[    8.362181] systemd[1]: Set hostname to <BeagleBone>.
[    8.646195] systemd[1]: /lib/systemd/system/plymouth-start.service:16: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed.
[    8.737595] systemd[1]: Queued start job for default target Graphical Interface.
[    8.745034] systemd[1]: Unnecessary job for /dev/bone/uart/0 was removed.
[    8.751821] systemd[1]: Unnecessary job for /sys/devices/platform/bus@100000/2800000.serial/tty/ttyS2 was removed.
[    8.765602] random: systemd: uninitialized urandom read (16 bytes read)
[    8.796101] systemd[1]: Created slice system-getty.slice.
[    8.801764] random: systemd: uninitialized urandom read (16 bytes read)
[    8.809296] systemd[1]: Created slice system-modprobe.slice.
[    8.819714] random: systemd: uninitialized urandom read (16 bytes read)
[    8.827672] systemd[1]: Created slice system-serial\x2dgetty.slice.
[    8.839287] systemd[1]: Created slice User and Session Slice.
[    8.850674] systemd[1]: Started Forward Password Requests to Wall Directory Watch.
[    8.859742] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point.
[    8.874478] systemd[1]: Reached target Remote File Systems.
[    8.885322] systemd[1]: Reached target Slices.
[    8.895288] systemd[1]: Reached target Swap.
[    8.905409] systemd[1]: Listening on Syslog Socket.
[    8.915728] systemd[1]: Listening on fsck to fsckd communication Socket.
[    8.927857] systemd[1]: Listening on initctl Compatibility Named Pipe.
[    8.940175] systemd[1]: Listening on Journal Audit Socket.
[    8.951036] systemd[1]: Listening on Journal Socket (/dev/log).
[    8.962542] systemd[1]: Listening on Journal Socket.
[    8.973116] systemd[1]: Listening on Network Service Netlink Socket.
[    8.984938] systemd[1]: Listening on udev Control Socket.
[    8.995764] systemd[1]: Listening on udev Kernel Socket.
[    9.028184] systemd[1]: Mounting Huge Pages File System...
[    9.036772] systemd[1]: Mounting POSIX Message Queue File System...
[    9.049834] systemd[1]: Mounting /sys/kernel/debug...
[    9.060816] systemd[1]: Mounting Kernel Trace File System...
[    9.072044] systemd[1]: Starting Set the console keyboard layout...
[    9.091841] systemd[1]: Starting Create list of static device nodes for the current kernel...
[    9.102921] systemd[1]: Starting Load Kernel Module configfs...
[    9.114908] systemd[1]: Starting Load Kernel Module drm...
[    9.127435] systemd[1]: Starting Load Kernel Module fuse...
[    9.138703] systemd[1]: Condition check resulted in Set Up Additional Binary Formats being skipped.
[    9.151172] systemd[1]: Condition check resulted in File System Check on Root Device being skipped.
[    9.164077] systemd[1]: Starting Journal Service...
[    9.176052] systemd[1]: Starting Load Kernel Modules...
[    9.185648] systemd[1]: Starting Remount Root and Kernel File Systems...
[    9.201159] systemd[1]: Starting Coldplug All udev Devices...
[    9.218972] systemd[1]: Mounted Huge Pages File System.
[    9.225882] systemd[1]: Mounted POSIX Message Queue File System.
[    9.244234] NET: Registered protocol family 36
[    9.251270] systemd[1]: Mounted /sys/kernel/debug.
[    9.257056] systemd[1]: Mounted Kernel Trace File System.
[    9.258379] EXT4-fs (mmcblk1p2): re-mounted. Opts: errors=remount-ro
[    9.276633] systemd[1]: Finished Set the console keyboard layout.
[    9.288500] systemd[1]: Finished Create list of static device nodes for the current kernel.
[    9.294532] usbcore: registered new interface driver wpanusb
[    9.323655] systemd[1]: modprobe@configfs.service: Succeeded.
[    9.335233] systemd[1]: Finished Load Kernel Module configfs.
[    9.343489] systemd[1]: modprobe@drm.service: Succeeded.
[    9.360445] systemd[1]: Finished Load Kernel Module drm.
[    9.367307] systemd[1]: modprobe@fuse.service: Succeeded.
[    9.378153] systemd[1]: Finished Load Kernel Module fuse.
[    9.385012] systemd[1]: Finished Remount Root and Kernel File Systems.
[    9.400085] gb_bootrom: module is from the staging directory, the quality is unknown, you have been warned.
[    9.412449] greybus: registered new driver bootrom
[    9.418257] systemd[1]: Mounting FUSE Control File System...
[    9.431691] systemd[1]: Mounting Kernel Configuration File System...
[    9.436367] gb_spilib: module is from the staging directory, the quality is unknown, you have been warned.
[    9.456640] systemd[1]: Condition check resulted in Rebuild Hardware Database being skipped.
[    9.465263] systemd[1]: Condition check resulted in Platform Persistent Storage Archival being skipped.
[    9.476354] gb_firmware: module is from the staging directory, the quality is unknown, you have been warned.
[    9.479231] systemd[1]: Starting Load/Save Random Seed...
[    9.499054] systemd[1]: Starting Create System Users...
[    9.507284] systemd[1]: Started Journal Service.
[    9.510746] greybus: registered new driver gb-firmware
[    9.536271] gb_gbphy: module is from the staging directory, the quality is unknown, you have been warned.
[    9.558001] systemd-journald[457]: Received client request to flush runtime journal.
[    9.566032] greybus: registered new driver gbphy
[    9.577469] gb_gpio: module is from the staging directory, the quality is unknown, you have been warned.
[    9.594835] gb_gbphy: registered new driver gpio
[    9.601919] gb_hid: module is from the staging directory, the quality is unknown, you have been warned.
[    9.603631] systemd-journald[457]: File /var/log/journal/2bda0d0cd8b24efcac2afdbf9138d6f9/system.journal corrupted or uncleanly shut down, renaming and replacing.
[    9.632961] greybus: registered new driver hid
[    9.646852] gb_i2c: module is from the staging directory, the quality is unknown, you have been warned.
[    9.667417] gb_gbphy: registered new driver i2c
[    9.680733] gb_log: module is from the staging directory, the quality is unknown, you have been warned.
[    9.700226] greybus: registered new driver log
[    9.719756] gb_loopback: module is from the staging directory, the quality is unknown, you have been warned.
[    9.744339] greybus: registered new driver loopback
[    9.776438] gb_raw: module is from the staging directory, the quality is unknown, you have been warned.
[    9.790567] greybus: registered new driver raw
[    9.804704] gb_spi: module is from the staging directory, the quality is unknown, you have been warned.
[    9.814537] gb_gbphy: registered new driver spi
[    9.831158] gb_uart: module is from the staging directory, the quality is unknown, you have been warned.
[    9.841195] gb_gbphy: registered new driver uart
[    9.858469] random: systemd: uninitialized urandom read (16 bytes read)
[   10.409350] random: systemd: uninitialized urandom read (16 bytes read)
[   10.437491] random: systemd: uninitialized urandom read (16 bytes read)
[   10.697611] am65-cpsw-nuss 46000000.ethernet eth0: PHY [46000f00.mdio:00] driver [TI DP83867] (irq=POLL)
[   10.707148] am65-cpsw-nuss 46000000.ethernet eth0: configuring for phy/rgmii-rxid link mode
[   10.957741] random: systemd: uninitialized urandom read (16 bytes read)
[   10.978535] random: systemd: uninitialized urandom read (16 bytes read)
[   11.078431] random: crng init done
[   11.081829] random: 68 urandom warning(s) missed due to ratelimiting
[   11.270442] imx219 6-0010: supply VANA not found, using dummy regulator
[   11.277202] imx219 6-0010: supply VDIG not found, using dummy regulator
[   11.283924] imx219 6-0010: supply VDDL not found, using dummy regulator
[   11.302858] k3-dsp-rproc 4d80800000.dsp: assigned reserved memory node vision-apps-c66-dma-memory@a9000000
[   11.317010] k3-dsp-rproc 4d80800000.dsp: configured DSP for remoteproc mode
[   11.324877] k3-dsp-rproc 4d80800000.dsp: local reset is deasserted for device
[   11.332605] remoteproc remoteproc12: 4d80800000.dsp is available
[   11.357874] k3-dsp-rproc 4d81800000.dsp: assigned reserved memory node vision-apps-c66-dma-memory@a8000000
[   11.375363] img_enc 4200000.video-encoder: vxe_enc_probe: using heap 1 for internal alloc
[   11.386128] k3-dsp-rproc 4d81800000.dsp: configured DSP for remoteproc mode
[   11.393522] k3-dsp-rproc 4d81800000.dsp: local reset is deasserted for device
[   11.404783] remoteproc remoteproc13: 4d81800000.dsp is available
[   11.412534] remoteproc remoteproc12: powering up 4d80800000.dsp
[   11.413382] img_enc 4200000.video-encoder: encoder registered as /dev/video0
[   11.418494] remoteproc remoteproc12: Booting fw image vision_apps_eaik/vx_app_rtos_linux_c6x_1.out, size 1461044
[   11.442575] k3-dsp-rproc 64800000.dsp: assigned reserved memory node vision-apps-c71-dma-memory@aa000000
[   11.458024] k3-dsp-rproc 4d80800000.dsp: booting DSP core using boot addr = 0xa8d9a000
[   11.466871] k3-dsp-rproc 64800000.dsp: configured DSP for remoteproc mode
[   11.473834] remoteproc remoteproc14: 64800000.dsp is available
[   11.491646]  remoteproc12#vdev0buffer: assigned reserved memory node vision-apps-c66-dma-memory@a9000000
[   11.501384]  remoteproc12#vdev0buffer: registered virtio0 (type 7)
[   11.507614] remoteproc remoteproc12: remote processor 4d80800000.dsp is now up
[   11.528304] remoteproc remoteproc13: powering up 4d81800000.dsp
[   11.534289] remoteproc remoteproc13: Booting fw image vision_apps_eaik/vx_app_rtos_linux_c6x_2.out, size 1461012
[   11.550955] k3-dsp-rproc 4d81800000.dsp: booting DSP core using boot addr = 0xa9d9a000
[   11.575499]  remoteproc13#vdev0buffer: assigned reserved memory node vision-apps-c66-dma-memory@a8000000
[   11.580676] img_dec 4300000.video-decoder: decoder registered as /dev/video1
[   11.585158]  remoteproc13#vdev0buffer: registered virtio1 (type 7)
[   11.598301] remoteproc remoteproc13: remote processor 4d81800000.dsp is now up
[   11.694494] omap_rng 4e10000.rng: Random Number Generator ver. 241b34c
[   11.901842] remoteproc remoteproc14: powering up 64800000.dsp
[   11.907662] remoteproc remoteproc14: Booting fw image vision_apps_eaik/vx_app_rtos_linux_c7x_1.out, size 13242432
[   11.918045] remoteproc remoteproc14: unsupported resource 65538
[   11.934332] k3-dsp-rproc 64800000.dsp: booting DSP core using boot addr = 0xaa200000
[   11.950836]  remoteproc14#vdev0buffer: assigned reserved memory node vision-apps-c71-dma-memory@aa000000
[   11.960511]  remoteproc14#vdev0buffer: registered virtio2 (type 7)
[   11.966732] remoteproc remoteproc14: remote processor 64800000.dsp is now up
[   12.063180] platform 41000000.r5f: R5F core may have been powered on by a different host, programmed state (0) != actual state (1)
[   12.089703] platform 41000000.r5f: configured R5F for IPC-only mode
[   12.096403] platform 41000000.r5f: assigned reserved memory node vision-apps-r5f-dma-memory@a0000000
[   12.106499] remoteproc remoteproc15: 41000000.r5f is available
[   12.112435] remoteproc remoteproc15: attaching to 41000000.r5f
[   12.118542] platform 41000000.r5f: R5F core initialized in IPC-only mode
[   12.125305]  remoteproc15#vdev0buffer: assigned reserved memory node vision-apps-r5f-dma-memory@a0000000
[   12.134933]  remoteproc15#vdev0buffer: registered virtio3 (type 7)
[   12.141173] remoteproc remoteproc15: remote processor 41000000.r5f is now attached
[   12.157099] FAT-fs (mmcblk1p1): Volume was not properly unmounted. Some data may be corrupt. Please run fsck.
[   12.171703] platform 5c00000.r5f: configured R5F for remoteproc mode
[   12.244345] platform 5c00000.r5f: assigned reserved memory node vision-apps-r5f-dma-memory@a2000000
[   12.254626] remoteproc remoteproc16: 5c00000.r5f is available
[   12.260634] remoteproc remoteproc16: Direct firmware load for vision_apps_eaik/vx_app_rtos_linux_mcu2_0.dontload failed with error -2
[   12.272764] remoteproc remoteproc16: powering up 5c00000.r5f
[   12.278465] remoteproc remoteproc16: Direct firmware load for vision_apps_eaik/vx_app_rtos_linux_mcu2_0.dontload failed with error -2
[   12.290454] remoteproc remoteproc16: request_firmware failed: -2
[   12.407832] audit: type=1400 audit(1659878713.172:2): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/bin/man" pid=624 comm="apparmor_parser"
[   12.417393] platform 5d00000.r5f: configured R5F for remoteproc mode
[   12.422904] audit: type=1400 audit(1659878713.172:3): apparmor="STATUS" operation="profile_load" profile="unconfined" name="man_filter" pid=624 comm="apparmor_parser"
[   12.444171] audit: type=1400 audit(1659878713.172:4): apparmor="STATUS" operation="profile_load" profile="unconfined" name="man_groff" pid=624 comm="apparmor_parser"
[   12.485659] audit: type=1400 audit(1659878713.244:5): apparmor="STATUS" operation="profile_load" profile="unconfined" name="nvidia_modprobe" pid=627 comm="apparmor_parser"
[   12.501073] audit: type=1400 audit(1659878713.244:6): apparmor="STATUS" operation="profile_load" profile="unconfined" name="nvidia_modprobe//kmod" pid=627 comm="apparmor_parser"
[   12.532620] audit: type=1400 audit(1659878713.296:7): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/lib/aarch64-linux-gnu/lightdm/lightdm-guest-session" pid=623 comm="apparmor_parser"
[   12.551546] audit: type=1400 audit(1659878713.296:8): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/lib/aarch64-linux-gnu/lightdm/lightdm-guest-session//chromium" pid=623 comm="apparmor_parser"
[   12.571285] audit: type=1400 audit(1659878713.300:9): apparmor="STATUS" operation="profile_load" profile="unconfined" name="lsb_release" pid=628 comm="apparmor_parser"
[   12.614200] audit: type=1400 audit(1659878713.376:10): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/sbin/ntpd" pid=629 comm="apparmor_parser"
[   12.644644] platform 5d00000.r5f: assigned reserved memory node vision-apps-r5f-dma-memory@a4000000
[   12.655165] remoteproc remoteproc17: 5d00000.r5f is available
[   12.665676] remoteproc remoteproc17: Direct firmware load for vision_apps_eaik/vx_app_rtos_linux_mcu2_1.dontload failed with error -2
[   12.682835] remoteproc remoteproc17: powering up 5d00000.r5f
[   12.694055] remoteproc remoteproc17: Direct firmware load for vision_apps_eaik/vx_app_rtos_linux_mcu2_1.dontload failed with error -2
[   12.711603] remoteproc remoteproc17: request_firmware failed: -2
[   12.750342] platform 5e00000.r5f: configured R5F for remoteproc mode
[   12.881956] platform 5e00000.r5f: assigned reserved memory node vision-apps-r5f-dma-memory@a6000000
[   12.891654] remoteproc remoteproc18: 5e00000.r5f is available
[   12.897704] remoteproc remoteproc18: Direct firmware load for j7-main-r5f1_0-fw failed with error -2
[   12.906889] remoteproc remoteproc18: powering up 5e00000.r5f
[   12.912615] remoteproc remoteproc18: Direct firmware load for j7-main-r5f1_0-fw failed with error -2
[   12.921755] remoteproc remoteproc18: request_firmware failed: -2
[   12.934140] platform 5f00000.r5f: configured R5F for remoteproc mode
[   12.971777] platform 5f00000.r5f: assigned reserved memory node vision-apps-r5f-dma-memory@a7000000
[   12.981484] remoteproc remoteproc19: 5f00000.r5f is available
[   12.988084] remoteproc remoteproc19: Direct firmware load for j7-main-r5f1_1-fw failed with error -2
[   12.997280] remoteproc remoteproc19: powering up 5f00000.r5f
[   13.003013] remoteproc remoteproc19: Direct firmware load for j7-main-r5f1_1-fw failed with error -2
[   13.012178] remoteproc remoteproc19: request_firmware failed: -2
[   13.195142] using random self ethernet address
[   13.199665] using random host ethernet address
[   13.367368] using random self ethernet address
[   13.371919] using random host ethernet address
[   13.456482] Mass Storage Function, version: 2009/09/11
[   13.461691] LUN: removable file: (no medium)
[   13.486855] Adding 2097148k swap on /var/swap.  Priority:-2 extents:3 across:2236412k SSFS
[   13.945304] cfg80211: Loading compiled-in X.509 certificates for regulatory database
[   13.962921] cfg80211: Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'
[   14.384102] virtio_rpmsg_bus virtio0: rpmsg host is online
[   14.384528] virtio_rpmsg_bus virtio1: rpmsg host is online
[   14.384888] virtio_rpmsg_bus virtio2: rpmsg host is online
[   14.385169] virtio_rpmsg_bus virtio3: rpmsg host is online
[   14.395237] virtio_rpmsg_bus virtio2: creating channel rpmsg_chrdev addr 0xd
[   14.395401] virtio_rpmsg_bus virtio0: creating channel rpmsg_chrdev addr 0xd
[   14.395459] virtio_rpmsg_bus virtio1: creating channel rpmsg_chrdev addr 0xd
[   14.401943] virtio_rpmsg_bus virtio3: creating channel ti.ipc4.ping-pong addr 0xd
[   14.402084] virtio_rpmsg_bus virtio3: creating channel rpmsg_chrdev addr 0xe
[   14.414238] 88XXau: loading out-of-tree module taints kernel.
[   14.430655] cdns-csi2rx 4504000.csi-bridge: Probed CSI2RX with 2/4 lanes, 4 streams, external D-PHY
[   14.432410] cdns-csi2rx: probe of 4514000.csi-bridge failed with error -22
[   14.783615] usb 1-1.1: 88XXau 34:60:f9:e7:b8:68 hw_info[107]
[   14.795936] usbcore: registered new interface driver rtl88XXau
[   15.334145] IPv6: ADDRCONF(NETDEV_CHANGE): wlan0: link becomes ready
[   15.649070] aufs 5.10.140-20230227
[   18.508525] usb0: HOST MAC 24:76:25:a0:fe:40
[   18.512842] usb0: MAC 24:76:25:a0:fe:41
[   18.517178] usb1: HOST MAC 24:76:25:a0:fe:42
[   18.521503] usb1: MAC 24:76:25:a0:fe:43
[   18.819379] audit: type=1400 audit(1659878719.584:11): apparmor="STATUS" operation="profile_load" profile="unconfined" name="docker-default" pid=1045 comm="apparmor_parser"
[   19.411391] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this.
[   19.432326] Bridge firewalling registered
[   19.735373] Initializing XFRM netlink socket
[   20.542299] systemd-journald[457]: File /var/log/journal/2bda0d0cd8b24efcac2afdbf9138d6f9/user-1000.journal corrupted or uncleanly shut down, renaming and replacing.
[ 2834.582027] j721e-csi2rx 4500000.ticsi2rx: Failed to drain DMA. Next frame might be bogus
[ 5354.456403] usb 2-1.2.4: new SuperSpeed Gen 1 USB device number 4 using xhci-hcd
[ 5354.483564] usb 2-1.2.4: New USB device found, idVendor=18a5, idProduct=0243, bcdDevice= 1.00
[ 5354.492085] usb 2-1.2.4: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[ 5354.499560] usb 2-1.2.4: Product: STORE N GO
[ 5354.503835] usb 2-1.2.4: Manufacturer: Verbatim
[ 5354.508359] usb 2-1.2.4: SerialNumber: 0721291E10298577
[ 5354.515013] usb-storage 2-1.2.4:1.0: USB Mass Storage device detected
[ 5354.522076] scsi host0: usb-storage 2-1.2.4:1.0
[ 5355.557402] scsi 0:0:0:0: Direct-Access     Verbatim STORE N GO       PMAP PQ: 0 ANSI: 6
[ 5355.566497] sd 0:0:0:0: [sda] 121145344 512-byte logical blocks: (62.0 GB/57.8 GiB)
[ 5355.575858] sd 0:0:0:0: [sda] Write Protect is off
[ 5355.580734] sd 0:0:0:0: [sda] Mode Sense: 2b 00 00 08
[ 5355.581486] sd 0:0:0:0: [sda] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA
[ 5355.616520] sd 0:0:0:0: Attached scsi generic sg0 type 0
[ 5357.204788]  sda: sda1
[ 5357.222014] sd 0:0:0:0: [sda] Attached SCSI removable disk
[ 9488.071858] sda: detected capacity change from 62026416128 to 0
[ 9493.570045] usb 2-1.2.4: USB disconnect, device number 4
$media-ctl -d /dev/media0 -p
Media controller API version 5.10.162

Media device information
------------------------
driver          j721e-csi2rx
model           TI-CSI2RX
serial          
bus info        platform:4500000.ticsi2rx
hw revision     0x1
driver version  5.10.162

Device topology
- entity 1: 4500000.ticsi2rx (17 pads, 17 links)
            type V4L2 subdev subtype Unknown flags 0
            device node name /dev/v4l-subdev0
	pad0: Sink
		[fmt:UYVY8_1X16/640x480 field:none colorspace:srgb xfer:srgb ycbcr:601 quantization:lim-range]
		<- "cdns_csi2rx.4504000.csi-bridge":1 [ENABLED,IMMUTABLE]
	pad1: Source
		[fmt:UYVY8_1X16/640x480 field:none colorspace:srgb xfer:srgb ycbcr:601 quantization:lim-range]
		-> "4500000.ticsi2rx context 0":0 [ENABLED,IMMUTABLE]
	pad2: Source
		-> "4500000.ticsi2rx context 1":0 [ENABLED,IMMUTABLE]
	pad3: Source
		-> "4500000.ticsi2rx context 2":0 [ENABLED,IMMUTABLE]
	pad4: Source
		-> "4500000.ticsi2rx context 3":0 [ENABLED,IMMUTABLE]
	pad5: Source
		-> "4500000.ticsi2rx context 4":0 [ENABLED,IMMUTABLE]
	pad6: Source
		-> "4500000.ticsi2rx context 5":0 [ENABLED,IMMUTABLE]
	pad7: Source
		-> "4500000.ticsi2rx context 6":0 [ENABLED,IMMUTABLE]
	pad8: Source
		-> "4500000.ticsi2rx context 7":0 [ENABLED,IMMUTABLE]
	pad9: Source
		-> "4500000.ticsi2rx context 8":0 [ENABLED,IMMUTABLE]
	pad10: Source
		-> "4500000.ticsi2rx context 9":0 [ENABLED,IMMUTABLE]
	pad11: Source
		-> "4500000.ticsi2rx context 10":0 [ENABLED,IMMUTABLE]
	pad12: Source
		-> "4500000.ticsi2rx context 11":0 [ENABLED,IMMUTABLE]
	pad13: Source
		-> "4500000.ticsi2rx context 12":0 [ENABLED,IMMUTABLE]
	pad14: Source
		-> "4500000.ticsi2rx context 13":0 [ENABLED,IMMUTABLE]
	pad15: Source
		-> "4500000.ticsi2rx context 14":0 [ENABLED,IMMUTABLE]
	pad16: Source
		-> "4500000.ticsi2rx context 15":0 [ENABLED,IMMUTABLE]

- entity 19: cdns_csi2rx.4504000.csi-bridge (5 pads, 2 links)
             type V4L2 subdev subtype Unknown flags 0
             device node name /dev/v4l-subdev1
	pad0: Sink
		[fmt:UYVY8_1X16/640x480 field:none colorspace:srgb xfer:srgb ycbcr:601 quantization:lim-range]
		<- "imx219 6-0010":0 [ENABLED,IMMUTABLE]
	pad1: Source
		[fmt:UYVY8_1X16/640x480 field:none colorspace:srgb xfer:srgb ycbcr:601 quantization:lim-range]
		-> "4500000.ticsi2rx":0 [ENABLED,IMMUTABLE]
	pad2: Source
		[fmt:UYVY8_1X16/640x480 field:none colorspace:srgb xfer:srgb ycbcr:601 quantization:lim-range]
	pad3: Source
		[fmt:UYVY8_1X16/640x480 field:none colorspace:srgb xfer:srgb ycbcr:601 quantization:lim-range]
	pad4: Source
		[fmt:UYVY8_1X16/640x480 field:none colorspace:srgb xfer:srgb ycbcr:601 quantization:lim-range]

- entity 25: imx219 6-0010 (1 pad, 1 link)
             type V4L2 subdev subtype Sensor flags 0
             device node name /dev/v4l-subdev2
	pad0: Source
		[fmt:SRGGB10_1X10/3280x2464 field:none colorspace:srgb xfer:srgb ycbcr:601 quantization:full-range
		 crop.bounds:(8,8)/3280x2464
		 crop:(8,8)/3280x2464]
		-> "cdns_csi2rx.4504000.csi-bridge":0 [ENABLED,IMMUTABLE]

- entity 31: 4500000.ticsi2rx context 0 (1 pad, 1 link)
             type Node subtype V4L flags 0
             device node name /dev/video2
	pad0: Sink
		<- "4500000.ticsi2rx":1 [ENABLED,IMMUTABLE]

- entity 37: 4500000.ticsi2rx context 1 (1 pad, 1 link)
             type Node subtype V4L flags 0
             device node name /dev/video3
	pad0: Sink
		<- "4500000.ticsi2rx":2 [ENABLED,IMMUTABLE]

- entity 43: 4500000.ticsi2rx context 2 (1 pad, 1 link)
             type Node subtype V4L flags 0
             device node name /dev/video4
	pad0: Sink
		<- "4500000.ticsi2rx":3 [ENABLED,IMMUTABLE]

- entity 49: 4500000.ticsi2rx context 3 (1 pad, 1 link)
             type Node subtype V4L flags 0
             device node name /dev/video5
	pad0: Sink
		<- "4500000.ticsi2rx":4 [ENABLED,IMMUTABLE]

- entity 55: 4500000.ticsi2rx context 4 (1 pad, 1 link)
             type Node subtype V4L flags 0
             device node name /dev/video6
	pad0: Sink
		<- "4500000.ticsi2rx":5 [ENABLED,IMMUTABLE]

- entity 61: 4500000.ticsi2rx context 5 (1 pad, 1 link)
             type Node subtype V4L flags 0
             device node name /dev/video7
	pad0: Sink
		<- "4500000.ticsi2rx":6 [ENABLED,IMMUTABLE]

- entity 67: 4500000.ticsi2rx context 6 (1 pad, 1 link)
             type Node subtype V4L flags 0
             device node name /dev/video8
	pad0: Sink
		<- "4500000.ticsi2rx":7 [ENABLED,IMMUTABLE]

- entity 73: 4500000.ticsi2rx context 7 (1 pad, 1 link)
             type Node subtype V4L flags 0
             device node name /dev/video9
	pad0: Sink
		<- "4500000.ticsi2rx":8 [ENABLED,IMMUTABLE]

- entity 79: 4500000.ticsi2rx context 8 (1 pad, 1 link)
             type Node subtype V4L flags 0
             device node name /dev/video10
	pad0: Sink
		<- "4500000.ticsi2rx":9 [ENABLED,IMMUTABLE]

- entity 85: 4500000.ticsi2rx context 9 (1 pad, 1 link)
             type Node subtype V4L flags 0
             device node name /dev/video11
	pad0: Sink
		<- "4500000.ticsi2rx":10 [ENABLED,IMMUTABLE]

- entity 91: 4500000.ticsi2rx context 10 (1 pad, 1 link)
             type Node subtype V4L flags 0
             device node name /dev/video12
	pad0: Sink
		<- "4500000.ticsi2rx":11 [ENABLED,IMMUTABLE]

- entity 97: 4500000.ticsi2rx context 11 (1 pad, 1 link)
             type Node subtype V4L flags 0
             device node name /dev/video13
	pad0: Sink
		<- "4500000.ticsi2rx":12 [ENABLED,IMMUTABLE]

- entity 103: 4500000.ticsi2rx context 12 (1 pad, 1 link)
              type Node subtype V4L flags 0
              device node name /dev/video14
	pad0: Sink
		<- "4500000.ticsi2rx":13 [ENABLED,IMMUTABLE]

- entity 109: 4500000.ticsi2rx context 13 (1 pad, 1 link)
              type Node subtype V4L flags 0
              device node name /dev/video15
	pad0: Sink
		<- "4500000.ticsi2rx":14 [ENABLED,IMMUTABLE]

- entity 115: 4500000.ticsi2rx context 14 (1 pad, 1 link)
              type Node subtype V4L flags 0
              device node name /dev/video16
	pad0: Sink
		<- "4500000.ticsi2rx":15 [ENABLED,IMMUTABLE]

- entity 121: 4500000.ticsi2rx context 15 (1 pad, 1 link)
              type Node subtype V4L flags 0
              device node name /dev/video17
	pad0: Sink
		<- "4500000.ticsi2rx":16 [ENABLED,IMMUTABLE]
$v4l2-ctl -d /dev/v4l-subdev2 --list-subdev-mbus-codes 0
ioctl: VIDIOC_SUBDEV_ENUM_MBUS_CODE (pad=0)
	0x300f: MEDIA_BUS_FMT_SRGGB10_1X10
	0x3014: MEDIA_BUS_FMT_SRGGB8_1X8
$v4l2-ctl -d /dev/v4l-subdev2 --list-subdev-framesizes pad=0,code=0x300f
ioctl: VIDIOC_SUBDEV_ENUM_FRAME_SIZE (pad=0)
	Size Range: 3280x2464 - 3280x2464
	Size Range: 1920x1080 - 1920x1080
	Size Range: 1640x1232 - 1640x1232
	Size Range: 640x480 - 640x480
$v4l2-ctl -d /dev/video2 --list-formats-ext
ioctl: VIDIOC_ENUM_FMT
	Type: Video Capture

	[0]: 'YUYV' (YUYV 4:2:2)
		Size: Stepwise 8x1 - 16777216x16777216 with step 8/1
	[1]: 'UYVY' (UYVY 4:2:2)
		Size: Stepwise 8x1 - 16777216x16777216 with step 8/1
	[2]: 'YVYU' (YVYU 4:2:2)
		Size: Stepwise 8x1 - 16777216x16777216 with step 8/1
	[3]: 'VYUY' (VYUY 4:2:2)
		Size: Stepwise 8x1 - 16777216x16777216 with step 8/1
	[4]: 'BA81' (8-bit Bayer BGBG/GRGR)
		Size: Stepwise 16x1 - 16777216x16777216 with step 16/1
	[5]: 'GBRG' (8-bit Bayer GBGB/RGRG)
		Size: Stepwise 16x1 - 16777216x16777216 with step 16/1
	[6]: 'GRBG' (8-bit Bayer GRGR/BGBG)
		Size: Stepwise 16x1 - 16777216x16777216 with step 16/1
	[7]: 'RGGB' (8-bit Bayer RGRG/GBGB)
		Size: Stepwise 16x1 - 16777216x16777216 with step 16/1
	[8]: 'BG10' (10-bit Bayer BGBG/GRGR)
		Size: Stepwise 8x1 - 16777216x16777216 with step 8/1
	[9]: 'GB10' (10-bit Bayer GBGB/RGRG)
		Size: Stepwise 8x1 - 16777216x16777216 with step 8/1
	[10]: 'BA10' (10-bit Bayer GRGR/BGBG)
		Size: Stepwise 8x1 - 16777216x16777216 with step 8/1
	[11]: 'RG10' (10-bit Bayer RGRG/GBGB)
		Size: Stepwise 8x1 - 16777216x16777216 with step 8/1
	[12]: 'BG12' (12-bit Bayer BGBG/GRGR)
		Size: Stepwise 8x1 - 16777216x16777216 with step 8/1
	[13]: 'GB12' (12-bit Bayer GBGB/RGRG)
		Size: Stepwise 8x1 - 16777216x16777216 with step 8/1
	[14]: 'BA12' (12-bit Bayer GRGR/BGBG)
		Size: Stepwise 8x1 - 16777216x16777216 with step 8/1
	[15]: 'RG12' (12-bit Bayer RGRG/GBGB)
		Size: Stepwise 8x1 - 16777216x16777216 with step 8/1
	[16]: 'RGI0' (10-bit Bayer RGBG/GIrGIr)
		Size: Stepwise 8x1 - 16777216x16777216 with step 8/1
	[17]: 'GRI0' (10-bit Bayer GRGB/IrGIrG)
		Size: Stepwise 8x1 - 16777216x16777216 with step 8/1
	[18]: 'BGI0' (10-bit Bayer BGRG/GIrGIr)
		Size: Stepwise 8x1 - 16777216x16777216 with step 8/1
	[19]: 'GBI0' (10-bit Bayer GBGR/IrGIrG)
		Size: Stepwise 8x1 - 16777216x16777216 with step 8/1
	[20]: 'GIR0' (10-bit Bayer GIrGIr/RGBG)
		Size: Stepwise 8x1 - 16777216x16777216 with step 8/1
	[21]: 'IGR0' (10-bit Bayer IrGIrG/GRGB)
		Size: Stepwise 8x1 - 16777216x16777216 with step 8/1
	[22]: 'GIB0' (10-bit Bayer GIrGIr/BGRG)
		Size: Stepwise 8x1 - 16777216x16777216 with step 8/1
	[23]: 'IGB0' (10-bit Bayer IrGIrG/GBGR)
		Size: Stepwise 8x1 - 16777216x16777216 with step 8/1

I tried some things with media-ctl, v4l2-ctl and gst-launch-1.0, but until yet I only got some output in different raw-formats:

I configured the pipeline for 10bit:
media-ctl -d 0 --set-v4l2 ‘“imx219 6-0010”:0[fmt:SRGGB10_1X10/3280x2464]’
media-ctl -d 0 --set-v4l2 ‘“cdns_csi2rx.4504000.csi-bridge”:0[fmt:SRGGB10_1X10/3280x2464]’
media-ctl -d 0 --set-v4l2 ‘“4500000.ticsi2rx”:0[fmt:SRGGB10_1X10/3280x2464]’
v4l2-ctl -d /dev/video2 --set-fmt-video width=3280,height=2464,pixelformat=RG10

These Pixelformats I could use then:

v4l2-ctl --device=/dev/video2 --set-fmt-video=width=1920,height=1080,pixelformat=BG10 --stream-mmap --stream-to=./BB_hd_BG10_50.raw --stream-count=50

v4l2-ctl --device=/dev/video2 --set-fmt-video=width=1920,height=1080,pixelformat=GB10 --stream-mmap --stream-to=./BB_hd_GB10_1.raw --stream-count=1

v4l2-ctl --device=/dev/video2 --set-fmt-video=width=1920,height=1080,pixelformat=GB10 --stream-mmap --stream-to=./BB_hd_GB10_100.raw --stream-count=100

v4l2-ctl --device=/dev/video2 --set-fmt-video=width=1920,height=1080,pixelformat=RG10 --stream-mmap --stream-to=./BB_hd_RG10_1.raw --stream-count=1

v4l2-ctl --device=/dev/video2 --set-fmt-video=width=1920,height=1080,pixelformat=BA10 --stream-mmap --stream-to=./BB_hd_BA10_50.raw --stream-count=50

v4l2-ctl --device=/dev/video2 --set-fmt-video=width=1920,height=1080,pixelformat=RG10 --stream-mmap --stream-to=./BB_hd_RG10_100.raw --stream-count=100

v4l2-ctl --device=/dev/video2 --set-fmt-video=width=1920,height=1080,pixelformat=RGI0 --stream-mmap --stream-to=./BB_hd_RGI0_50.raw --stream-count=50

v4l2-ctl --device=/dev/video2 --set-fmt-video=width=1920,height=1080,pixelformat=GRI0 --stream-mmap --stream-to=./BB_hd_GRI0_50.raw --stream-count=50

v4l2-ctl --device=/dev/video2 --set-fmt-video=width=1920,height=1080,pixelformat=BGI0 --stream-mmap --stream-to=./BB_hd_BGI0_50.raw --stream-count=50

v4l2-ctl --device=/dev/video2 --set-fmt-video=width=1920,height=1080,pixelformat=GBI0 --stream-mmap --stream-to=./BB_hd_GBI0_50.raw --stream-count=50

v4l2-ctl --device=/dev/video2 --set-fmt-video=width=1920,height=1080,pixelformat=GIR0 --stream-mmap --stream-to=./BB_hd_GIR0_50.raw --stream-count=50

v4l2-ctl --device=/dev/video2 --set-fmt-video=width=1920,height=1080,pixelformat=IGR0 --stream-mmap --stream-to=./BB_hd_IGR0_50.raw --stream-count=50

v4l2-ctl --device=/dev/video2 --set-fmt-video=width=1920,height=1080,pixelformat=GIB0 --stream-mmap --stream-to=./BB_hd_GIB0_50.raw --stream-count=50

v4l2-ctl --device=/dev/video2 --set-fmt-video=width=1920,height=1080,pixelformat=IGB0 --stream-mmap --stream-to=./BB_hd_IGB0_50.raw --stream-count=50

The same works for 8 bit.

But I’m not shure how to get a pipeline to autovideosink configured with gst-launch-1.0.

This easy example is doing something, but gives me no output on the screen:

$gst-launch-1.0 v4l2src device=/dev/video2 ! autovideosink
Setting pipeline to PAUSED ...
Pipeline is live and does not need PREROLL ...
Got context from element 'autovideosink0': gst.gl.GLDisplay=context, gst.gl.GLDisplay=(GstGLDisplay)"\(GstGLDisplayX11\)\ gldisplayx11-0";
Pipeline is PREROLLED ...
Setting pipeline to PLAYING ...
New clock: GstSystemClock

!!! Stopped it with <CTRL>+<C>

handling interrupt.
Interrupt: Stopping pipeline ...
Execution ended after 0:00:03.021667879
Setting pipeline to NULL ...
Freeing pipeline ...

I tried with different variations of video/x-bayer/raw, bayer2rgb, videoconvert etc., but nothing worked.

Next question would be, how I can use the VPAC ISP. I saw. that there are some GStreamer-Plugins for the TIOVX-API available, but the example pipeline is not working on my Image.

$sudo gst-launch-1.0 videotestsrc is-live=true num-buffers=5 ! "video/x-raw,format=RGBx,width=1280,height=720" ! identity silent=false ! tiovxcolorconvert ! "video/x-raw,format=NV12,width=1280,height=720" ! tiovxmultiscaler name=multi multi. ! "video/x-raw,format=NV12,width=640,height=480" ! filesink location=conv_scale.raw -e
APP: Init ... !!!
MEM: Init ... !!!
MEM: Initialized DMA HEAP (fd=4) !!!
MEM: Init ... Done !!!
IPC: Init ... !!!
IPC: ERROR: Unable to create TX channels for CPU [mcu2_0] !!!
IPC: ERROR: Unable to create TX channels for CPU [mcu2_1] !!!
IPC: Init ... Done !!!
APP: ERROR: IPC init failed !!!
REMOTE_SERVICE: Init ... !!!
REMOTE_SERVICE: Init ... Done !!!
  5516.406155 s: GTC Frequency = 200 MHz
APP: Init ... Done !!!
  5516.406254 s:  VX_ZONE_INIT:Enabled
  5516.406257 s:  VX_ZONE_ERROR:Enabled
  5516.406259 s:  VX_ZONE_WARNING:Enabled
  5516.406963 s:  VX_ZONE_INIT:[tivxInitLocal:130] Initialization Done !!!
  5516.407185 s:  VX_ZONE_INIT:[tivxHostInitLocal:86] Initialization Done for HOST !!!
  5516.407467 s:  VX_ZONE_ERROR:[ownContextCreateCmdObj:161] context object descriptor [0] allocation failed
  5516.407472 s:  VX_ZONE_ERROR:[vxCreateContext:946] context objection creation failed
  5516.407476 s:  VX_ZONE_ERROR:[vxGetStatus:713] Reference is NULL
  5516.408175 s:  VX_ZONE_ERROR:[ownContextCreateCmdObj:161] context object descriptor [0] allocation failed
  5516.408182 s:  VX_ZONE_ERROR:[vxCreateContext:946] context objection creation failed
  5516.408186 s:  VX_ZONE_ERROR:[vxGetStatus:713] Reference is NULL
Setting pipeline to PAUSED ...
Pipeline is live and does not need PREROLL ...
Pipeline is PREROLLED ...
Setting pipeline to PLAYING ...
New clock: GstSystemClock
  5516.429670 s:  VX_ZONE_ERROR:[vxGetStatus:713] Reference is NULL
  5516.430442 s:  VX_ZONE_ERROR:[vxGetStatus:713] Reference is NULL
Execution ended after 0:00:00.012709618
Setting pipeline to NULL ...
Freeing pipeline ...
  5516.460756 s:  VX_ZONE_ERROR:[vxGetStatus:713] Reference is NULL

Also the image is missing the imx219-Profiles for tiovxisp:
/opt/imaging/imx219/dcc_2a.bin
/opt/imaging/imx219/dcc_2a_8b.bin
/opt/imaging/imx219/dcc_2a_10b.bin
/opt/imaging/imx219/dcc_viss.bin
/opt/imaging/imx219/dcc_viss_8b.bin
/opt/imaging/imx219/dcc_viss_10b.bin

I also tried to get some informations out of this outdated manual:
https://docs.beagleboard.org/latest/boards/beaglebone/ai-64/edge_ai_apps/getting_started.html

Would be great, if somebody could help me to understand the concept of configuring the pipeline better. Maybe there are also some issues to solve with the drivers and the devictree overlay.

Longterm goal could be to implement an pipline handler for libcamera. :slight_smile:

1 Like

Hi @Beutomaster,

I am not too involved with the vision aspects of BBAI-64 but, I have been following along with progress. I have two tips for you:

  1. Update to a newer image such as one of these monthly snapshot images:
  1. Check out this thread that DenRyu started:

I followed DenRyu’s steps and successfully streamed video from the imx219 (V2 RPi camera) to screen.

Please keep us posted if you make any further progress.

Regards,
FredE

1 Like

Thanks to this post I finally got around to testing this, I was able to find the .bin files (I assume, setting profiles) from TI’s git service: processor-sdk/imaging - Unnamed repository; edit this file 'description' to name the repository.

I picked the 8.02.00.01 version, but I imagine newer works too. For testing I did:

sudo gst-launch-1.0 v4l2src device=/dev/video2 ! video/x-bayer, width=1920, height=1080, format=rggb ! tiovxisp sink_0::device=/dev/v4l-subdev2 sensor-name=SENSOR_SONY_IMX219_RPI dcc-isp-file=/home/debian/imaging-REL.PSDK.JACINTO.08.02.00.01/sensor_drv/src/imx219/dcc_bins/dcc_viss.bin sink_0::dcc-2a-file=/home/debian/imaging-REL.PSDK.JACINTO.08.02.00.01/sensor_drv/src/imx219/dcc_bins/dcc_2a.bin format-msb=7 ! timeoverlay ! jpegenc ! multifilesink location="./images/img_%06d.jpg"

I haven’t tried a more “proper” sink than JPEGs.

1 Like

Thanks for the hint with the monthly builds. The tiovxisp seems to work in this image: https://rcn-ee.com/rootfs/bb.org/testing/2023-03-10/bullseye-xfce-edgeai-arm64/bbai64-debian-11.6-xfce-edgeai-arm64-2023-03-10-10gb.img.xz

The topic AI-64 Streaming H.264 encoded video from an IMX219 CSI-2 camera I had read before. But I still don’t get any output on my screen with this command:

$ sudo gst-launch-1.0 v4l2src device=/dev/video2 ! video/x-bayer, width=1920, height=1080, format=rggb ! tiovxisp sink_0::device=/dev/v4l-subdev2 sensor-name=SENSOR_SONY_IMX219_RPI dcc-isp-file=/opt/imaging/imx219/dcc_viss.bin sink_0::dcc-2a-file=/opt/imaging/imx219/dcc1/dcc_2a.bin format-msb=7 ! autovideosink
APP: Init ... !!!
MEM: Init ... !!!
MEM: Initialized DMA HEAP (fd=5) !!!
MEM: Init ... Done !!!
IPC: Init ... !!!
IPC: Init ... Done !!!
REMOTE_SERVICE: Init ... !!!
REMOTE_SERVICE: Init ... Done !!!
  2780.499180 s: GTC Frequency = 200 MHz
APP: Init ... Done !!!
  2780.499291 s:  VX_ZONE_INIT:Enabled
  2780.499310 s:  VX_ZONE_ERROR:Enabled
  2780.499324 s:  VX_ZONE_WARNING:Enabled
  2780.499985 s:  VX_ZONE_INIT:[tivxInitLocal:130] Initialization Done !!!
  2780.500216 s:  VX_ZONE_INIT:[tivxHostInitLocal:86] Initialization Done for HOST !!!
Setting pipeline to PAUSED ...
error: XDG_RUNTIME_DIR not set in the environment.
Pipeline is live and does not need PREROLL ...
Got context from element 'autovideosink0': gst.gl.GLDisplay=context, gst.gl.GLDisplay=(GstGLDisplay)"\(GstGLDisplayX11\)\ gldisplayx11-0";
Pipeline is PREROLLED ...
Setting pipeline to PLAYING ...
New clock: GstSystemClock

!!! Stopped it with <CTRL>+<C>

^Chandling interrupt.
Interrupt: Stopping pipeline ...
Execution ended after 0:02:24.147924295
Setting pipeline to NULL ...
Freeing pipeline ...
  2925.147360 s:  VX_ZONE_INIT:[tivxHostDeInitLocal:100] De-Initialization Done for HOST !!!
  2925.151289 s:  VX_ZONE_INIT:[tivxDeInitLocal:193] De-Initialization Done !!!
APP: Deinit ... !!!
REMOTE_SERVICE: Deinit ... !!!
REMOTE_SERVICE: Deinit ... Done !!!
IPC: Deinit ... !!!
IPC: DeInit ... Done !!!
MEM: Deinit ... !!!
MEM: Alloc's: 0 alloc's of 0 bytes 
MEM: Free's : 0 free's  of 0 bytes 
MEM: Open's : 0 allocs  of 0 bytes 
MEM: Deinit ... Done !!!
APP: Deinit ... Done !!!

Any good advises?

One thing I noticed last night, but I wasn’t able to edit my original post at this point, is that I had a typo from in my command (left over from an experiment) and should have removed the “dcc1” folder in my command “…dcc-2a-file=/opt/imaging/imx219/dcc1/dcc_2a.bin…” so if you have the files (out of the TI provided PSDK or from the TI Imaging project git repository as @kaelinl did in the post above) copied into the expected/required directory “/opt/imaging/imx219” then the dcc_2a.bin would be pointing to the incorrect directory.

Have you checked that the imx219 module is loaded correctly?

dmesg | grep imx219

Do you see the camera node in the Video 4 Linux tree?

media-ctl -d /dev/media0 -p

(Note: it could be /dev/media1 as well depending on your setup)

Did you run the init_script before issuing the gstreamer command?
/opt/edge_ai_apps/init_script.sh

Also, I believe there is a bug with the BBAI64-CSI1-imx219.dtbo device tree overlay (I’ve posted an Issue on the Device Tree GitHub repository) so as a workaround I would use BBAI64-CSI0-imx219.dtbo until it is updated unless you want\need to go through the steps of updating it yourself.

Also, you could try using the built in gsteamer test stream to see if it pops up a video window at least to verify gstreamer is working properly.

gst-launch-1.0 videotestsrc ! video/x-raw, format=, width=640, height=480 ! autovideosink
1 Like

Thanks for all your help.

I could get an output for 8-bit with the IMX219 ISP Tuning-binaries from processor-sdk/imaging - Unnamed repository; edit this file 'description' to name the repository. . This is the version matching to the Processor SDK in the last image I mentioned above. It does not have the binaries for 10-bit included, like newer versions.

curl -O https://git.ti.com/cgit/processor-sdk/imaging/snapshot/imaging-REL.PSDK.JACINTO.08.02.00.02.zip
sudo unzip imaging-REL.PSDK.JACINTO.08.02.00.02.zip -d /opt/

You have to start the init-script to set up the camera to SRGGB8_1X8/1920x1080, because it is automatically set up for SRGGB10_1X10/3280x2464 right after starting the image with the the overlays mentioned in my other posts above:

sudo /opt/edge_ai_apps/init_script.sh

If you unpacked the SDK imaging folder like me, you could get an Gstreamer-Output with this command:

sudo gst-launch-1.0 v4l2src device=/dev/video2 ! video/x-bayer, width=1920, height=1080, format=rggb ! tiovxisp sink_0::device=/dev/v4l-subdev2 sensor-name=SENSOR_SONY_IMX219_RPI dcc-isp-file=/opt/imaging-REL.PSDK.JACINTO.08.02.00.02/sensor_drv/src/imx219/dcc_bins/dcc_viss.bin sink_0::dcc-2a-file=/opt/imaging-REL.PSDK.JACINTO.08.02.00.02/sensor_drv/src/imx219/dcc_bins/dcc_2a.bin format-msb=7 ! autovideosink

It’s also working with the newest Version:

curl -O https://git.ti.com/cgit/processor-sdk/imaging/snapshot/imaging-REL.PSDK.JACINTO.08.06.00.14.zip
sudo unzip imaging-REL.PSDK.JACINTO.08.06.00.14.zip -d /opt/

sudo /opt/edge_ai_apps/init_script.sh

sudo gst-launch-1.0 v4l2src device=/dev/video2 ! video/x-bayer, width=1920, height=1080, format=rggb ! tiovxisp sink_0::device=/dev/v4l-subdev2 sensor-name=SENSOR_SONY_IMX219_RPI dcc-isp-file=/opt/imaging-REL.PSDK.JACINTO.08.06.00.14/sensor_drv/src/imx219/dcc_bins/dcc_viss.bin sink_0::dcc-2a-file=/opt/imaging-REL.PSDK.JACINTO.08.06.00.14/sensor_drv/src/imx219/dcc_bins/dcc_2a.bin format-msb=7 ! autovideosink

In this version are also 10bit-binaries included. There are also different binaries for different resolutions included, but I could not see any difference.

The init-script only works for 8-bit in 1920x1080. If you want to use other formats, you have to use media-ctl to set up the camera-subdevice. You don’t have to use it for all devices in the pipeline as I mentioned in my first post. I can’t edit my first post anymore, but I forgot to format the commands as code and there was an autocorrect error in the quotation marks:

It should have looked like that:

media-ctl -d 0 --set-v4l2 '"imx219 6-0010":0[fmt:SRGGB10_1X10/3280x2464]'
media-ctl -d 0 --set-v4l2 '"cdns_csi2rx.4504000.csi-bridge":0[fmt:SRGGB10_1X10/3280x2464]'
media-ctl -d 0 --set-v4l2 '"4500000.ticsi2rx":0[fmt:SRGGB10_1X10/3280x2464]'
v4l2-ctl -d /dev/video2 --set-fmt-video width=3280,height=2464,pixelformat=RG10

But you only need the first line!

For example for configuring the CSI0-camera to full resolution in 8-bit, you need this:

media-ctl -d 0 --set-v4l2 '"imx219 6-0010":0[fmt:SRGGB8_1X8/3280x2464]'

And for the output with GStreamer:

sudo gst-launch-1.0 v4l2src device=/dev/video2 ! video/x-bayer, width=3280, height=2464, format=rggb ! tiovxisp sink_0::device=/dev/v4l-subdev2 sensor-name=SENSOR_SONY_IMX219_RPI dcc-isp-file=/opt/imaging-REL.PSDK.JACINTO.08.06.00.14/sensor_drv/src/imx219/dcc_bins/dcc_viss.bin sink_0::dcc-2a-file=/opt/imaging-REL.PSDK.JACINTO.08.06.00.14/sensor_drv/src/imx219/dcc_bins/dcc_2a.bin format-msb=7 ! kmssink driver-name=tidss

To configuring the CSI1-camera to full resolution in 8-bit, you need this:

media-ctl -d 1 --set-v4l2 '"imx219 4-0010":0[fmt:SRGGB8_1X8/3280x2464]'

Output with GStreamer:

sudo gst-launch-1.0 v4l2src device=/dev/video18 ! video/x-bayer, width=3280, height=2464, format=rggb ! tiovxisp sink_0::device=/dev/v4l-subdev5 sensor-name=SENSOR_SONY_IMX219_RPI dcc-isp-file=/opt/imaging-REL.PSDK.JACINTO.08.06.00.14/sensor_drv/src/imx219/dcc_bins/dcc_viss.bin sink_0::dcc-2a-file=/opt/imaging-REL.PSDK.JACINTO.08.06.00.14/sensor_drv/src/imx219/dcc_bins/dcc_2a.bin format-msb=7 ! kmssink driver-name=tidss

And of course, If you want to use a different format, you have to configure the camera again with media-ctl. You can always have only one format configured.
These following commands cover all MBus-Codes of the imx219.

CSI0, 8-bit:

media-ctl -d 0 --set-v4l2 '"imx219 6-0010":0[fmt:SRGGB8_1X8/640x480]'
media-ctl -d 0 --set-v4l2 '"imx219 6-0010":0[fmt:SRGGB8_1X8/1640x1232]'
media-ctl -d 0 --set-v4l2 '"imx219 6-0010":0[fmt:SRGGB8_1X8/1920x1080]'
media-ctl -d 0 --set-v4l2 '"imx219 6-0010":0[fmt:SRGGB8_1X8/3280x2464]'

CSI0, 10-bit:

media-ctl -d 0 --set-v4l2 '"imx219 6-0010":0[fmt:SRGGB10_1X10/640x480]'
media-ctl -d 0 --set-v4l2 '"imx219 6-0010":0[fmt:SRGGB10_1X10/1640x1232]'
media-ctl -d 0 --set-v4l2 '"imx219 6-0010":0[fmt:SRGGB10_1X10/1920x1080]'
media-ctl -d 0 --set-v4l2 '"imx219 6-0010":0[fmt:SRGGB10_1X10/3280x2464]'

CSI1, 8-bit:

media-ctl -d 1 --set-v4l2 '"imx219 4-0010":0[fmt:SRGGB8_1X8/640x480]'
media-ctl -d 1 --set-v4l2 '"imx219 4-0010":0[fmt:SRGGB8_1X8/1640x1232]'
media-ctl -d 1 --set-v4l2 '"imx219 4-0010":0[fmt:SRGGB8_1X8/1920x1080]'
media-ctl -d 1 --set-v4l2 '"imx219 4-0010":0[fmt:SRGGB8_1X8/3280x2464]'

CSI1, 10-bit:

media-ctl -d 1 --set-v4l2 '"imx219 4-0010":0[fmt:SRGGB10_1X10/640x480]'
media-ctl -d 1 --set-v4l2 '"imx219 4-0010":0[fmt:SRGGB10_1X10/1640x1232]'
media-ctl -d 1 --set-v4l2 '"imx219 4-0010":0[fmt:SRGGB10_1X10/1920x1080]'
media-ctl -d 1 --set-v4l2 '"imx219 4-0010":0[fmt:SRGGB10_1X10/3280x2464]'

But I’m still not able to get an output in 10-bit with the ISP from the camera.
This example is not working:

debian@BeagleBone:~$ media-ctl -d 0 --set-v4l2 '"imx219 6-0010":0[fmt:SRGGB10_1X10/3280x2464]'
debian@BeagleBone:~$ sudo gst-launch-1.0 v4l2src device=/dev/video2 ! video/x-bayer, width=3280, height=2464, format=rggb10 ! tiovxisp sink_0::device=/dev/v4l-subdev2 sensor-name=SENSOR_SONY_IMX219_RPI dcc-isp-file=/opt/imaging-REL.PSDK.JACINTO.08.06.00.14/sensor_drv/src/imx219/dcc_bins/dcc_viss_10b.bin sink_0::dcc-2a-file=/opt/imaging-REL.PSDK.JACINTO.08.06.00.14/sensor_drv/src/imx219/dcc_bins/dcc_2a_10b.bin format-msb=9 ! autovideosink
APP: Init ... !!!
MEM: Init ... !!!
MEM: Initialized DMA HEAP (fd=5) !!!
MEM: Init ... Done !!!
IPC: Init ... !!!
IPC: Init ... Done !!!
REMOTE_SERVICE: Init ... !!!
REMOTE_SERVICE: Init ... Done !!!
 12846.902032 s: GTC Frequency = 200 MHz
APP: Init ... Done !!!
 12846.902146 s:  VX_ZONE_INIT:Enabled
 12846.902158 s:  VX_ZONE_ERROR:Enabled
 12846.902164 s:  VX_ZONE_WARNING:Enabled
 12846.902829 s:  VX_ZONE_INIT:[tivxInitLocal:130] Initialization Done !!!
 12846.903008 s:  VX_ZONE_INIT:[tivxHostInitLocal:86] Initialization Done for HOST !!!
WARNING: erroneous pipeline: could not link v4l2src0 to tiovxisp0, v4l2src0 can't handle caps video/x-bayer, width=(int)3280, height=(int)2464, format=(string)rggb10

One thing I have to say about the fps-rate of the autovideosink. It is really low. The picture is much more fluid with the kmssink.

Could you please describe how you figured out the pipeline via g streamer? I managed to get the video streamed/saved via ffmpeg


ffmpeg -y -f v4l2 -pix_fmt bayer_rggb8 -video_size 1920x1080 -i /dev/video2 -r 30 -c:v libx264 -preset ultrafast -crf 23 -pix_fmt yuv420p -f mpegts udp://127.0.0.1:8555

But it uses so much CPU that the board is lagging. Maybe you could hint me how to configure a similar pipeline with gstreamer?

Update:
I tried your commands, and in my case driver tidss is missing, did you launch some install scripts?
Update num2:
I ran some tests in gst-plugins and two of them seem to be failing:
15/19 gsttiovxldc FAIL 0.56s exit status 5
17/19 gsttiovxmultiscaler FAIL 0.89s exit status 1

I went precisely through your steps, and up to here I got the same errors, but on this moment I again got a problem with tidss in dmesg | grep drm :

debian@BeagleBone:~$ dmesg | grep drm  
[    1.048552] [drm] Initialized tidss 1.0.0 20180215 for 4a00000.dss on minor 0
[    1.048605] tidss 4a00000.dss: [drm] Cannot find any crtc or sizes
[    6.303074] systemd[1]: Starting Load Kernel Module drm...
[    6.353560] systemd[1]: modprobe@drm.service: Succeeded.
[    6.354109] systemd[1]: Finished Load Kernel Module drm.

and when I try to run your pipeline:

sudo gst-launch-1.0 v4l2src device=/dev/video2 ! video/x-bayer, width=1920, height=1080, format=rggb ! tiovxisp sink_0::device=/dev/v4l-subdev2 sensor-name=SENSOR_SONY_IMX219_RPI dcc-isp-file=/opt/imaging-REL.PSDK.JACINTO.08.02.00.02/sensor_drv/src/imx219/dcc_bins/dcc_viss.bin sink_0::dcc-2a-file=/opt/imaging-REL.PSDK.JACINTO.08.02.00.02/sensor_drv/src/imx219/dcc_bins/dcc_2a.bin format-msb=7 ! autovideosink
debian@BeagleBone:~$ ^C
debian@BeagleBone:~$ sudo gst-launch-1.0 v4l2src device=/dev/video2 ! video/x-bayer, width=1920, height=1080, format=rggb ! tiovxisp sink_0::device=/dev/v4l-subdev2 sensor-name=SENSOR_SONY_IMX219_RPI dcc-isp-file=/opt/imaging-REL.PSDK.JACINTO.08.02.00.02/sensor_drv/src/imx219/dcc_bins/dcc_viss.bin sink_0::dcc-2a-file=/opt/imaging-REL.PSDK.JACINTO.08.02.00.02/sensor_drv/src/imx219/dcc_bins/dcc_2a.bin format-msb=7 ! autovideosink
[sudo] password for debian: 
APP: Init ... !!!
MEM: Init ... !!!
MEM: Initialized DMA HEAP (fd=5) !!!
MEM: Init ... Done !!!
IPC: Init ... !!!
IPC: Init ... Done !!!
REMOTE_SERVICE: Init ... !!!
REMOTE_SERVICE: Init ... Done !!!
  2525.000740 s: GTC Frequency = 200 MHz
APP: Init ... Done !!!
  2525.007235 s:  VX_ZONE_INIT:Enabled
  2525.007265 s:  VX_ZONE_ERROR:Enabled
  2525.007286 s:  VX_ZONE_WARNING:Enabled
  2525.008145 s:  VX_ZONE_INIT:[tivxInitLocal:130] Initialization Done !!!
  2525.008318 s:  VX_ZONE_INIT:[tivxHostInitLocal:86] Initialization Done for HOST !!!
Setting pipeline to PAUSED ...
X11 connection rejected because of wrong authentication.
error: XDG_RUNTIME_DIR not set in the environment.
X11 connection rejected because of wrong authentication.
MESA-LOADER: failed to open tidss: /usr/lib/dri/tidss_dri.so: cannot open shared object file: No such file or directory (search paths /usr/lib/aarch64-linux-gnu/dri:\${ORIGIN}/dri:/usr/lib/dri, suffix _dri)
failed to load driver: tidss
Pipeline is live and does not need PREROLL ...
Got context from element 'autovideosink0': gst.gl.GLDisplay=context, gst.gl.GLDisplay=(GstGLDisplay)"\(GstGLDisplayGBM\)\ gldisplaygbm0";
Pipeline is PREROLLED ...
Setting pipeline to PLAYING ...
New clock: GstSystemClock
Caught SIGSEGV:99:99.
Segmentation fault

Important update: I dont have a monitor connected, I interact with beagle over shell (ethernet from my router), I always ssh -X.
@Beutomaster maybe you have run some other install scripts?
I tried to change the pipeline to save or stream video, but so far no luck, in this case the gstreamer hangs on “Redistribute latency”

debian@BeagleBone:~$ sudo gst-launch-1.0 v4l2src device=/dev/video2 ! video/x-bayer, width=1920, height=1080, format=rggb ! tiovxisp sink_0::device=/dev/v4l-subdev2 sensor-name=SENSOR_SONY_IMX219_RPI dcc-isp-file=/opt/imaging-REL.PSDK.JACINTO.08.06.00.14/sensor_drv/src/imx219/dcc_bins/dcc_viss.bin sink_0::dcc-2a-file=/opt/imaging-REL.PSDK.JACINTO.08.06.00.14/sensor_drv/src/imx219/dcc_bins/dcc_2a.bin format-msb=7 !  videoconvert ! x264enc ! mp4mux ! filesink location=vi.mp4
APP: Init ... !!!
MEM: Init ... !!!
MEM: Initialized DMA HEAP (fd=5) !!!
MEM: Init ... Done !!!
IPC: Init ... !!!
IPC: Init ... Done !!!
REMOTE_SERVICE: Init ... !!!
REMOTE_SERVICE: Init ... Done !!!
  4791.259070 s: GTC Frequency = 200 MHz
APP: Init ... Done !!!
  4791.259192 s:  VX_ZONE_INIT:Enabled
  4791.259211 s:  VX_ZONE_ERROR:Enabled
  4791.259225 s:  VX_ZONE_WARNING:Enabled
  4791.259876 s:  VX_ZONE_INIT:[tivxInitLocal:130] Initialization Done !!!
  4791.260089 s:  VX_ZONE_INIT:[tivxHostInitLocal:86] Initialization Done for HOST !!!
Setting pipeline to PAUSED ...
Pipeline is live and does not need PREROLL ...
Pipeline is PREROLLED ...
Setting pipeline to PLAYING ...
New clock: GstSystemClock
Redistribute latency...

Obviously autovideosink does not work without a display. :slight_smile: There was no setup for tidss needed. It is the TI Display Subsystem Driver and should output only to a connected screen. The output is an overlay to the output of the X-Terminal.

I also tried to use x264enc, but I’m also not shure, what’s the problem. I think using videoconvert is probably important, but I would say mp4mux is not needed, if you have no sound.

I also tried to use “v4l2h264enc output-io-mode=5”, for the built in hardware encoder on /dev/video1, but had the same problems. Maybe it has something to do with the configured video-bitrate or with the latency-problem mentioned at x264enc . I tried the suggested “tune=zerolatency” parameter, but it did’nt work either.

Maybe the problem is not the colorspace, but the pixelformat.

$v4l2-ctl -d /dev/video1 --all
Driver Info:
	Driver name      : vxe-enc
	Card type        : vxe-enc
	Bus info         : platform:vxe-enc
	Driver version   : 5.10.162
	Capabilities     : 0x84204000
		Video Memory-to-Memory Multiplanar
		Streaming
		Extended Pix Format
		Device Capabilities
	Device Caps      : 0x04204000
		Video Memory-to-Memory Multiplanar
		Streaming
		Extended Pix Format
Priority: 2
Format Video Capture Multiplanar:
	Width/Height      : 0/0
	Pixel Format      : 'H264' (H.264)
	Field             : None
	Number of planes  : 1
	Flags             : 
	Colorspace        : Default
	Transfer Function : Default
	YCbCr/HSV Encoding: Default
	Quantization      : Default
	Plane 0           :
	   Bytes per Line : 0
	   Size Image     : 0
Format Video Output Multiplanar:
	Width/Height      : 0/0
	Pixel Format      : 'NV12' (Y/CbCr 4:2:0)
	Field             : None
	Number of planes  : 1
	Flags             : 
	Colorspace        : Default
	Transfer Function : Default
	YCbCr/HSV Encoding: Default
	Quantization      : Default
	Plane 0           :
	   Bytes per Line : 0
	   Size Image     : 0
Streaming Parameters Video Capture:
	Capabilities     : timeperframe
	Frames per second: invalid (0/1)
	Read buffers     : 0
Streaming Parameters Video Output:
	Capabilities     : timeperframe
	Frames per second: invalid (0/1)
	Write buffers    : 0
                       gop_size 0x009909cb (int)    : min=1 max=7200 step=1 default=1800 value=1800
                  video_bitrate 0x009909cf (int)    : min=50000 max=100000000 step=1 default=500000 value=0
                  h264_i_period 0x00990a66 (int)    : min=1 max=600 step=1 default=30 value=0

Yeah, I figured out the autovideosink the day before your comment, but I’ve had some issues with display tho. Nevertheless I debugged it via fakesink and got actually data flowing. Now trying to configure the x264enc, but not luck yet. I need to encode it int h264/h265, and then do udpsink, bu really a struggle.