not seeing any issues like you have reported
connected both a wifi dongle and SSD
xuantie Ubuntu, branch beaglev-1.1.2
Ubuntu 23.04 BeagleV ttyS0 BeagleBoard.org Ubuntu 23.04 Console Image 2023-09-14
Support: BeagleBoard.org - debian
default username:password is [beagle:temppwd]
uname -a
Linux BeagleV 5.10.113-g7357c97c76ec-dirty #1 SMP PREEMPT Thu Sep 14 14:50:38 CD
T 2023 riscv64 riscv64 riscv64 GNU/Linux