I have a YOLO model, and I convert it into TensorFlow Lite. I want to run BeagleBone AI 64. It’s running, but I want to run it on the GPU so there is less CPU load on the BeagleBone board. How can I check the GPU load, and how do I know if it’s running on the GPU or not?
kindly any one help me out
You are S.O.L with the Ti stuff and gpu. Its a been a long time since touching that board and its a combination of many negatives. If you need to use gpu the Jetson / Tegra is the only SBC that has enough compute power and open access to the CUDA cores and GPU.
The big value this board holds is in all these higher performing real-time cores, working with Linux, in combination with a lot fancy IO. If you for example want to make an industrial machine, that needs tight demanding real-time controls, this board is reasonable choice.
The GPU is useless and a waste. It’s annoying to pay for. There is no support from what I can see. I believe there might be some kind of Linux driver now, but not fully working or some garbage… The AI demo stuff, iirc, works in some overly complicated way making use of the DSP and R5 cores.
The checkmarks this board has filled for me have been very hard time find elsewhere. Almost nobody is using this board, the community support is painful, many like @foxquirrel have given up. I have repeatedly looked to try to find better alternative platforms for my use case. Platforms that would cost me less headbanging, be better documented, and around the same price range. I found nothing that gave me the confidence to make the switch. Of all this, the current best alternative I’ve found for my use case is the PocketBeagle2…if only it had a network port…
I dream of a BeagleBoneBlack2 with a TI AM6442, and some actual initial support and documentation.
Anyway, if you want to do fancy AI stuff, use the latest Jetson. You’ll get 20x the performance and much better support. The strength of the AI64 is in industrial controls. If you need both fancy AI in combination with industrial controls, use both boards simultaneously. Have them talk.
After two years of battling, and much learning, I am now finally approaching the point of making use of this board in production. To help others make use of this board for controls, I have been working on putting together this example application Heterogeneous_App_Example
Thank you very much for putting that together, I have not tried it out to verify. However, its seem to touch on plenty of the key issues.
The very strong positive about the board is the fact it makes a rock solid server. Rip out the desktop and run it headless with nvme. We have one that is in production on our local network. It hangs out with our big dells, no issues at all.