Hi all,
I’m gathering options for a vision-sound project, i.e a machine vision ML model providing the input to a sound generation stage. I was thinking of interfacing Beagley ( BeagleY-AI - BeagleBoard ) and Bela (Bela Cape – eu.shop.bela.io) for this.
Admittedly my HW fundamentals are a bit rusty (I do machine learning usually).
I imagine the Beagley, being a BBB derivative, would provide the OS and compute backbone, and the Bela cape extending it, is this intuition correct?
The data flow would be: a neural model runs on the Beagley, producing predictions as a data stream (few tens of XY coordinates per video frame), which would then be sent as control signals to the Bela for sound generation.
What hardware connections / drivers / wires would one need to make this kind of connection ?
Thank you in advance for any and all pointers and suggestions.
I see that the bela cape is designed for the beaglebone black - this has quite a different header configuration to the beagley-ai, so they are not plug-in compatible. If the bby-ai has all the signals you want then jumper wires or some sort of adapter would work, but you’d probably need to adjust device trees.
If this pushes you too far outside your comfort zone and you really do want to make this work, then another option would be to use your bby-ai as planned, but then send your control data to a beaglebone black with the bela cape attached instead of attempting to connect it directly.
Thank you so much @bbbpaul , your proposal makes a lot of sense. Indeed I do not know enough about SBCs in general and in particular I couldn’t understand how does Bela plug into the BBB both physically and logically. I was hoping to skip patching kernels, custom device drivers and the like.
I suspect much will be revealed by direct experience so I will first try my hand with the boards and likely will be back with more questions
There is Bela GEM for the PB2 (Pocket Beagle 2) also. I am waiting until the new year to purchase one for music ideas… I think they will be available from Mouser (maybe). I need to double check with them soon.