Webcam works on Debian (BBB, VM), but not on Ubuntu

For faster opencv development using a webcam, I’d like to use an Ubuntu VM
(Razius Vagrant Virtualbox or vmware: 14.04.5 LTS (kernel 3.13.0-93-generic))

The problem is that the spca561 driver never loads (lsusb,usb-devices):

Vendor=046d ProdID=092c Rev=00.00
If#= 0 Alt= 0 #EPs= 1 Cls=ff(vend.) Sub=00 Prot=00 Driver=(none)

The same webcam works fine on Debian, either on the BBB (debian 8.4 kernel 4.4.9-ti-r25)
or a VM (debian 8.5 kernel 3.16.0-4-amd64) :

Vendor=046d ProdID=092c Rev=00.00

If#= 0 Alt= 0 #EPs= 1 Cls=ff(vend.) Sub=00 Prot=00 Driver=spca561

Install (g)spca on ubuntu however has issues, apparently the driver must be in the kernel?
http://mxhaard.free.fr/