USB not working with self-built kernel

Hi everyone!

I'm trying currently trying to build a kernel from Linux-Omap-2.6
sources for BeagleBoard XM.

By using omap2plus_defconfig/omap3_beagle_defconfig (depending on the
kernel version) and enabling twl4030/ehci I get a kernel that boots

However, I can't get the USB ports working. The LED stays off and no
devices are recognized, they also seem to get no power from the port.

Using the the kernel that is shipped with the BeagleBoard USB works
fine and my devices are recognized.

I have already searched for solutions to this problem and obviously
others have it too, only the patches I found seem to be already
applied in linux-omap kernel.

Maybe someone can give me a hint what I'm missing here.

Thanks in advance.