Direct Frame Buffer not working on HDMI video using linux 3.10.6

I have compiled Linux 3.10.6 into a uImage and compiled Buildroot containing DirectFB into my root file system and put in on the SDcard for my Beagleboard XM. The system loads and runs fine on the serial port but I get no output on the monitor connected to the HDMI output.

Are there any “tricks” to getting this working? How do I know if it is a DirectFB (buildroot) problem or a linux 3.10.6 problem.