Physically removing the HDMI Frame buffer chip

I would like to physically remove some unused hardware component for testing.
Is it possible to remove the HDMI Frame buffer chip without preventing the OS to load?
There are lots of “expensive” components on the board made for most people, others like myself love the board but would have liked other component (JTAG headers) right on there.
Did anyone remove this particular chip from their design?

The beaglebone (white) does not have the hdmi framer and has a
built-in usb-jtag.

Based on your comments, it would be an obvious choice..


“BlueSteel” might be suitable as well: