Inconsistently Booting Pocketbeagle

I have a pocketbeagle with a bela mini cape attached. I’m having an issue where the board will power up fine is left unplugged for 20-30 seconds but if it is plugged in before then the power led on the pocketbeagle just flashes. Does anyone know why this might be happening?