How not to have uboot env partition on SPI flash?

Is there a way to remove the uboot env partition on SPI flash?
I always want uboot to use the “default env” that is part of uboot.bin.
I want only uboot.bin on SPI flash and no separate uboot env partition on flash.

CONFIG_ENV_IS_NOWHERE