It wasn’t an engine limitation, it was a design choice. Heretic is a colorful game, and it was using Doom engine.

It’s especially bad in Quake, all monsters look like a moving piece of a wall, and the level design is walls on top of walls with some walls in-between. If not for the revolutionary game engine, it would seriously flop.