I'm still at the early chapters though.

That's definitely it. Soon you'll get upgrades that make special enemies trivial, like a shield upgrade that clears all shields when thrown. After that you can finish the entire game without switching weapons once.