The price was definitely a primary factor, but it wasn’t the only one. The Vision Pro is a bulky thing with a dingleberry on a string and many reviewers noted the uncomfortable headband situation. It, like may headsets, is also a royal pain in the ass to deal with if you wear glasses and/or need really specialized lenses.
But a really big factor was that it’s an Apple product. Word travelled fast about how limited the software is and how you can’t really do much with it. Apple is going to have a hard time selling these things until they crawl out of their own ass and actually let people use their products how they wish to. One of the biggest appeals of AR computing is how it bridges together computing with your imagination, and that doesn’t really work when Apple says “no, you can’t do that because it doesn’t match our company vision”