I am what you would call a sucker for peripherals. I brought the Sega CD. I brought the Gameboy Camera and Printer. I had light guns for all my consoles that supported them. I had a cartridge that turned my Gameboy Color into a TV Remote. I still think the VMU is one of the most unsung gaming innovations of all time. I had all the Guitar Hero instruments. I bought the EU-only translator game/app/Mic peripheral Talkman for my PSP. I am the sort of person who buys dorky add-ons just to experience something a particular way.
I’d buy a VR headset to play videogames (which for home consumers is really its only use) but I find the shoehorning of established genres either gives me motion sickness or, via floating hands and teleporting completely removes any immersion I might have had. I will admit avant grade titles like Rez Infinite and Tetris Effect are incredible in VR but they are an exception and I find sat closer to the TV in the dark I get about 80% the same effects.
So if a piece of hardware that already makes me feel self-conscious about looking like a dork only makes great games 20% better and my existing console has a much wider library I can play with my family or friends without additional gubbins why would I buy one? If it can’t appeal to a guy who payed a lot of money just to import obscure fluff like the PocketStation or the Play-Yan (you might have to Google that one) then what hope does it have?