I have 3 rims. A round rally type, a GT / Supercar type with flat bottom and a Vantage replica (new GT3 / Formula type) rim that's yet to arrive. They all feel different, with different shapes and grips and offer a purpose different to each other. I try to match the in game car with what's in my hands. With the 3 types of rim I own, I can pretty much do this for every car.
Also, VR or not, the rims feel different, handle different, weigh different amounts. You don't stare at your rim most of the time while driving on screens, either. Some people stick to one rim. I drive a variety of cars and try to replicate the authentic experience. I drive V8's with a sequential (and a V8 Supercar specifically machined gear knob), H pattern cars with exactly that, and paddles for whatever uses them. Same goes for clutch, heel toe, etc.
Some people have 10+ rims. It's a hobby. You build this kit over time. The great thing is there's usually a way to use pretty much whatever you want given some patience and a little or a lot of cash.