Under normal circumstances, I agree completely. Nobody is going to sniff around your guns doing a proctological examination looking for an infraction.
But things like that usually happen coincidental to some other event, totally by accident. These days you never know when you might run into some brainwashed, robotic prick, who may want to push an issue.
It's federal. That's why a lot of people choose to observe 922R however ridiculous it may be. Myself included. It's up to each individual to decide for themselves. I don't judge either way.
Like in California for example, if you replace a "muzzle brake" device with a normal flash hider on a particular rifle, you can be arrested and charged with possession of an "assault weapon"- a felony. Keep a "muzzle brake" on it, and all is well.
Completely insane and ridiculous but, that's what can happen if caught.