Things like this do happen to an extent in VR games, which is funny.
A classic example would be opening a locked door to which you have a key in, say, a zelda game. On a controller you just go over to it and press A. In VR you may need to sheathe your sword to draw the key and put away your shield to steady the door knob to unlock it and then push open the door and then pick up your weapons again.
The whole "Pick up your weapons again" loop at the end of little interactions is common in many games and is more involved than in traditional games that would abstract it.