Personally I use physical MFDs in my simulator together with a VR headset, it works out great. Initially I thought I would need to get some kind of hand tracking cameras or passthrough in order to see what buttons I was pressing, but I found that you develop muscle memory super quickly, and seeing the buttons move in VR when you press them physically is good enough.