human stereo vision processing has incredibly sophisticated noise filtering capabilities that are still hard to replicate in software. The shimmering effect people report is essentially your visual cortex highlighting areas where the stereo correspondence fails.