There was a lot of excitement last week sbout fooling AI image recognition by changing 1 pixel:
as in the title image from arXiv:1710.08864 [really about 0.1% of pixels]
This study goes a bit further to criticize probability theory and underlying statistical assumptions:
A starting point is this animated gif and study showing different graphs with the same statistical characteristics:
However what humans call Common Sense isn’t just fine tuning of one algorithm, it’s a comparison of different algorithms and sensory inputs to cross-check the result.
Or to put it another way: If it looks like a duck, swims like a duck, and quacks like a duck, then it probably is a duck.
If we only hear a quack, we can’t be sure.