Editorial: Vision and the Statistics of the Natural Environment

Understanding the statistics of the natural environment and their implications for vision (Editorial)

James H. Elder, Jonathan D. Victor, and Steven W. Zucker

Vision Research 120, 1-4 (2016)

Summary

The job of the visual system is to extract useful information about the 3D world from the 2D image projections formed by our eyes. This is an ill-posed problem, and solving it relies critically on the statistics of visual scenes.

Despite recent progress, one cannot escape the sense that our understanding of how the visual system is shaped by the statistics of our environment is still in its early stages, and much remains to be done.

Deep artificial neural networks provide a very incomplete understanding: the mathematical and physical principles underlying their performance are left scattered over thousands of parameters, providing little insight. Moreover, they fail to account for the critical role of feedback and recurrent connectivity, the diversity of problems that biological visual systems can solve, and the rates at which they learn.

Where else shall we look? Some clues are offered by the papers in this special issue. Simple theoretical principles: the geometry of objects, the physics of image formation, efficient and sparse coding, yield ideas that provide insight while keeping the dimensionality of models low. We believe a continuing confluence of these simple but powerful ideas will ultimately lead to a more complete understanding of the statistics of the natural environment and their implications for vision.


Download a preprint
Download from Vision Research
Link to Special Issue: Vision and the Statistics of the Natural Environment
Publications related to texture processing
Publications related to receptive field analysis
Return to publications list