Trends in Cognitive Sciences
ReviewPerception of self-motion from visual flow
Section snippets
Heading detection during eye rotation
Experimental investigations of visual self-motion perception have benefited tremendously from the availability of specialized 3-D graphics workstations that can simulate movement through virtual environments in real time. The most basic experiments use linear movement in simple random-dot environments devoid of recognizable image features (Fig. 1B). The resulting visual motion is presented on a large screen in front of the subject that covers a substantial part of the visual field. Heading
Path perception
The above descriptions assume linear motion and a rotational component induced by eye movement. However, a combination of translational and rotational self-motion also arises during movement along a curved path. In this case the rotation axis is not in the eye but at the center of the motion curve. This creates a further problem for heading detection from retinal flow because the flow field cannot specify the location of the rotation axis and hence the origin of the rotational component. The
Combining retinal flow with information about the environment
Another factor that could influence heading judgements is information about 3-D scene layout. Knowledge of the depth structure of the scene could aid the separation of translation and rotation, because the motion of objects in the flow depends on their distance from the observer. The motion of distant points can be used to estimate rotation while the motion of near points is more useful to obtain translational information (see Fig. 1E). Independent knowledge about the depth structure of the
Dynamic properties and saccadic eye movements
Saccadic gaze shifts disrupt the retinal flow and change the retinal projection of the direction of heading on average twice per second (Box 1). Heading judgements are possible for presentation times as short as 228–400 ms, that is, within the time available between two saccades12, 23. Yet, visual search for the heading direction is only rarely accomplished in a single saccade, indicating that heading direction is usually processed across successive saccadic intervals35.
Short presentation times
Mechanisms of heading detection
Electrophysiology in macaque monkeys has shown several areas in the posterior parietal cortex involved in optic-flow processing37. Most research has focussed on the medial superior temporal (MST) area, because this is the first area in the cortical motion pathway with genuine optic flow selectivity38, 39, 40. Many MST cells also respond to real movement of the animal, even in darkness41, 42. Cells in MST are selective for the location of the focus of expansion43, 44. MST responses during
Conclusion
Goal-directed spatial behavior relies heavily on vision. Retinal flow provides visual input to monitor self-motion, navigate and guide future movements, and avoid obstacles. This article has reviewed the large body of knowledge about how humans analyse retinal flow that has accumulated in psychophysical studies. Humans can in principle use retinal flow for the determination of heading, in addition to several other visual cues (see Box 3). To solve the problem of eye rotations robustly, the
Outstanding questions
- •
The future motion path is often more important for the control of self-motion than the current instantaneous heading. How is path information obtained from retinal flow and extraretinal signals and how is the path predicted?
- •
Humans can use many other cues besides optic flow for visual navigation (Box 3). How is optic flow combined with other navigational strategies?
- •
Most previous studies have used passive judgements of heading. Normally, however, heading judgements are required during active
Acknowledgements
We thank Antje Grigo and Bart Krekelberg for comments on the manuscript. This review and much of the cited work was made possible by financial support from the Human Frontier Science Program (RG-71/96B and RG 34/96B), the German Science Foundation (SFB 509), and the Dutch Research Council (SLW-NWO 805-33.171-P).
References (69)
- et al.
Perception of translational heading from optical flow
J. Exp. Psychol.
(1988)Hum. Percept. Perform.
(1988) - et al.
Perceiving heading with different retinal regions and types of optic flow
Percept. Psychophys.
(1993) Perception With an Eye for Motion
(1986)Judgements of heading
Vis. Res.
(1996)Visual self-motion perception during head turns
Nat. Neurosci.
(1998)Heading and path information from retinal flow in naturalistic environments
Percept. Psychophys.
(1997)Analysis of local and wide-field movements in the superior temporal visual areas of the macaque monkey
J. Neurosci.
(1986)Optic flow processing in monkey STS: a theoretical and experimental approach
J. Neurosci.
(1996)Mechanisms of heading perception in primate visual cortex
Science
(1996)- et al.
MST neuronal responses to heading direction during pursuit eye movements
J. Neurophysiol.
(1999)
Subspace methods for recovering rigid motion: I. Algorithm and implementation
Int. J. Comput. Vis.
A model of the combination of optic flow and extraretinal eye movement signals in primate extrastriate visual cortex
Neural Netw.
Model for the computation of self-motion in biological systems
J. Opt. Soc. Am.
A model of self-motion estimation within primate extrastriate visual cortex
Vis. Res.
Testing the Perrone and Stone (1994) model of heading estimation
Vis. Res.
Motion templates with eye velocity gain fields for transformation of retinal to head-centric flow
NeuroReport
Heading detection using motion templates and eye velocity gain fields
Vis. Res.
The Perception of the Visual World
The optic flow field: the foundation of vision
Philos. Trans. R. Soc. London Ser. B
Visual influence on human locomotion: modulation to changes in optic flow
Exp. Brain Res.
Empirical and theoretical issues in the perception of time to contact
J. Exp. Psychol. Hum. Percept. Perform.
The use of optical velocities for distance discrimination and reproduction during visually simulated self-motion
Exp. Brain Res.
How do we avoid confounding the direction we are looking and the direction we are moving?
Science
Eye movements and optical flow
J. Opt. Soc. Am. Ser. A
Wayfinding on foot from information in retinal, not optical, flow
J. Exp. Psych. Gen.
The role of central and peripheral vision in perceiving the direction of self-motion
Percept. Psychophys.
Evidence in human subjects for independent coding of azimuth and elevation for direction of heading from optic flow
Vis. Res.
Locating the singular point in first-order optical flow fields
J. Exp. Psychol. Hum. Percept. Perform.
On the sufficiency of the velocity field for perception of heading
Biol. Cybern.
Human visual navigation in the presence of 3-D rotations
Biol. Cybern.
Estimating heading during eye movements
Vis. Res.
Robustness of perception of heading from optic flow
Vis. Res.
Estimating heading during real and simulated eye movements
Vis. Res.
Cited by (331)
The impact of COVID-19 on speed behavior in Wisconsin
2024, Transportation Research Part F: Traffic Psychology and BehaviourThe bigger the better? Investigating the effects of driving simulator fidelity on driving behavior and perception
2024, Transportation Research Part F: Traffic Psychology and BehaviourEstimating human sensitivity to curving of segmented paths within room-size environment
2024, International Journal of Human Computer StudiesReliability of distance estimation in virtual reality space: A quantitative approach for construction management
2023, Computers in Human BehaviorEye movements during optic flow perception
2023, Vision ResearchCitation Excerpt :When we locomote through our environment, optic flow helps maintain balance, posture and gait stability (Lestienne, Soechting, & Berthoz, 1977; Prokop, Schubert, Berger, 1997; Warren, Kay, Zosh, Duchon, & Sahuc, 2001). Optic flow also informs perceptual tasks, such as judging heading direction (Warren & Hannon, 1988; Lappe, Bremmer, & van den Berg, 1999), estimating travel distance (Bremmer & Lappe, 1999; Bury, Jenkin, Allison, & Harris, 2020; Redlick, Jenkin & Harris, 2001), and steering (Alefantis, Lakshminarasimhan, Avila, Noel, Pitkow, & Angelaki, 2022). During these types of tasks, observers can be expected to move their eyes freely and incessantly to bring objects of interest close to the fovea.