-
Philosophical Transactions of the Royal... Sep 2023To navigate and guide adaptive behaviour in a dynamic environment, animals must accurately estimate their own motion relative to the external world. This is a... (Review)
Review
To navigate and guide adaptive behaviour in a dynamic environment, animals must accurately estimate their own motion relative to the external world. This is a fundamentally multisensory process involving integration of visual, vestibular and kinesthetic inputs. Ideal observer models, paired with careful neurophysiological investigation, helped to reveal how visual and vestibular signals are combined to support perception of linear self-motion direction, or heading. Recent work has extended these findings by emphasizing the dimension of time, both with regard to stimulus dynamics and the trade-off between speed and accuracy. Both time and certainty-i.e. the degree of confidence in a multisensory decision-are essential to the ecological goals of the system: terminating a decision process is necessary for timely action, and predicting one's accuracy is critical for making multiple decisions in a sequence, as in navigation. Here, we summarize a leading model for multisensory decision-making, then show how the model can be extended to study confidence in heading discrimination. Lastly, we preview ongoing efforts to bridge self-motion perception and navigation , including closed-loop virtual reality and active self-motion. The design of unconstrained, ethologically inspired tasks, accompanied by large-scale neural recordings, raise promise for a deeper understanding of spatial perception and decision-making in the behaving animal. This article is part of the theme issue 'Decision and control processes in multisensory perception'.
Topics: Animals; Motion Perception; Space Perception; Vestibule, Labyrinth; Movement; Adaptation, Psychological; Visual Perception; Photic Stimulation
PubMed: 37545301
DOI: 10.1098/rstb.2022.0333 -
Experimental Brain Research Oct 2022Various studies have demonstrated a role for cognition on self-motion perception. Those studies all concerned modulations of the perception of a physical or visual...
Various studies have demonstrated a role for cognition on self-motion perception. Those studies all concerned modulations of the perception of a physical or visual motion stimulus. In our study, however, we investigated whether cognitive cues could elicit a percept of oscillatory self-motion in the absence of sensory motion. If so, we could use this percept to investigate if the resulting mismatch between estimated self-motion and a lack of corresponding sensory signals is motion sickening. To that end, we seated blindfolded participants on a swing that remained motionless during two conditions, apart from a deliberate perturbation at the start of each condition. The conditions only differed regarding instructions, a secondary task and a demonstration, which suggested either a quick halt ("Distraction") or continuing oscillations of the swing ("Focus"). Participants reported that the swing oscillated with larger peak-to-peak displacements and for a longer period of time in the Focus condition. That increase was not reflected in the reported motion sickness scores, which did not differ between the two conditions. As the reported motion was rather small, the lack of an effect on the motion sickness response can be explained by assuming a subthreshold neural conflict. Our results support the existence of internal models relevant to sensorimotor processing and the potential of cognitive (behavioral) therapies to alleviate undesirable perceptual issues to some extent. We conclude that oscillatory self-motion can be perceived in the absence of related sensory stimulation, which advocates for the acknowledgement of cognitive cues in studies on self-motion perception.
Topics: Cues; Humans; Motion; Motion Perception; Motion Sickness; Self Concept; Visual Perception
PubMed: 35986767
DOI: 10.1007/s00221-022-06442-3 -
Journal of Vision Oct 2022Sensory decision-making is frequently studied using categorical tasks, even though the feature space of most stimuli is continuous. Recently, it has become more common...
Sensory decision-making is frequently studied using categorical tasks, even though the feature space of most stimuli is continuous. Recently, it has become more common to measure feature perception in a gradual fashion, say when studying motion perception across the full space of directions. However, continuous reports can be contaminated by perceptual or motor biases. Here, we examined such biases on perceptual reports by comparing two response methods. With the first method, participants reported motion direction in a motor reference frame by moving a trackball. With the second method, participants used a perceptual frame of reference with a perceptual comparison stimulus. We tested biases using three different versions of random dot kinematograms. We found strong and systematic biases in responses when reporting the direction in a motor frame of reference. For the perceptual frame of reference, these systematic biases were not evident. Independent of the response method, we also detected a systematic misperception where subjects sometimes confuse the physical stimulus direction with its opposite direction. This was confirmed using a von Mises mixture model that estimated the contribution of veridical perception, misperception, and guessing. Importantly, the more sensitive perceptual reporting method revealed that, with increasing levels of sensory evidence, perceptual performance increases not only in the form of higher detection probability, but under certain conditions also in the form of increased precision.
Topics: Humans; Motion Perception; Psychophysics; Computer Simulation
PubMed: 36306146
DOI: 10.1167/jov.22.11.16 -
Journal of Vision Mar 2022Visual motion signals are used not only to drive motion perception but also to elicit oculomotor responses. A fundamental question is whether perceptual and oculomotor...
Visual motion signals are used not only to drive motion perception but also to elicit oculomotor responses. A fundamental question is whether perceptual and oculomotor processing of motion signals shares a common mechanism. This study aimed to address this question using visual motion priming, in which the perceived direction of a directionally ambiguous stimulus is biased in the same (positive priming) or opposite (negative priming) direction as that of a priming stimulus. The priming effect depends on the duration of the priming stimulus. It is assumed that positive and negative priming are mediated by high- and low-level motion systems, respectively. Participants were asked to judge the perceived direction of a π-phase-shifted test grating after a smoothly drifting priming grating during varied durations. Their eye movements were measured while the test grating was presented. The perception and eye movements were discrepant under positive priming and correlated under negative priming on a trial-by-trial basis when an interstimulus interval was inserted between the priming and test stimuli, indicating that the eye movements were evoked by the test stimulus per se. These findings suggest that perceptual and oculomotor responses are induced by a common mechanism at a low level of motion processing but by independent mechanisms at a high level of motion processing.
Topics: Eye Movements; Humans; Motion; Motion Perception; Motor Activity; Photic Stimulation; Vision, Ocular; Visual Perception
PubMed: 35293955
DOI: 10.1167/jov.22.4.6 -
Journal of Vision Mar 2021Motion perception is a critical function of the visual system. In a three-dimensional environment, multiple sensory cues carry information about an object's motion...
Motion perception is a critical function of the visual system. In a three-dimensional environment, multiple sensory cues carry information about an object's motion trajectory. Previous work has quantified the contribution of binocular motion cues, such as interocular velocity differences and changing disparities over time, as well as monocular motion cues, such as size and density changes. However, even when these cues are presented in concert, observers will systematically misreport the direction of motion-in-depth. Although in the majority of laboratory experiments head position is held fixed using a chin or head rest, an observer's head position is subject to involuntary small movements under real-world viewing conditions. Here, we considered the potential impact of such "head jitter" on motion-in-depth perception. We presented visual stimuli in a head-mounted virtual reality device that facilitated low latency head tracking and asked observers to judge 3D object motion. We found performance improved when we updated the visual display consistent with the small changes in head position. When we disrupted or delayed head movement-contingent updating of the visual display, the proportion of motion-in-depth misreports again increased, reflected in both a reduction in sensitivity and an increase in bias. Our findings identify a critical function of head jitter in visual motion perception, which has been obscured in most (head-fixed and non-head jitter contingent) laboratory experiments.
Topics: Cues; Depth Perception; Head Movements; Humans; Imaging, Three-Dimensional; Motion Perception; Virtual Reality; Vision, Binocular
PubMed: 33687429
DOI: 10.1167/jov.21.3.12 -
Neuroscience Bulletin Jan 2023Accurate self-motion perception, which is critical for organisms to survive, is a process involving multiple sensory cues. The two most powerful cues are visual (optic... (Review)
Review
Accurate self-motion perception, which is critical for organisms to survive, is a process involving multiple sensory cues. The two most powerful cues are visual (optic flow) and vestibular (inertial motion). Psychophysical studies have indicated that humans and nonhuman primates integrate the two cues to improve the estimation of self-motion direction, often in a statistically Bayesian-optimal way. In the last decade, single-unit recordings in awake, behaving animals have provided valuable neurophysiological data with a high spatial and temporal resolution, giving insight into possible neural mechanisms underlying multisensory self-motion perception. Here, we review these findings, along with new evidence from the most recent studies focusing on the temporal dynamics of signals in different modalities. We show that, in light of new data, conventional thoughts about the cortical mechanisms underlying visuo-vestibular integration for linear self-motion are challenged. We propose that different temporal component signals may mediate different functions, a possibility that requires future studies.
Topics: Animals; Humans; Motion Perception; Bayes Theorem; Optic Flow; Cues; Vestibule, Labyrinth; Photic Stimulation; Visual Perception
PubMed: 35821337
DOI: 10.1007/s12264-022-00916-8 -
Journal of Vision Jul 2022Perception of an ambiguous apparent motion is influenced by the immediately preceding motion. In positive priming, when an observer is primed with a slow-pace (1-3 Hz)...
Perception of an ambiguous apparent motion is influenced by the immediately preceding motion. In positive priming, when an observer is primed with a slow-pace (1-3 Hz) sequence of motion frames depicting unidirectional drift (e.g., Right-Right-Right-Right), subsequent sequences of ambiguous frames are often perceived to continue moving in the primed direction (illusory Right-Right …). Furthermore, priming an observer with a slow-pace sequence of rebounding apparent motion frames that alternate between opponently coded motion directions (e.g., Right-Left-Right-Left) leads to an illusory continuation of the two-step rebounding sequence in subsequent random frames. Here, we show that even more arbitrary two-step motion sequences can be primed; in particular, two-step motion sequences that alternate between non-opponently coded directions (e.g., Up-Right-Up-Right; staircase motion) can be primed to be illusorily perceived in subsequent random frames. We found that staircase sequences, but not drifting or rebounding sequences, were primed more effectively with four priming frames compared with two priming frames, suggesting the importance of repeating the sequence element for priming arbitrary two-step motion sequences. Moreover, we compared the effectiveness of motion primes to that of symbolic primes (arrows) and found that motion primes were significantly more effective at producing prime-consistent responses. Although it has been proposed that excitatory and rivalry-like mechanisms account for drifting and rebounding motion priming, current motion processing models cannot account for our observed priming of staircase motion. We argue that higher order processes involving the recruitment and interaction of both attention and visual working memory are required to account for the type of two-step motion priming reported here.
Topics: Attention; Humans; Illusions; Motion Perception
PubMed: 35881413
DOI: 10.1167/jov.22.8.14 -
Journal of Vision Apr 2019Research on functional changes across the adult lifespan has been dominated by studies related to cognitive processes. However, it has become evident that a more... (Review)
Review
Research on functional changes across the adult lifespan has been dominated by studies related to cognitive processes. However, it has become evident that a more comprehensive approach to behavioral aging is needed. In particular, our understanding of age-related perceptual changes is limited. Visual motion perception is one of the most studied areas in perceptual aging and therefore, provides an excellent domain on the basis of which we can investigate the complexity of the aging process. We review the existing literature on how aging affects motion perception, including different processing stages, and consider links to cognitive and motor changes. We address the heterogeneity of results and emphasize the role of individual differences. Findings on age-related changes in motion perception ultimately illustrate the complexity of functional dynamics that can contribute to decline as well as stability during healthy aging. We thus propose that motion perception offers a conceptual framework for perceptual aging, encouraging a deliberate consideration of functional limits and resources emerging across the lifespan.
Topics: Aging; Female; Humans; Male; Motion Perception; Vision, Ocular; Visual Cortex
PubMed: 30943529
DOI: 10.1167/19.4.3 -
Neuropsychologia Aug 2016Visual motion processing is often attributed to the dorsal visual pathway despite visual motion's involvement in almost all visual functions. Furthermore, some visual... (Review)
Review
Visual motion processing is often attributed to the dorsal visual pathway despite visual motion's involvement in almost all visual functions. Furthermore, some visual motion tasks critically depend on the structural integrity of regions outside the dorsal pathway. Here, based on numerous studies, I propose that visual motion signals are swiftly transmitted via multiple non-hierarchical routes to primary motion-dedicated processing regions (MT/V5 and MST) that are not part of the dorsal pathway, and then propagated to a multiplicity of brain areas according to task demands, reaching these regions earlier than the dorsal/ventral hierarchical flow. This not only places MT/V5 at the same or even earlier visual processing stage as that of V1, but can also elucidate many findings with implications to visual awareness. While the integrity of the non-hierarchical motion pathway is necessary for all visual motion perception, it is insufficient on its own, and the transfer of visual motion signals to additional brain areas is crucial to allow the different motion perception tasks (e.g. optic flow, visuo-vestibular balance, movement observation, dynamic form detection and perception, and even reading). I argue that this lateral visual motion pathway can be distinguished from the dorsal pathway not only based on faster response latencies and distinct anatomical connections, but also based on its full field representation. I also distinguish between this primary lateral visual motion pathway sensitive to all motion in the visual field, and a much less investigated optic flow sensitive medial processing pathway (from V1 to V6 and V6A) that appears to be part of the dorsal pathway. Multiple additional predictions are provided that allow testing this proposal and distinguishing between the visual pathways.
Topics: Humans; Motion; Motion Perception; Visual Pathways
PubMed: 27444880
DOI: 10.1016/j.neuropsychologia.2016.07.018 -
Current Biology : CB Sep 2022Neurons integrate excitatory and inhibitory signals to produce their outputs, but the role of input timing in this integration remains poorly understood. Motion...
Neurons integrate excitatory and inhibitory signals to produce their outputs, but the role of input timing in this integration remains poorly understood. Motion detection is a paradigmatic example of this integration, since theories of motion detection rely on different delays in visual signals. These delays allow circuits to compare scenes at different times to calculate the direction and speed of motion. Different motion detection circuits have different velocity sensitivity, but it remains untested how the response dynamics of individual cell types drive this tuning. Here, we sped up or slowed down specific neuron types in Drosophila's motion detection circuit by manipulating ion channel expression. Altering the dynamics of individual neuron types upstream of motion detectors increased their sensitivity to fast or slow visual motion, exposing distinct roles for excitatory and inhibitory dynamics in tuning directional signals, including a role for the amacrine cell CT1. A circuit model constrained by functional data and anatomy qualitatively reproduced the observed tuning changes. Overall, these results reveal how excitatory and inhibitory dynamics together tune a canonical circuit computation.
Topics: Amacrine Cells; Motion; Motion Perception; Photic Stimulation
PubMed: 35868321
DOI: 10.1016/j.cub.2022.06.075