-
Neural Networks : the Official Journal... Aug 2023Motion perception is an essential ability for animals and artificially intelligent systems interacting effectively, safely with surrounding objects and environments.... (Review)
Review
Motion perception is an essential ability for animals and artificially intelligent systems interacting effectively, safely with surrounding objects and environments. Biological visual systems, that have naturally evolved over hundreds-million years, are quite efficient and robust for motion perception, whereas artificial vision systems are far from such capability. This paper argues that the gap can be significantly reduced by formulation of ON/OFF channels in motion perception models encoding luminance increment (ON) and decrement (OFF) responses within receptive field, separately. Such signal-bifurcating structure has been found in neural systems of many animal species articulating early motion is split and processed in segregated pathways. However, the corresponding biological substrates, and the necessity for artificial vision systems have never been elucidated together, leaving concerns on uniqueness and advantages of ON/OFF channels upon building dynamic vision systems to address real world challenges. This paper highlights the importance of ON/OFF channels in motion perception through surveying current progress covering both neuroscience and computationally modelling works with applications. Compared to related literature, this paper for the first time provides insights into implementation of different selectivity to directional motion of looming, translating, and small-sized target movement based on ON/OFF channels in keeping with soundness and robustness of biological principles. Existing challenges and future trends of such bio-plausible computational structure for visual perception in connection with hotspots of machine learning, advanced vision sensors like event-driven camera finally are discussed.
Topics: Animals; Motion Perception; Visual Perception; Vision, Ocular; Visual Pathways; Motion
PubMed: 37263088
DOI: 10.1016/j.neunet.2023.05.031 -
Proceedings of the National Academy of... Oct 2022Understanding the neural basis of the remarkable human cognitive capacity to learn novel concepts from just one or a few sensory experiences constitutes a fundamental...
Understanding the neural basis of the remarkable human cognitive capacity to learn novel concepts from just one or a few sensory experiences constitutes a fundamental problem. We propose a simple, biologically plausible, mathematically tractable, and computationally powerful neural mechanism for few-shot learning of naturalistic concepts. We posit that the concepts that can be learned from few examples are defined by tightly circumscribed manifolds in the neural firing-rate space of higher-order sensory areas. We further posit that a single plastic downstream readout neuron learns to discriminate new concepts based on few examples using a simple plasticity rule. We demonstrate the computational power of our proposal by showing that it can achieve high few-shot learning accuracy on natural visual concepts using both macaque inferotemporal cortex representations and deep neural network (DNN) models of these representations and can even learn novel visual concepts specified only through linguistic descriptors. Moreover, we develop a mathematical theory of few-shot learning that links neurophysiology to predictions about behavioral outcomes by delineating several fundamental and measurable geometric properties of neural representations that can accurately predict the few-shot learning performance of naturalistic concepts across all our numerical simulations. This theory reveals, for instance, that high-dimensional manifolds enhance the ability to learn new concepts from few examples. Intriguingly, we observe striking mismatches between the geometry of manifolds in the primate visual pathway and in trained DNNs. We discuss testable predictions of our theory for psychophysics and neurophysiological experiments.
Topics: Animals; Concept Formation; Humans; Learning; Macaca; Neural Networks, Computer; Plastics; Primates; Visual Pathways
PubMed: 36251997
DOI: 10.1073/pnas.2200800119 -
Neuroscience Research Nov 2023The retinal neuronal circuit is the first stage of visual processing in the central nervous system. The efforts of scientists over the last few decades indicate that the... (Review)
Review
The retinal neuronal circuit is the first stage of visual processing in the central nervous system. The efforts of scientists over the last few decades indicate that the retina is not merely an array of photosensitive cells, but also a processor that performs various computations. Within a thickness of only ∼200 µm, the retina consists of diverse forms of neuronal circuits, each of which encodes different visual features. Since the discovery of direction-selective cells by Horace Barlow and Richard Hill, the mechanisms that generate direction selectivity in the retina have remained a fascinating research topic. This review provides an overview of recent advances in our understanding of direction-selectivity circuits. Beyond the conventional wisdom of direction selectivity, emerging findings indicate that the retina utilizes complicated and sophisticated mechanisms in which excitatory and inhibitory pathways are involved in the efficient encoding of motion information. As will become evident, the discovery of computational motifs in the retina facilitates an understanding of how sensory systems establish feature selectivity.
Topics: Retinal Ganglion Cells; Retina; Visual Perception; Central Nervous System; Visual Pathways; Motion Perception
PubMed: 37352934
DOI: 10.1016/j.neures.2023.06.003 -
Advances in Clinical and Experimental... Jan 2023Major depression (MD) is the one of the most debilitating diseases, affecting millions of people all around the world.
BACKGROUND
Major depression (MD) is the one of the most debilitating diseases, affecting millions of people all around the world.
OBJECTIVES
To establish visual pathway function in untreated individuals with MD.
MATERIAL AND METHODS
In 29 untreated, newly diagnosed, ophthalmologically asymptomatic individuals (58 eyes) with MD (mean age: 47.3 years) and in 29 (58 eyes) of age-, sexand refractive error-matched healthy controls (mean age: 46.8 years), the following examinations were performed: 1) best corrected distance visual acuity (BCDVA); 2) intraocular pressure (IOP); 3) and 4) biomicroscopy of anterior and posterior segment of eye; 5) macular structure (SD-OCT-Zeiss); and 6) pattern visual evoked potentials (PVEPs) measurements according to the International Society for Clinical Electrophysiology of Vision (ISCEV) standard (ISCEV-standard PVEPs). An analysis of correlation between the parameters of PVEPs and the depression severity (Hamilton Depression Rating Scale (HAMD)) was performed. To estimate the diagnostic power of PVEPs test, a receiver operating characteristics (ROC) curve was used. Data were analyzed with the significance level of p < 0.05.
RESULTS
In the study group and in healthy control, the clinical results and macular structure were normal and not different. In the MD group, in PVEPs test (check size: 1°4'and 0°16'), a significant decrease of amplitudes of P100 (AP100), associated with prolonged P100 peak time (PTP100; check size: 0°16', p < 0.004) were detected. The most frequent abnormality in PVEPs examination in the MD group was AP100 reduction (in 69% of individuals) detected using stimulation check size 0°16'. The statistically significant positive correlation between PTP100 (check size: 0°16') and HAMD score was found in severe MD (p = 0.03). The analysis of ROC curve revealed the highest sensitivity of 0.759 and specificity of 1.0 for AP100 (0°16'). The area under the curve (AUC) was 0.841 (p < 0.001).
CONCLUSION
In individuals with newly diagnosed, ophthalmologically asymptomatic and untreated MD, a dysfunction of visual pathway is present without other signs of ocular pathology. The visual pathway dysfunction measured with ISCEV PVEPs has a potential value to be an objective biomarker of MD.
Topics: Humans; Middle Aged; Visual Pathways; Depressive Disorder, Major; Evoked Potentials, Visual; Depression; Vision Disorders
PubMed: 36637185
DOI: 10.17219/acem/158483 -
Journal of Neurophysiology Apr 2022The superior colliculus (SC) integrates visual and other sensory information to regulate critical reflexive and innate behaviors, such as prey capture. In the mouse, the...
The superior colliculus (SC) integrates visual and other sensory information to regulate critical reflexive and innate behaviors, such as prey capture. In the mouse, the vast majority of retinal ganglion cells (RGCs) innervate the SC, including inputs from both the contralateral (contra-RGCs) and ipsilateral (ipsi-RGCs) eye. Despite this, previous studies revealed minimal neuronal responses to ipsilateral stimulation and few binocular interactions in the mouse SC. More recent work suggests that ipsi-RGC function and innervation of the SC are critical for efficient prey capture, raising the possibility that binocular interactions in the mouse SC may be more prevalent than previously thought. To explore this possibility, we investigated eye-specific and binocular influences on visual responses and tuning of SC neurons, focusing on the anteromedial region. Although the majority of SC neurons were primarily driven by contralateral eye stimulation, we observed that a substantial proportion of units were influenced or driven by ipsilateral stimulation. Clustering based on differential responses to eye-specific stimulus presentation revealed five distinct putative subpopulations and multiple modes of binocular interaction, including facilitation, summation, and suppression. Each of the putative subpopulations exhibited selectivity for orientation, and differences in spatial frequency tuning and spatial summation properties were observed between subpopulations. Further analysis of orientation tuning under different ocular conditions supported differential modes of binocular interaction between putative subtypes. Taken together, these data suggest that binocular interactions in the mouse SC may be more prevalent and diverse than previously understood. The mouse superior colliculus (SC) receives binocular inputs, which inform complex behavioral programs. However, we know surprisingly little about binocular tuning in the rodent SC. Here, we characterize responses to eye-specific presentations of visual stimuli and reveal a previously unappreciated diversity of binocularly modulated neurons in the SC. This foundational work broadens our understanding of visual processing in the SC and sets the stage for future studies interrogating the circuit mechanisms underlying binocular tuning.
Topics: Animals; Mice; Photic Stimulation; Retinal Ganglion Cells; Superior Colliculi; Visual Pathways; Visual Perception
PubMed: 35294270
DOI: 10.1152/jn.00526.2021 -
Neural Computation Jan 2023In our previous study (Han & Sereno, 2022a), we found that two artificial cortical visual pathways trained for either identity or space actively retain information about...
In our previous study (Han & Sereno, 2022a), we found that two artificial cortical visual pathways trained for either identity or space actively retain information about both identity and space independently and differently. We also found that this independently and differently retained information about identity and space in two separate pathways may be necessary to accurately and optimally recognize and localize objects. One limitation of our previous study was that there was only one object in each visual image, whereas in reality, there may be multiple objects in a scene. In this study, we find we are able to generalize our findings to object recognition and localization tasks where multiple objects are present in each visual image. We constrain the binding problem by training the identity network pathway to report the identities of objects in a given order according to the relative spatial relationships between the objects, given that most visual cortical areas including high-level ventral steam areas retain spatial information. Under these conditions, we find that the artificial neural networks with two pathways for identity and space have better performance in multiple-objects recognition and localization tasks (higher average testing accuracy, lower testing accuracy variance, less training time) than the artificial neural networks with a single pathway. We also find that the required number of training samples and the required training time increase quickly, and potentially exponentially, when the number of objects in each image increases, and we suggest that binding information from multiple objects simultaneously within any network (cortical area) induces conflict or competition and may be part of the reason why our brain has limited attentional and visual working memory capacities.
Topics: Pattern Recognition, Visual; Visual Pathways; Visual Perception; Brain; Neural Networks, Computer
PubMed: 36543331
DOI: 10.1162/neco_a_01559 -
Annual Review of Vision Science Sep 2020Visual information is encoded in distinct retinal ganglion cell (RGC) types in the eye tuned to specific features of the visual space. These streams of information... (Review)
Review
Visual information is encoded in distinct retinal ganglion cell (RGC) types in the eye tuned to specific features of the visual space. These streams of information project to the visual thalamus, the first station of the image-forming pathway. In the mouse, this connection between RGCs and thalamocortical neurons, the retinogeniculate synapse, has become a powerful experimental model for understanding how circuits in the thalamus are constructed to process these incoming lines of information. Using modern molecular and genetic tools, recent studies have suggested a more complex circuit organization than was previously understood. In this review, we summarize the current understanding of the structural and functional organization of the retinogeniculate synapse in the mouse. We discuss a framework by which a seemingly complex circuit can effectively integrate and parse information to downstream stations of the visual pathway. Finally, we review how activity and visual experience can sculpt this exquisite connectivity.
Topics: Animals; Axons; Geniculate Bodies; Humans; Mice; Retinal Ganglion Cells; Synaptic Transmission; Thalamus; Visual Pathways
PubMed: 32936733
DOI: 10.1146/annurev-vision-121219-081753 -
Journal of Molecular Neuroscience : MN Jun 2022A change in visual perception is a frequent early symptom of multiple sclerosis (MS), the pathoaetiology of which remains unclear. Following a slow demyelination process...
A change in visual perception is a frequent early symptom of multiple sclerosis (MS), the pathoaetiology of which remains unclear. Following a slow demyelination process caused by 12 weeks of low-dose (0.1%) cuprizone (CPZ) consumption, histology and proteomics were used to investigate components of the visual pathway in young adult mice. Histological investigation did not identify demyelination or gliosis in the optic tracts, pretectal nuclei, superior colliculi, lateral geniculate nuclei or visual cortices. However, top-down proteomic assessment of the optic nerve/tract revealed a significant change in the abundance of 34 spots in high-resolution two-dimensional (2D) gels. Subsequent liquid chromatography-tandem mass spectrometry (LC-TMS) analysis identified alterations in 75 proteoforms. Literature mining revealed the relevance of these proteoforms in terms of proteins previously implicated in animal models, eye diseases and human MS. Importantly, 24 proteoforms were not previously described in any animal models of MS, eye diseases or MS itself. Bioinformatic analysis indicated involvement of these proteoforms in cytoskeleton organization, metabolic dysregulation, protein aggregation and axonal support. Collectively, these results indicate that continuous CPZ-feeding, which evokes a slow demyelination, results in proteomic changes that precede any clear histological changes in the visual pathway and that these proteoforms may be potential early markers of degenerative demyelinating conditions.
Topics: Animals; Cuprizone; Disease Models, Animal; Mice; Mice, Inbred C57BL; Multiple Sclerosis; Proteins; Proteomics; Visual Pathways
PubMed: 35644788
DOI: 10.1007/s12031-022-01997-w -
The Journal of Neuroscience : the... Aug 2019Visual information reaches the cerebral cortex through parallel ON and OFF pathways that signal the presence of light and dark stimuli in visual scenes. We have... (Comparative Study)
Comparative Study
Visual information reaches the cerebral cortex through parallel ON and OFF pathways that signal the presence of light and dark stimuli in visual scenes. We have previously demonstrated that optical blur reduces visual salience more for light than dark stimuli because it removes the high spatial frequencies from the stimulus, and low spatial frequencies drive weaker ON than OFF cortical responses. Therefore, we hypothesized that sustained optical blur during brain development should weaken ON cortical pathways more than OFF, increasing the dominance of darks in visual perception. Here we provide support for this hypothesis in humans with anisometropic amblyopia who suffered sustained optical blur early after birth in one of the eyes. In addition, we show that the dark dominance in visual perception also increases in strabismic amblyopes that have their vision to high spatial frequencies reduced by mechanisms not associated with optical blur. Together, we show that amblyopia increases visual dark dominance by 3-10 times and that the increase in dark dominance is strongly correlated with amblyopia severity. These results can be replicated with a computational model that uses greater luminance/response saturation in ON than OFF pathways and, as a consequence, reduces more ON than OFF cortical responses to stimuli with low spatial frequencies. We conclude that amblyopia affects the ON cortical pathway more than the OFF, a finding that could have implications for future amblyopia treatments. Amblyopia is a loss of vision that affects 2-5% of children across the world and originates from a deficit in visual cortical circuitry. Current models assume that amblyopia affects similarly ON and OFF visual pathways, which signal light and dark features in visual scenes. Against this current belief, here we demonstrate that amblyopia affects the ON visual pathway more than the OFF, a finding that could have implications for new amblyopia treatments targeted at strengthening a weak ON visual pathway.
Topics: Adolescent; Adult; Amblyopia; Brain; Cerebral Cortex; Darkness; Eye; Female; Fixation, Ocular; Humans; Light; Male; Middle Aged; Neuronal Plasticity; Photic Stimulation; Psychophysics; Thalamus; Vision, Monocular; Visual Acuity; Visual Pathways; Young Adult
PubMed: 31189574
DOI: 10.1523/JNEUROSCI.3215-18.2019 -
Neuron May 2021Predators use vision to hunt, and hunting success is one of evolution's main selection pressures. However, how viewing strategies and visual systems are adapted to...
Predators use vision to hunt, and hunting success is one of evolution's main selection pressures. However, how viewing strategies and visual systems are adapted to predation is unclear. Tracking predator-prey interactions of mice and crickets in 3D, we find that mice trace crickets with their binocular visual fields and that monocular mice are poor hunters. Mammalian binocular vision requires ipsi- and contralateral projections of retinal ganglion cells (RGCs) to the brain. Large-scale single-cell recordings and morphological reconstructions reveal that only a small subset (9 of 40+) of RGC types in the ventrotemporal mouse retina innervate ipsilateral brain areas (ipsi-RGCs). Selective ablation of ipsi-RGCs (<2% of RGCs) in the adult retina drastically reduces the hunting success of mice. Stimuli based on ethological observations indicate that five ipsi-RGC types reliably signal prey. Thus, viewing strategies align with a spatially restricted and cell-type-specific set of ipsi-RGCs that supports binocular vision to guide predation.
Topics: Animals; Depth Perception; Functional Laterality; Mice; Predatory Behavior; Retinal Ganglion Cells; Vision, Binocular; Visual Pathways
PubMed: 33784498
DOI: 10.1016/j.neuron.2021.03.010