-
Medical Image Analysis Aug 2023Multi-modality cardiac imaging plays a key role in the management of patients with cardiovascular diseases. It allows a combination of complementary anatomical,... (Review)
Review
Multi-modality cardiac imaging plays a key role in the management of patients with cardiovascular diseases. It allows a combination of complementary anatomical, morphological and functional information, increases diagnosis accuracy, and improves the efficacy of cardiovascular interventions and clinical outcomes. Fully-automated processing and quantitative analysis of multi-modality cardiac images could have a direct impact on clinical research and evidence-based patient management. However, these require overcoming significant challenges including inter-modality misalignment and finding optimal methods to integrate information from different modalities. This paper aims to provide a comprehensive review of multi-modality imaging in cardiology, the computing methods, the validation strategies, the related clinical workflows and future perspectives. For the computing methodologies, we have a favored focus on the three tasks, i.e., registration, fusion and segmentation, which generally involve multi-modality imaging data, either combining information from different modalities or transferring information across modalities. The review highlights that multi-modality cardiac imaging data has the potential of wide applicability in the clinic, such as trans-aortic valve implantation guidance, myocardial viability assessment, and catheter ablation therapy and its patient selection. Nevertheless, many challenges remain unsolved, such as missing modality, modality selection, combination of imaging and non-imaging data, and uniform analysis and representation of different modalities. There is also work to do in defining how the well-developed techniques fit in clinical workflows and how much additional and relevant information they introduce. These problems are likely to continue to be an active field of research and the questions to be answered in the future.
Topics: Humans; Imaging, Three-Dimensional; Cardiovascular Diseases; Image Processing, Computer-Assisted; Magnetic Resonance Imaging
PubMed: 37384950
DOI: 10.1016/j.media.2023.102869 -
Frontiers in Neuroinformatics 2023
PubMed: 37206643
DOI: 10.3389/fninf.2023.1192211 -
Current Opinion in Insect Science Oct 2023Flowers present information to their insect visitors in multiple simultaneous sensory modalities. Research has commonly focussed on information presented in visual and... (Review)
Review
Flowers present information to their insect visitors in multiple simultaneous sensory modalities. Research has commonly focussed on information presented in visual and olfactory modalities. Recently, focus has shifted towards additional 'invisible' information, and whether information presented in multiple modalities enhances the interaction between flowers and their visitors. In this review, we highlight work that addresses how multimodality influences behaviour, focussing on work conducted on bumblebees (Bombus spp.), which are often used due to both their learning abilities and their ability to use multiple sensory modes to identify and differentiate between flowers. We review the evidence for bumblebees being able to use humidity, electrical potential, surface texture and temperature as additional modalities, and consider how multimodality enhances their performance. We consider mechanisms, including the cross-modal transfer of learning that occurs when bees are able to transfer patterns learnt in one modality to an additional modality without additional learning.
Topics: Bees; Animals; Learning; Flowers; Temperature
PubMed: 37468044
DOI: 10.1016/j.cois.2023.101086 -
Psychonomic Bulletin & Review Feb 2017Why, in all cultures in which hearing is possible, has language become the province of speech and the oral modality? I address this question by widening the lens with... (Review)
Review
Why, in all cultures in which hearing is possible, has language become the province of speech and the oral modality? I address this question by widening the lens with which we look at language to include the manual modality. I suggest that human communication is most effective when it makes use of two types of formats--a discrete and segmented code, produced simultaneously along with an analog and mimetic code. The segmented code is supported by both the oral and the manual modalities. However, the mimetic code is more easily handled by the manual modality. We might then expect mimetic encoding to be done preferentially in the manual modality (gesture), leaving segmented encoding to the oral modality (speech). This argument rests on two assumptions: (1) The manual modality is as good at segmented encoding as the oral modality; sign languages, established and idiosyncratic, provide evidence for this assumption. (2) Mimetic encoding is important to human communication and best handled by the manual modality; co-speech gesture provides evidence for this assumption. By including the manual modality in two contexts--when it takes on the primary function of communication (sign language), and when it takes on a complementary communicative function (gesture)--in our analysis of language, we gain new perspectives on the origins and continuing development of language.
Topics: Gestures; Humans; Language; Sign Language
PubMed: 27368641
DOI: 10.3758/s13423-016-1074-x -
Frontiers in Psychology 2023Modern society depends on numerical information, which must be communicated accurately and effectively. Numerical communication is accomplished in different... (Review)
Review
Modern society depends on numerical information, which must be communicated accurately and effectively. Numerical communication is accomplished in different modalities-speech, writing, sign, gesture, graphs, and in naturally occurring settings it almost always involves more than one modality at once. Yet the modalities of numerical communication are often studied in isolation. Here we argue that, to understand and improve numerical communication, we must take seriously this multimodality. We first discuss each modality on its own terms, identifying their commonalities and differences. We then argue that numerical communication is shaped critically by interactions among modalities. We boil down these interactions to four types: one modality can the message of another; it can attention to content from another modality (e.g., using a gesture to guide attention to a relevant aspect of a graph); it can another modality (e.g., verbally explaining the meaning of an axis in a graph); and it can a modality (e.g., framing an upwards-oriented trend as a bad outcome). We conclude by discussing how a focus on multimodality raises entirely new research questions about numerical communication.
PubMed: 37564312
DOI: 10.3389/fpsyg.2023.1130777 -
Behavior Research Methods Jun 2022Many words are strongly connected to the senses, such as vision, taste, and touch. In order to facilitate research on language and the senses, large sets of linguistic...
Many words are strongly connected to the senses, such as vision, taste, and touch. In order to facilitate research on language and the senses, large sets of linguistic stimuli and their corresponding measures of sensory associations should be available. To aid in such investigations, we present a new set of sensory modality norms for over 24,000 Dutch words. The sensory norms comprise perceptual strength ratings in six perceptual modalities: audition, gustation, haptics, olfaction, vision, and interoception. The new norms improve on existing Dutch sensory norms in three ways: 1) they significantly expand on the number of words rated; 2) they include multiple word classes; 3) they add a new perceptual modality: interoception. We show that the sensory norms are able to predict word processing behavior and outperform existing ratings of sensory experience: concreteness and imageability. The data are available via the Open Science Framework ( https://osf.io/ubvy2 ) and serve as a valuable resource for research into the relationship between language and perception.
Topics: Humans; Language; Linguistics
PubMed: 34505998
DOI: 10.3758/s13428-021-01656-9 -
Journal of Vision Aug 2020In our natural environment, the brain needs to combine signals from multiple sensory modalities into a coherent percept. Whereas spatial attention guides perceptual...
In our natural environment, the brain needs to combine signals from multiple sensory modalities into a coherent percept. Whereas spatial attention guides perceptual decisions by prioritizing processing of signals that are task-relevant, spatial expectations encode the probability of signals over space. Previous studies have shown that behavioral effects of spatial attention generalize across sensory modalities. However, because they manipulated spatial attention as signal probability over space, these studies could not dissociate attention and expectation or assess their interaction. In two experiments, we orthogonally manipulated spatial attention (i.e., task-relevance) and expectation (i.e., signal probability) selectively in one sensory modality (i.e., primary modality) (experiment 1: audition, experiment 2: vision) and assessed their effects on primary and secondary sensory modalities in which attention and expectation were held constant. Our results show behavioral effects of spatial attention that are comparable for audition and vision as primary modalities; however, signal probabilities were learned more slowly in audition, so that spatial expectations were formed later in audition than vision. Critically, when these differences in learning between audition and vision were accounted for, both spatial attention and expectation affected responses more strongly in the primary modality in which they were manipulated and generalized to the secondary modality only in an attenuated fashion. Collectively, our results suggest that both spatial attention and expectation rely on modality-specific and multisensory mechanisms.
Topics: Adult; Attention; Auditory Perception; Female; Humans; Male; Motivation; Pattern Recognition, Visual; Psychomotor Performance; Space Perception; Uncertainty
PubMed: 32744617
DOI: 10.1167/jov.20.8.1 -
Journal of Personalized Medicine Oct 2022Coronary artery calcification is increasingly prevalent in our patient population. It significantly limits the procedural success of percutaneous coronary intervention... (Review)
Review
Coronary artery calcification is increasingly prevalent in our patient population. It significantly limits the procedural success of percutaneous coronary intervention and is associated with a higher risk of adverse cardiovascular events both in the short-term and long-term. There are several modalities for modifying calcified plaque, such as balloon angioplasty (including specialty balloons), coronary atheroablative therapy (rotational, orbital, and laser atherectomy), and intravascular lithotripsy. We discuss each modality's relative advantages and disadvantages and the data supporting their use. This review also highlights the importance of intravascular imaging to characterize coronary calcification and presents an algorithm to tailor the calcium modification therapy based on specific coronary lesion characteristics.
PubMed: 36294777
DOI: 10.3390/jpm12101638 -
PloS One 2021Peritoneal dialysis (PD) modalities affect solute removal differently. However, the impacts of switching PD modalities on serum levels of biomarkers of different sizes...
Peritoneal dialysis (PD) modalities affect solute removal differently. However, the impacts of switching PD modalities on serum levels of biomarkers of different sizes are not known. Our objective was to analyze whether a change in the PD modality associates with the levels of two routine biochemical laboratories. In this multicentric prospective cohort study. we selected all patients who remained on a PD modality for at least 6 months and switched PD modality. Patients were also required to be treated with the same PD modality for at least 3 months before and after the modality change. The primary outcome was change in potassium and phosphate serum levels. We identified 737 eligible patients who switched their PD modality during the study. We found mean serum phosphate levels increased during the 3 months after switching from CAPD to APD and conversely decreased after switching to from APD to CAPD. In contrast, for potassium the difference in the mean serum levels was comparable between groups switching from CAPD to APD, and vice versa. In conclusion, CAPD seems to be as efficient as APD for the control of potassium serum levels, but more effective for the control of phosphate serum levels. The effect of a higher removal of middle size molecules as result of PD modalities in terms of clinical and patient-reported outcomes should be further explored.
Topics: Adult; Aged; Female; Humans; Male; Middle Aged; Peritoneal Dialysis; Peritoneal Dialysis, Continuous Ambulatory; Phosphates; Potassium; Prospective Studies
PubMed: 34653195
DOI: 10.1371/journal.pone.0257140 -
Life (Basel, Switzerland) Apr 2021Traditionally, surgical clipping was the only available treatment modality for intracranial aneurysms. However, in the last few decades, the endovascular therapy of... (Review)
Review
Traditionally, surgical clipping was the only available treatment modality for intracranial aneurysms. However, in the last few decades, the endovascular therapy of intracranial aneurysms (IAs) has seen a tremendous evolution and development. From coiling to flow diversion and flow disruptor devices, endovascular treatment modalities have increased in number and received broader indications throughout the years. In this review article, the treatment modalities for the endovascular management of IAs are presented, emphasizing newer devices and technologies.
PubMed: 33920264
DOI: 10.3390/life11040335