-
Medical Image Analysis Aug 2023Multi-modality cardiac imaging plays a key role in the management of patients with cardiovascular diseases. It allows a combination of complementary anatomical,... (Review)
Review
Multi-modality cardiac imaging plays a key role in the management of patients with cardiovascular diseases. It allows a combination of complementary anatomical, morphological and functional information, increases diagnosis accuracy, and improves the efficacy of cardiovascular interventions and clinical outcomes. Fully-automated processing and quantitative analysis of multi-modality cardiac images could have a direct impact on clinical research and evidence-based patient management. However, these require overcoming significant challenges including inter-modality misalignment and finding optimal methods to integrate information from different modalities. This paper aims to provide a comprehensive review of multi-modality imaging in cardiology, the computing methods, the validation strategies, the related clinical workflows and future perspectives. For the computing methodologies, we have a favored focus on the three tasks, i.e., registration, fusion and segmentation, which generally involve multi-modality imaging data, either combining information from different modalities or transferring information across modalities. The review highlights that multi-modality cardiac imaging data has the potential of wide applicability in the clinic, such as trans-aortic valve implantation guidance, myocardial viability assessment, and catheter ablation therapy and its patient selection. Nevertheless, many challenges remain unsolved, such as missing modality, modality selection, combination of imaging and non-imaging data, and uniform analysis and representation of different modalities. There is also work to do in defining how the well-developed techniques fit in clinical workflows and how much additional and relevant information they introduce. These problems are likely to continue to be an active field of research and the questions to be answered in the future.
Topics: Humans; Imaging, Three-Dimensional; Cardiovascular Diseases; Image Processing, Computer-Assisted; Magnetic Resonance Imaging
PubMed: 37384950
DOI: 10.1016/j.media.2023.102869 -
Psychological Medicine Dec 2019There is a growing recognition in psychosis research of the importance of hallucinations in modalities other than the auditory. This has focused attention on cognitive... (Review)
Review
There is a growing recognition in psychosis research of the importance of hallucinations in modalities other than the auditory. This has focused attention on cognitive and neural processes that might be shared by, and which might contribute distinctly to, hallucinations in different modalities. In this article, I address some issues around the modality-generality of cognitive and neural processes in hallucinations, including the role of perceptual and reality-monitoring systems, top-down and bottom-up processes in relation to the psychological and neural substrates of hallucinations, and the phenomenon of simultaneous multimodal hallucinations of the same entity. I suggest that a functional systems approach, inspired by some neglected aspects of the writings of A. R. Luria, can help us to understand patterns of hallucinatory experience across modalities and across clinical and non-clinical groups. Understanding the interplay between modality-general and modality-specific processes may bear fruit for improved diagnosis and therapeutic approaches to dealing with distressing hallucinations.
Topics: Attention; Auditory Perception; Brain; Cognition; Functional Laterality; Hallucinations; Humans; Nerve Net; Schizophrenia; Schizophrenic Psychology
PubMed: 31530334
DOI: 10.1017/S0033291719002496 -
Cortex; a Journal Devoted To the Study... May 2021A fundamental question in affective neuroscience is whether there is a common hedonic system for valence processing independent of modality, or there are distinct neural...
A fundamental question in affective neuroscience is whether there is a common hedonic system for valence processing independent of modality, or there are distinct neural systems for different modalities. To address this question, we used both region of interest and whole-brain representational similarity analyses on functional magnetic resonance imaging data to identify modality-general and modality-specific brain areas involved in valence processing across visual and auditory modalities. First, region of interest analyses showed that the superior temporal cortex was associated with both modality-general and auditory-specific models, while the primary visual cortex was associated with the visual-specific model. Second, the whole-brain searchlight analyses also identified both modality-general and modality-specific representations. The modality-general regions included the superior temporal, medial superior frontal, inferior frontal, precuneus, precentral, postcentral, supramarginal, paracentral lobule and middle cingulate cortices. The modality-specific regions included both perceptual cortices and higher-order brain areas. The valence representations derived from individualized behavioral valence ratings were consistent with these results. Together, these findings suggest both modality-general and modality-specific representations of valence.
Topics: Auditory Perception; Brain; Brain Mapping; Humans; Magnetic Resonance Imaging; Visual Perception
PubMed: 33684626
DOI: 10.1016/j.cortex.2021.01.022 -
Behavior Research Methods Jun 2022Many words are strongly connected to the senses, such as vision, taste, and touch. In order to facilitate research on language and the senses, large sets of linguistic...
Many words are strongly connected to the senses, such as vision, taste, and touch. In order to facilitate research on language and the senses, large sets of linguistic stimuli and their corresponding measures of sensory associations should be available. To aid in such investigations, we present a new set of sensory modality norms for over 24,000 Dutch words. The sensory norms comprise perceptual strength ratings in six perceptual modalities: audition, gustation, haptics, olfaction, vision, and interoception. The new norms improve on existing Dutch sensory norms in three ways: 1) they significantly expand on the number of words rated; 2) they include multiple word classes; 3) they add a new perceptual modality: interoception. We show that the sensory norms are able to predict word processing behavior and outperform existing ratings of sensory experience: concreteness and imageability. The data are available via the Open Science Framework ( https://osf.io/ubvy2 ) and serve as a valuable resource for research into the relationship between language and perception.
Topics: Humans; Language; Linguistics
PubMed: 34505998
DOI: 10.3758/s13428-021-01656-9 -
Scientific Reports Feb 2020We present a cross-modality generation framework that learns to generate translated modalities from given modalities in MR images. Our proposed method performs Image...
We present a cross-modality generation framework that learns to generate translated modalities from given modalities in MR images. Our proposed method performs Image Modality Translation (abbreviated as IMT) by means of a deep learning model that leverages conditional generative adversarial networks (cGANs). Our framework jointly exploits the low-level features (pixel-wise information) and high-level representations (e.g. brain tumors, brain structure like gray matter, etc.) between cross modalities which are important for resolving the challenging complexity in brain structures. Our framework can serve as an auxiliary method in medical use and has great application potential. Based on our proposed framework, we first propose a method for cross-modality registration by fusing the deformation fields to adopt the cross-modality information from translated modalities. Second, we propose an approach for MRI segmentation, translated multichannel segmentation (TMS), where given modalities, along with translated modalities, are segmented by fully convolutional networks (FCN) in a multichannel manner. Both of these two methods successfully adopt the cross-modality information to improve the performance without adding any extra data. Experiments demonstrate that our proposed framework advances the state-of-the-art on five brain MRI datasets. We also observe encouraging results in cross-modality registration and segmentation on some widely adopted brain datasets. Overall, our work can serve as an auxiliary method in medical use and be applied to various tasks in medical fields.
PubMed: 32111966
DOI: 10.1038/s41598-020-60520-6 -
Journal of Clinical Medicine Feb 2024Hypertrophic cardiomyopathy (HCM) is characterized by abnormal growth of the myocardium with myofilament disarray and myocardial hyper-contractility, leading to left... (Review)
Review
Hypertrophic cardiomyopathy (HCM) is characterized by abnormal growth of the myocardium with myofilament disarray and myocardial hyper-contractility, leading to left ventricular hypertrophy and fibrosis. Where culprit genes are identified, they typically relate to cardiomyocyte sarcomere structure and function. Multi-modality imaging plays a crucial role in the diagnosis, monitoring, and risk stratification of HCM, as well as in screening those at risk. Following the recent publication of the first European Society of Cardiology (ESC) cardiomyopathy guidelines, we build on previous reviews and explore the roles of electrocardiography, echocardiography, cardiac magnetic resonance (CMR), cardiac computed tomography (CT), and nuclear imaging. We examine each modality's strengths along with their limitations in turn, and discuss how they can be used in isolation, or in combination, to facilitate a personalized approach to patient care, as well as providing key information and robust safety and efficacy evidence within new areas of research.
PubMed: 38337535
DOI: 10.3390/jcm13030842 -
Patient Preference and Adherence 2020The purpose of this review was to evaluate the modalities (e.g., face-to-face, telephone or electronic) of pharmacist health coaching providing the greatest improvement... (Review)
Review
OBJECTIVE
The purpose of this review was to evaluate the modalities (e.g., face-to-face, telephone or electronic) of pharmacist health coaching providing the greatest improvement in patient outcomes, to enable a more comprehensive evaluation to be done and quality decision-making around health coaching modalities to be undertaken by pharmacists.
METHODS
This systematic review followed the PRISMA guidelines. CINHAL, EMBASE, PubMed, PsychINFO and SCOPUS were searched (2000-2019). Included articles were reviewed for the modality used to health coach, the training provided, and the outcomes.
RESULTS
Twelve papers met the eligibility criteria. A majority of studies included involved a combination of modalities of pharmacist health coaching. Four papers referred to face-to-face sessions, and one study used telephone coaching. In each paper, coaching led to an improvement in clinical and non-clinical health outcomes.
CONCLUSION
The training provided to health coaches varied and in some cases was not reported. Inconsistencies in reports led to difficulties when comparing study outcomes. Therefore, conclusions about the modality providing the greatest improvement in patient outcomes and the most pragmatic health coaching modality are not possible. Studies that document the training, the modality, the outcomes and the cost benefits of coaching by pharmacists are warranted to enable a more comprehensive evaluation to be done and quality decision-making around health coaching modalities to be undertaken by pharmacists.
PubMed: 32904668
DOI: 10.2147/PPA.S265958 -
IEEE Transactions on Image Processing :... 2021In this work, we propose a new generic multi-modality domain adaptation framework called Progressive Modality Cooperation (PMC) to transfer the knowledge learned from...
In this work, we propose a new generic multi-modality domain adaptation framework called Progressive Modality Cooperation (PMC) to transfer the knowledge learned from the source domain to the target domain by exploiting multiple modality clues (e.g., RGB and depth) under the multi-modality domain adaptation (MMDA) and the more general multi-modality domain adaptation using privileged information (MMDA-PI) settings. Under the MMDA setting, the samples in both domains have all the modalities. Through effective collaboration among multiple modalities, the two newly proposed modules in our PMC can select the reliable pseudo-labeled target samples, which captures the modality-specific information and modality-integrated information, respectively. Under the MMDA-PI setting, some modalities are missing in the target domain. Hence, to better exploit the multi-modality data in the source domain, we further propose the PMC with privileged information (PMC-PI) method by proposing a new multi-modality data generation (MMG) network. MMG generates the missing modalities in the target domain based on the source domain data by considering both domain distribution mismatch and semantics preservation, which are respectively achieved by using adversarial learning and conditioning on weighted pseudo semantic class labels. Extensive experiments on three image datasets and eight video datasets for various multi-modality cross-domain visual recognition tasks under both MMDA and MMDA-PI settings clearly demonstrate the effectiveness of our proposed PMC framework.
PubMed: 33481713
DOI: 10.1109/TIP.2021.3052083 -
Current Sports Medicine Reports Jul 2021Passive recovery techniques are popular and offer a diverse spectrum of options for athletes and the clinicians providing care for them. These techniques are intended to... (Review)
Review
Passive recovery techniques are popular and offer a diverse spectrum of options for athletes and the clinicians providing care for them. These techniques are intended to minimize the negative effects of training or competition, thus enabling the athlete a quicker return to peak performance. Current evidence demonstrates improved athlete recovery with compression garments, cold water immersion, partial body cryotherapy, hyperbaric oxygen, and vibratory therapies. Other popular modalities, such as compression devices, whole body cryotherapy, percussive gun-assisted therapy, neuromuscular electrical stimulation, and pulsed electromagnetic therapy lack convincing evidence concerning athlete recovery. This article seeks to review the current literature and offer the reader an updated understanding of the mechanisms for each modality and the evidence regarding each modality's potential benefit in an athlete's recovery strategy.
Topics: Athletes; Athletic Performance; Clothing; Cryotherapy; Electric Stimulation Therapy; Exercise; Humans; Hyperbaric Oxygenation; Immersion; Magnetic Field Therapy; Massage; Myalgia; Recovery of Function; Vibration
PubMed: 34234090
DOI: 10.1249/JSR.0000000000000859 -
Annual International Conference of the... Jul 2022Image-based diagnosis routinely depends on more that one image modality for exploiting the complementary information they provide. However, it is not always possible to...
Image-based diagnosis routinely depends on more that one image modality for exploiting the complementary information they provide. However, it is not always possible to obtain images from a secondary modality for several reasons such as cost, degree of invasiveness and non-availability of scanners. Three-dimensional (3D) morphable models have made a significant contribution to the field of medical imaging for feature-based analysis. Here we extend their use to encode 3D volumetric imaging modalities. Specifically, we build a Gaussian Process (GP) over transformations establishing anatomical correspondence between training images within a modality. Given, two different modalities, the GP's eigenspace (latent space) can then be used to provide a parametric representation of each image modality, and we provide an operator for cross-domain translation between the two. We show that the latent space yields samples that are representative of the encoded modality. We also demonstrate that a 3D volumetric image can be efficiently encoded in latent space and transferred to synthesize the corresponding image in another modality. The framework called VIGPM can be extended by designing a fitting process to learn an observation in a given modality and performing cross-modality synthesis. Clinical Relevance- The proposed method provides a way to access a multi modality image from one modality. Both the source and synthetic modalities are in anatomical correspondence giving access to registered complementary information.
Topics: Imaging, Three-Dimensional; Magnetic Resonance Imaging; Normal Distribution
PubMed: 36085619
DOI: 10.1109/EMBC48229.2022.9871882