We found the following 2 published projects which all share the keyword multimodal amongst their description of software or software methods used.

Title
Brain Health Assessment via Multi-Modal Retinal Imaging with Deep Learning and Large Language Models
Generative AI for Emotion-Aware Speech and Dialogue