Apple and Sorbonne University Joint Research: Early Fusion and Sparse Architectures Advance Multimodal AI

In the field of multimodal artificial intelligence (AI), engineers from Apple have collaborated with a research team from Sorbonne University in France on a significant study. Recently, tech media outlet marktechpost published a blog post discussing the application and prospects of early and late fusion models in multimodal AI. The research indicates that early fusion models trained from scratch offer superior computational efficiency and scalability. Multimodal AI aims to process multiple data types simultaneously, such as images and text; however, integrating these diverse sources presents challenges.