Search AI Products and News

Recently, tech giant NVIDIA, in collaboration with the Massachusetts Institute of Technology (MIT) and the University of Hong Kong, released a new framework called Fast-dLLM. This innovative framework aims to significantly increase the inference speed of diffusion models (Diffusion-based LLMs), up to 27.6 times, providing stronger technical support for AI applications. The challenges and opportunities of diffusion models make them strong competitors to traditional autoregressive models.

In multimodal tasks, visual language models (VLMs) play a crucial role, such as in image retrieval, image captioning, and medical diagnosis. These models aim to align visual data with language data for more efficient information processing. However, current VLMs still face significant challenges in understanding negation. Negation is critical in many applications, such as distinguishing between "a room without windows" and "a room with windows." Despite significant progress made by VLMs, existing models fall short when it comes to handling negated statements.

The Massachusetts Institute of Technology (MIT) showcased a brand new robot training model this week that abandons the previous focus on training methods centered around specific datasets, opting instead for an approach that utilizes vast amounts of information similar to that used in training large language models (LLMs). Researchers noted that imitation learning—where agents learn by mimicking individuals performing tasks—can fail when facing minor challenges. These challenges may include varying lighting conditions, different environmental setups, or new obstacles. In such cases, the robots lack sufficient data to adapt to these changes.

This week, MIT showcased a new model for training robots, aimed at addressing the challenges faced by imitation learning when introduced to small obstacles. Researchers pointed out that imitation learning can fail in conditions such as varying lighting, different environments, or new obstacles because robots simply do not have enough data to adapt. The team sought powerful data methods, like those used in models such as GPT-4, to tackle the problem. They introduced a new architecture called the Heterogeneous Pretrained Transformer (HPT), which aggregates information from different sensors and environments.

Is AI actually starting to ‘get smarter’?! The latest research from MIT indicates that the internal structure of large language models (LLMs) astonishingly resembles that of the human brain! This study utilized sparse autoencoder techniques to conduct an in-depth analysis of the activation space of LLMs, revealing three hierarchical structural features that are truly remarkable: first, at the microscopic level, researchers discovered the existence of structures akin to ‘crystals’. The surfaces of these ‘crystals’ are composed of parallelograms or trapezoids, similar to familiar lexical analogies such as ‘man:’