Search AI Products and News

ByteDance has officially released UI-TARS-1.5 on the Hugging Face platform, an open-source multimodal agent built upon a powerful vision-language model. This release marks another significant breakthrough for ByteDance in the field of AI automated interaction, providing developers and users with a highly efficient and intelligent cross-platform GUI (Graphical User Interface) automation solution. UI-TARS-1.5: A New Benchmark for Multimodal Agents. UI-TARS-1.5 is the latest in ByteDance's UI-TARS series...

The ByteDance Doubao large model team announced the open-sourcing of UI-TARS-1.5, an open-source multimodal agent built on a vision-language model capable of efficiently executing various tasks in a virtual world. The model achieved state-of-the-art (SOTA) performance on seven typical GUI (Graphical User Interface) benchmark evaluations and demonstrated, for the first time, its long-term reasoning capabilities in games and interactive capabilities in open spaces. This open-source project marks a significant advancement in multimodal agent technology for GUIs.

Samsung fans, pay attention! The tech giant has officially announced the arrival of its latest mobile operating system, One UI 7, based on Android 15. The global rollout begins April 7th for existing phones and tablets. US users will have a slightly later launch, starting April 10th. In the US, the first to experience One UI 7 will be Samsung's 2024 flagship Galaxy S24 series, along with the highly anticipated Fold6 and Flip6 foldable phones. This will be followed by...

Android Studio now integrates Gemini, enabling developers to upload images and receive corresponding UI code. This new multimodal functionality simplifies UI development by leveraging AI-powered image processing and code generation.

Recently, realme UI product manager Kang Da Leo announced a significant update: the Xiaobu Assistant in realme UI 6.0 has officially integrated the full version of DeepSeek-R1. This update covers six realme models, including the realme GT7 Pro, realme GT7 Pro Racing Edition, realme Neo7, realme Neo7 SE, realme GT5 Pro, and realme GT6, bringing a more intelligent and efficient user experience to numerous realme phone users.

Recently, a tool called Ready AI has been gaining significant attention in the design community. The remarkable feature of this tool is that users can generate professional-level web interfaces in just 30 seconds by inputting text commands. With Ready AI, users have more control over their desired UI. Unlike similar products, Ready AI supports real-time preview and version comparison features, demonstrating incredible efficiency in design testing for social media platforms and e-commerce websites. Ready AI offers various framework options, such as HTML.

Apple Inc. recently launched the next generation AI system Ferret-UI 2. This cross-platform AI assistant has made significant breakthroughs in UI element recognition, achieving a test score of 89.73, far surpassing GPT-4V's score of 77.73, demonstrating exceptional performance. The most notable feature of this system is its intelligent ability to understand user intent. Unlike traditional coordinate-based interaction methods, Ferret-UI 2 can automatically locate and execute relevant actions based on users' natural language commands.

It is reported that ChatGPT is rolling out a new UI in a gradual release, where the input box is smaller and resembles a search input box. This new UI appears to be a preparation for the upcoming GPT-4o model (which might be renamed to GPT-auto). In this new UI, users can input the tasks they want to accomplish, and GPT-auto will provide corresponding assistance, including creating images, brainstorming, summarizing text, writing code, composing, offering suggestions, and planning. All these features come with input hints, allowing users to easily find the help they need.

Sketch once again surprises designers. With the launch of the Smart Animate feature, UI designers can finally easily inject lively animation effects into prototype designs, making interfaces more attractive and interactive. The core principle of Smart Animate is similar to the Magic Move feature in Keynote. It can automatically recognize layers with the same name across multiple artboards and create smooth transition animations between these layers. When designers adjust the size or position of a shape on different artboards...

Aishi Technology's video generation model PixVerse has officially launched its new user interface (UI). This update brings a series of innovative features aimed at enhancing the user's creative experience. First, the introduction of the universal creation floating panel allows users to start creating instantly on any product interface without frequent switching between different modules, integrating all functions in one place. Additionally, the homepage inspiration library curates the most creative videos from around the world, enabling users to apply templates with a single click, making it easy for anyone to replicate viral videos.

As AI technology continues to advance, understanding user interfaces (UI) has become a key challenge in creating intuitive and useful AI applications. Recently, researchers at Apple introduced UI-JEPA in a new paper, an architecture designed for lightweight, device-side UI understanding that maintains high performance while significantly reducing the computational requirements for UI understanding. The challenge of UI understanding lies in processing cross-modal features, including images and natural language, to capture temporal relationships within UI sequences. Despite the complexity, multimodal large language models...

Chatbot UI is an open-source chatbot web UI framework that supports multiple model integrations. The framework offers a beautiful chat experience, including image and file capabilities, and supports both OpenAI embeddings and local embeddings. It features rich assistant functionalities such as import/export, sharing capabilities, an authentication system, and user profile backgrounds. It supports local running or hosted deployment and provides integrated image/file storage features. Chatbot UI is a comprehensive chatbot web UI framework.