Search AI Products and News

In the field of artificial intelligence, reward models are a critical component for aligning large language models (LLMs) with human feedback, but existing models face the issue of "reward hacking." These models often focus on superficial features, such as the length or format of responses, rather than identifying genuine quality metrics, such as factual accuracy and relevance. The root cause lies in standard training objectives failing to distinguish between spurious associations and true causal drivers present in the training data. This failure leads to fragile reward models (RMs), which generate misaligned policies.

Large Language Models (LLMs) have achieved significant progress in complex reasoning tasks by combining task prompts with large-scale reinforcement learning (RL), as demonstrated by models like Deepseek-R1-Zero, which directly apply reinforcement learning to base models, showcasing strong reasoning capabilities. However, this success is difficult to replicate across different base model families, especially within the Llama series. This raises a core question: what factors lead to inconsistent performance of different base models during reinforcement learning? How does reinforcement learning perform in

The plan's advancement has triggered dissatisfaction among developers. According to VentureBeat, OpenAI's current API deprecation involves the GPT-4.5 Preview version, which is an intermediary model launched between GPT-4 and GPT-5. Multiple developers have stated that this sudden change has disrupted their development plans, forcing significant adjustments to applications already built based on this API. A developer who wished to remain anonymous commented: We understand the necessity of technological iteration, but the lack of sufficient buffer time in the schedule has brought additional pressure to development teams.

Mistral recently launched its new Agents API, a framework designed for developers to simplify the creation of AI agents that can execute various tasks such as running Python code, generating images, and performing Retrieval-Augmented Generation (RAG). The launch of this API aims to provide a unified environment for large language models (LLMs) to interact with multiple tools and data sources in a structured and persistent manner.

Cybersecurity researchers warn of a new software supply chain attack called "Slopsquatting." This attack exploits the 'package hallucination' phenomenon – where generative AI (like LLMs) may suggest non-existent package names during code writing. Attackers can preemptively register these fictitious names and inject malicious code. Image Note: Image generated by AI, courtesy of Midjourney. Research reveals that AI-fabricated package names often exhibit a high degree of...

Intel recently announced the open-sourcing of its AI Playground software, designed for local generative AI. AI Playground provides a powerful platform for running AI models on Intel Arc GPUs. It supports various image and video generation models, as well as Large Language Models (LLMs), significantly lowering the hardware barrier for AI applications by optimizing local computing resources. The project is available on GitHub and has attracted developers and AI enthusiasts worldwide.

DeepSeek AI, a prominent Chinese artificial intelligence research lab, following its powerful open-source language model DeepSeek-R1, has achieved another significant breakthrough in the field of Large Language Models (LLMs). Recently, DeepSeek AI officially launched an innovative technology called Self-Principled Critique Tuning (SPCT), aimed at building more general-purpose and scalable AI reward models.

Amidst the rapid advancement of Artificial Intelligence (AI), Microsoft is actively promoting AI literacy with its 50-day AI Skills Festival. This event is open to everyone, from beginners to professionals, offering free registration and access to a wealth of AI learning resources. The initiative aims not only to enhance public AI capabilities but also to break a Guinness World Record, making it a fun and practical event. AI is transforming the way various industries operate, particularly in daily office work. Microsoft hopes to...

The LLMs.txt Generator has received a major update with the release of version 2. This tool quickly converts any website content into text files usable by AI agents or Large Language Models (LLMs), greatly benefiting AI application developers and users. Developed by the @firecrawl_dev team and fully supported by their official llmstxt endpoint, the new version boasts an incredible 10x speed improvement over its predecessor. The LLMs.txt Generator v2...