阿里巴巴Qwen團隊推出Mobile-Agent-v3和GUI-Owl，旨在解決圖形用戶界面自動化挑戰。基於Qwen2.5-VL的GUI-Owl通過多模態代理模型和大量GUI交互數據訓練，顯著提升任務理解能力，突破傳統依賴複雜腳本和手工規則的侷限。
X-PLUG團隊發佈Mobile-Agent-v3跨平臺多代理框架，基於GUI-Owl模型，具備規劃、進度管理、反思和記憶能力，提升GUI自動化體驗。該原生端到端多模態代理融合感知、推理、規劃與執行功能，支持流暢跨平臺交互和多回合決策。
阿里巴巴發佈第三代GUI智能體框架Mobile-Agent-v3，並開源多模態跨平臺GUI虛擬層模型GUI-Owl。該技術組合在10餘項權威基準測試中表現卓越，尤其在AndroidWorld和OSWorld平臺分別創下73.3%和37.7%的成功率記錄，標誌着GUI自動化技術取得重大突破。
Alibaba
$2
輸入tokens/百萬
$20
輸出tokens/百萬
-
上下文長度
Bytedance
$3.5
$12
128
microsoft
GUI-Actor-2B是基於Qwen2-VL-2B的視覺語言模型，專為圖形用戶界面(GUI)定位任務設計，通過增加基於注意力的動作頭並進行微調，在多個GUI定位基準測試中表現良好。
GUI-Actor-7B是基於Qwen2-VL-7B-Instruct開發的視覺語言模型，專注於圖形用戶界面(GUI)代理任務，提供無座標的視覺接地解決方案。
%20--%3e%3cdefs%3e%3cstyle%3e%20.st0%20{%20fill:%20%23061b40;%20}%20.st1%20{%20fill:%20%23306af1;%20}%20.st2%20{%20fill:%20%235ce5cf;%20}%20%3c/style%3e%3c/defs%3e%3cg%3e%3cpath%20class='st0'%20d='M55,10.5h9v3h-9v9h12V7.5h-12v3ZM64,19.5h-6v-3h6v3Z'/%3e%3cpolygon%20class='st0'%20points='69%2016.5%2078%2016.5%2078%2019.5%2069%2019.5%2069%2022.5%2081%2022.5%2081%2013.5%2072%2013.5%2072%2010.5%2081%2010.5%2081%207.5%2069%207.5%2069%2016.5'/%3e%3cpolygon%20class='st0'%20points='95%2010.5%2095%207.5%2083%207.5%2083%2022.5%2095%2022.5%2095%2019.5%2086%2019.5%2086%2016.5%2095%2016.5%2095%2013.5%2086%2013.5%2086%2010.5%2095%2010.5'/%3e%3cpath%20class='st0'%20d='M40,1.5v21h11.6l1.4-1.4v-7.6h0c0,0-1.4-1.5-1.4-1.5l1.4-1.4V2.9l-1.4-1.4h-11.6ZM50,19.5h-7v-6h7v6ZM50,10.5h-7v-6h7v6Z'/%3e%3c/g%3e%3cpath%20class='st1'%20d='M23.1,24L14.7,4.8l-4.9,11.2h3.8l-1.8,4H3.3L12.1,0H2C.9,0,0,.9,0,2v20c0,1.1.9,2,2,2h21.1Z'/%3e%3cpath%20class='st2'%20d='M34,0h-16.8l10.6,24h6.2c1.1,0,2-.9,2-2V2C36,.9,35.1,0,34,0ZM32.5,20h-4V4h4v16Z'/%3e%3c/svg%3e)
