CompBench

Public

CompBench evaluates the comparative reasoning of multimodal large language models (MLLMs) with 40K image pairs and questions across 8 dimensions of relative comparison: visual attribute, existence, state, emotion, temporality, spatiality, quantity, and quality. CompBench covers diverse visual domains, including animals, fashion, sports, and scenes.

benchmark evaluation-llms foundation-models human-annotation large-language-models llms llms-benchmarking multimodal-deep-learning multimodal-large-language-models reasoning

Creat：2024-07-24T01:48:04

Update：2025-03-26T03:04:53

https://compbench.github.io/

Stars

Stars Increase

Related projects

Transformers

bert

? Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

150875

2年前

+41today

Generative Ai For Beginners

21 Lessons, Get Started Building with Generative AI ? https://microsoft.github.io/generative-ai-for-beginners/

99999

8个月前

+37today

Django

apps

The Web framework for perfectionists with deadlines.

85372

6个月前

+13today

LLMs From Scratch

Hot

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

75057

1年前

+86today

Awesome Llm Apps

Hot

llms

Collection of awesome LLM apps with AI Agents and RAG using OpenAI, Anthropic, Gemini and opensource models.

71626

6个月前

+83today

Gpt_academic

academic

为GPT/GLM等LLM大语言模型提供实用化交互接口，特别优化论文阅读/润色/写作体验，模块化设计，支持自定义快捷按钮&函数插件，支持Python和C++等项目剖析&自译解功能，PDF/LaTex论文翻译&总结功能，支持并行问询多种LLM模型，支持chatglm3等本地模型。接入通义千问, deepseekcoder, 讯飞星火, 文心一言, llama2, rwkv, claude2, moss等。

69318

6个月前

+5today