Popular GitHub Repositories for Benchmarking Functions

Enhanced ChatGPT Clone: Features Agents, DeepSeek, Anthropic, AWS, OpenAI, Assistants API, Azure, Groq, o1, GPT-4o, Mistral, OpenRouter, Vertex AI, Gemini, Artifacts, AI model switching, message search, Code Interpreter, langchain, DALL-E-3, OpenAPI Actions, Functions, Secure Multi-User Auth, Presets, open-source for self-hosting. Active project.

Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)

structured outputs for llms

Experience, Learn and Code the latest breakthrough innovations with Microsoft AI

AI suite powered by state-of-the-art models and providing advanced AI/AGI functions. It features AI personas, AGI functions, multi-model chats, text-to-image, voice, response streaming, code highlighting and execution, PDF import, presets for developers, much more. Deploy on-prem or in the cloud.

An adversarial example library for constructing attacks, building defenses, and benchmarking both

✨ AI agents that spark joy

Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including OpenAI Agents SDK, CrewAI, Langchain, Autogen, AG2, and CamelAI

Merlion: A Machine Learning Framework for Time Series Intelligence

AutoRAG: An Open-Source Framework for Retrieval-Augmented Generation (RAG) Evaluation & Optimization with AutoML-Style Automation

The leading workflow orchestration platform. Run stateful step functions and AI workflows on serverless, servers, or the edge.

? Turns your machine learning code into microservices with web API, interactive GUI, and more.

The Compute Library is a set of computer vision and machine learning functions optimised for both Arm CPUs and GPUs using SIMD technologies.

Repository for benchmarking graph neural networks (JMLR 2023)

The state-of-the-art image restoration model without nonlinear activation functions.

Collection of popular and reproducible image denoising works.

Seamlessly integrate LLMs as Python functions

? NanoNeuron is 7 simple JavaScript functions that will give you a feeling of how machines can actually "learn"

[NeurIPS 2024] OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments

Unifying Variational Autoencoder (VAE) implementations in Pytorch (NeurIPS 2022)