Popular GitHub Repositories for Cost Effective Pretraining

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

CLIP (Contrastive Language-Image Pretraining), Predict the most relevant text snippet given an image

Llama中文社区，Llama3在线体验和微调模型已开放，实时汇总最新Llama3学习资料，已将所有代码更新适配Llama3，构建最好的中文Llama大模型，完全开源可商用

SkyPilot: Run AI and batch jobs on any infra (Kubernetes or 15+ clouds). Get unified execution, cost savings, and high GPU availability via a simple interface.

XLNet: Generalized Autoregressive Pretraining for Language Understanding

Build effective agents using Model Context Protocol and simple workflow patterns

A large-scale 7B pretraining language model developed by BaiChuan-Inc.

PraisonAI is a production-ready Multi AI Agents framework, designed to create AI Agents to automate and solve problems ranging from simple tasks to complex challenges. It provides a low-code solution to streamline the building and management of multi-agent LLM systems, emphasising simplicity, customisation, and effective human-agent collaboration.

Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including OpenAI Agents SDK, CrewAI, Langchain, Autogen, AG2, and CamelAI

General technology for enabling AI capabilities w/ LLMs and MLLMs

? Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 ?

DeepSeek-VL: Towards Real-World Vision-Language Understanding

This is a Phi Family of SLMs book for getting started with Phi Models. Phi a family of open sourced AI models developed by Microsoft. Phi models are the most capable and cost-effective small language models (SLMs) available, outperforming models of the same size and next size up across a variety of language, reasoning, coding, and math benchmarks

OpenBot leverages smartphones as brains for low-cost robots. We have designed a small electric vehicle that costs about $50 and serves as a robot body. Our software stack for Android smartphones supports advanced robotics workloads such as person following and real-time autonomous navigation.

[EMNLP 2023 Demo] Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding

mPLUG-Owl: The Powerful Multi-modal Large Language Model Family

"Effective Whole-body Pose Estimation with Two-stages Distillation" (ICCV 2023, CV4Metaverse Workshop)

Large-scale pretraining for dialogue

[AAAI-23 Oral] Official implementation of the paper "Are Transformers Effective for Time Series Forecasting?"

EasyNLP: A Comprehensive and Easy-to-use NLP Toolkit