Popular GitHub Repositories for Generalist Robots

An open source quadruped robot pet framework for developing Boston Dynamics-style four-legged robots that are perfect for STEM, coding & robotics education, IoT robotics applications, AI-enhanced robotics application services, research, and DIY robotics kit development.

An open source quadruped robot pet framework for developing Boston Dynamics-style four-legged robots that are perfect for STEM, coding & robotics education, IoT robotics applications, AI-enhanced robotics application services, research, and DIY robotics kit development.

OpenBot leverages smartphones as brains for low-cost robots. We have designed a small electric vehicle that costs about $50 and serves as a robot body. Our software stack for Android smartphones supports advanced robotics workloads such as person following and real-time autonomous navigation.

A list of AI agents and robots to block.

Generalist and Lightweight Model for Named Entity Recognition (Extract any entity types from texts) @ NAACL 2024

The first open-source Artificial Narrow Intelligence generalist agentic framework Computer-Using-Agent that fully operates graphical-user-interfaces (GUIs) by using only natural language. Uses Visualization-of-Thought and Chain-of-Thought reasoning to elicit spatial reasoning and perception, emulates, plans and simulates synthetic HID interactions.

ROSA ? is an AI Agent designed to interact with ROS1- and ROS2-based robotics systems using natural language queries. ROSA helps robot developers inspect, diagnose, understand, and operate robots.

VisionLLM Series

??The spatial perception framework for rapidly building smart robots and spaces

Autonomous Agents (LLMs) research papers. Updated Daily.

[ICML'24] SeeAct is a system for generalist web agents that autonomously carry out tasks on any given website, with a focus on large multimodal models (LMMs) such as GPT-4V(ision).

ROS package for dynamic obstacle avoidance for ground robots trained with deep RL

? The Full Process Python Package for Robot Learning from Demonstration and Robot Manipulation

Useful links of different content related to AI, Computer Vision, and Robotics.

Paper list in the survey paper: Toward General-Purpose Robots via Foundation Models: A Survey and Meta-Analysis

? The largest directory for AI-ready documentation and tools implementing the proposed llms.txt standard

RT-GENE: Real-Time Eye Gaze and Blink Estimation in Natural Environments

[RSS 2024]: Expressive Whole-Body Control for Humanoid Robots

[IROS 2020] se(3)-TrackNet: Data-driven 6D Pose Tracking by Calibrating Image Residuals in Synthetic Domains

Towards Generalist Biomedical AI