Popular GitHub Repositories for Crawl4ai

AI web scraper built with Crawl4AI for extracting structured leads data from websites.

The Web Metadata Extraction Toolkit is designed to streamline the process of extracting, cleaning, and analyzing metadata from websites. Utilizing advanced AI models and custom extraction strategies, this toolkit helps users efficiently gather data like titles, descriptions, and keywords, which are crucial for SEO and content strategy.

Crawl4DeepSeek = Crawl4AI + DeepSeek ? Smart, efficient, and built for deep web exploration! ??

Integrates Supabase with Crawl4AI and AI Chat to create a powerful web crawling and semantic search solution. Streamlit supabase data visualization. Run all in Docker. API and more!

Generate YouTube Shorts Video From an Article Link using Pydantic AI

LLM laboratory

AI tool to transforms any URL into a structured knowledge source by: extracting content using Crawl4AI ,vectorizing and summarizing data , running Retrieval-Augmented Generation (RAG) for deep information discovery, enabling a smart chatbot for interactive Q&A.

LangGraph 网页智能助手：基于 LangGraph 技术的智能 AI 助手，能够进行网络搜索、抓取网页内容并进行智能摘要，为用户提供比普通搜索更深入、更全面的网络信息获取体验。

Web crawling tool that integrates with AI assistants via the MCP

AI-driven system for structured data extraction, storage, and vector search, leveraging Crawl4AI, PydanticAI, and Supabase to enable efficient retrieval and RAG-based AI applications.

? Deterministic & programmatic Gmail → Supabase → Crawl4AI vector knowledge base for UC Berkeley MIDS.