Popular GitHub Repositories for Scrapping

AgentQL is a suite of tools for connecting your AI to the web. Featuring a query language and Playwright integrations for interacting with elements and extracting data quickly, precisely, and at scale. Includes REST API, Python and JavaScript SDKs, browser debugger.

Selenium Open Source Search Engine & crawler

Model Context Protocol server that integrates AgentQL's data extraction capabilities.

Scrape Reddit for marketing pain points using GPT — built to fuel Cronlytic's growth.

A quantitative study on over 1.25 million tweets about ChatGPT, employed data scrapping, data cleaning, EDA, topic modeling, and sentiment analysis.

API for scrapping news on stock market for sentiment analysis and stock prediction

An AI project where we do web scrapping from Twitter API, find the sentimental analysis using bag-of-word model, & store it in a csv file.

DeepSeek Operator - OpenAI Operator Alternative (Run Locally for FREE)

AgentQL’s integrations with workflow automation tools and AI agent frameworks let you extract structured data from web pages using queries or natural language and interact with the web with Playwright. Resilient, fast, and AI-ready.

?️ n8n Community Node for Scrappey API – Automate web scraping and data extraction with advanced anti-bot blocking technology, seamlessly integrated into the n8n HTTP node.

End-to-end Sentiment Analysis Pipeline for Call Center Conversations

An Ultimate web scrapping and data analyst project and also machine learning project that send API to a car selling website and u can have prices of cars u want in your sql database and estimate your own car price by machine learning and so much more...

A web app that is made to scan handwritten text and convert it to typed one and then performs tasks like translation and summarization of that text and this app has mode which let you find details of any medicine just by scanning it.

Multi-Agent Generally Intelligent Simultaneous Training Algorithm for Project Zeta

AI-powered web scraping agent built with LangGraph, LangSmith, Firecrawl, and Anthropic AI. Automates intelligent crawling, structured data extraction, and LLM-powered content formatting. Efficiently handles anti-bot mechanisms, error recovery, and batch processing. ?

Python-Backend for web-scrapping and NLP summarization

A products scraper, that uses Scrapy spiders to crawl a list of websites, gather relevant data from them, a data filtering script and a Spacy model for NER, that will be trained to detect products.

KeepCoding Bootcamp Big Data & Machine Learning - Proyecto Final Team Outliers - Batiendo a la bolsa

In this project I have built an end to end advanced RAG project using open source llm model, Mistral using groq inferencing engine.

Python module for batch-downloading media from Reddit, with support for duplicate removal.