Popular GitHub Repositories for Comment Scraper

Python scraper based on AI

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Use LLMs to dig out what you care about from massive amounts of information and a variety of sources daily.

Turn any webpage into structured data using LLMs

A community-driven way to read and chat with AI bots - powered by chatGPT.

A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama

Introducing DeToxify – the ultimate toxicity buster. Armed with NLP superpowers, it sniffs out harmful comments, neutralizes negativity, and rewrites toxicity into pure class. Think of it as Jarvis for your online spaces—making the internet a kinder, smarter place, one comment at a time.

Automate webpages at scale, scrape web data completely and accurately with high performance, distributed AI-RPA.

A multithreaded ?? web crawler that recursively crawls a website and creates a ? markdown file for each page, designed for LLM RAG

Extract knowledge from all information sources using gpt and other language models. Index and make Q&A session with information sources.

The GPT-based Universal Web Scraper MVP is a solution that leverages GPT models and web scraping libraries to generate scraper code based on user input and website analysis, simplifying the web scraping process.

Lego AI Parser is an open-source application that uses OpenAI to parse visible text of HTML elements.

Youtube Bot Auto Comment

Turn Webpage to LLM friendly input text. Similar to Firecrawl and Jina Reader API. Makes RAG, AI web scraping, image & webpage links extraction easy.

ScraperAI is an open-source, AI-powered tool designed to simplify web scraping for users of all skill levels.

Unofficial Claude API supporting direct HTTP chat creation/deletion/retrieval, messages with multiple file attachments and auto session gathering using Firefox with geckodriver.

Developed an AI application using LLM to analyze user resumes and provided the summarization, strengths, weaknesses, suggestions, suitable job titles, and also scraping job details from LinkedIn using Selenium. This application reduces time by 30% and helps candidates tailor their resumes effectively.

Mimix: A Text Generation Tool and Pretrained Chinese Models

Financial Web Scraper & Sentiment Classifier

Sentiment Analysis of news on stock prices