Popular GitHub Repositories for Scrapy Spider

Python 开源项目之「自学编程之路」，保姆级教程：AI实验室、宝藏视频、数据结构、学习指南、机器学习实战、深度学习实战、网络爬虫、大厂面经、程序人生、资源分享。

Flexible Node.js AI-assisted crawler library

爬取百度百科中文页面，抽取三元组信息，构建中文知识图谱

:newspaper: Let ChatGPT Summarize Hacker News for You

借助Python抓取微博数据，并对抓取的数据进行情绪分析

The Resources for "Natural Language to Logical Form" ; "自然语言转逻辑形式"研究资料收集。

就业推荐系统 spark ml 推荐系统 协同过滤 招聘平台 爬虫 毕业设计 大数据技术 招聘信息爬虫 智联招聘

对豆瓣影评进行文本分类情感分析，利用爬虫豆瓣爬取评论，进行数据清洗，分词，采用BERT、CNN、LSTM等模型进行训练，采用tensorboardX可视化训练过程，自然语言处理项目\A project for text classification, based on torch 1.7.1

Text-to-SQL in the Wild: A Naturally-Occurring Dataset Based on Stack Exchange Data

? 哔哩哔哩(bilibili)评论下载器兼数据可视化桌面软件- 支持单视频/批量下载、地区分布地图、词云分析、图片获取等功能的桌面应用。未来会做一个 youtube 评论区观察，欢迎⭐支持我~

A Machine Learning Project implemented from scratch which involves web scraping, data engineering, exploratory data analysis and machine learning to predict housing prices in New York Tri-State Area.

Automated web scraping spider generation using Browser Use and LLMs. Streamline the creation of Playwright-based spiders with minimal manual coding. Ideal for large enterprises with recurring data extraction needs.

携程/榛果民宿实时评论挖掘软件，包含数据的实时采集/数据清洗/结构化保存/ UGC 数据主题提取/情感分析/后结构化可视化等技术的综合性演示 Demo。基于在线民宿 UGC 数据的意见挖掘项目，包含数据挖掘和 NLP 相关的处理，负责数据采集、主题抽取、情感分析等任务。主要克服用户打分和评论不一致，实时对携程和美团在线民宿的满意度进行评测以及对额外数据进行可视化的综合性工具，多维度的对在线 UGC 进行数据挖掘并可视化，demo 视频演示见链接。

Vietnamese speech recognition using Wavenet

针对微博平台的微博文本数据进行舆情分析项目，内容有微博爬虫、LDA主题分析和情感分析

A simple spider and sentiment analysis for JD (爬取京东商品评论+情感分析+数据可视化)

Building a model to recognize incentives for landscape restoration in environmental policies from Latin America, the US and India. Bringing NLP to the world of policy analysis through an extensible framework that includes scraping, preprocessing, active learning and text analysis pipelines.

A powerful tool that leverages Cursor AI and MCP (Model Context Protocol) to easily generate web scrapers for various types of websites.

The spider crawls moneycontrol.com and economictimes.com to fetch news of input companies and also scores and classifies the companies to raise an early warning signal

Full Python Programming Tutorials with Focus on artificial intelligence and machine learning