AIbase
プロダクトライブラリツールナビゲーション

eGet-Crawler-for-ai

Public

Web scraping framework built for AI applications. Extract clean, structured content from any website with dynamic content handling, markdown conversion, and intelligent crawling capabilities. Perfect for RAG applications and AI training data pipelines. Features async processing, browser management, and Prometheus monitoring.

作成時間2024-11-15T11:08:54
更新時間2025-02-26T13:32:49
45
Stars
0
Stars Increase

関連プロジェクト