AIbase

markdown-crawler

Public

A multithreaded ?? web crawler that recursively crawls a website and creates a ? markdown file for each page, designed for LLM RAG

Creat2023-10-24T21:30:06
Update2025-03-26T06:01:21
https://pypi.org/project/markdown-crawler/
392
Stars
-1
Stars Increase