Popular GitHub Repositories for Multilingual Websites

Make websites accessible for AI agents

? Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.

? 1Panel offers an intuitive web interface for managing websites, files, containers, databases and LLMs within a Linux server.

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Convert ebooks to audiobooks with chapters and metadata using dynamic AI models and voice cloning. Supports 1,107+ languages!

CodeGeeX: An Open Multilingual Code Generation Model (KDD 2023)

vits2 backbone with multilingual-bert

CodeGeeX2: A More Powerful Multilingual Code Generation Model

GLM-4 series: Open Multilingual Multimodal Chat LMs | 开源多语言多模态对话模型

High-quality multi-lingual text-to-speech library by MyShell.ai. Support English, Spanish, French, Chinese, Japanese and Korean.

Multilingual Voice Understanding Model

Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.

BibiGPT v1 · one-Click AI Summary for Audio/Video & Chat with Learning Content: Bilibili | YouTube | Tweet丨TikTok丨Dropbox丨Google Drive丨Local files | Websites丨Podcasts | Meetings | Lectures, etc. 音视频内容 AI 一键总结 & 对话：哔哩哔哩丨YouTube丨推特丨小红书丨抖音丨快手丨百度网盘丨阿里云盘丨网页丨播客丨会议丨本地文件等 (原 BiliGPT 省流神器 & AI课代表)

An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites

A large model-based chatbot builder that can quickly integrate AI models (including ChatGPT, Claude, Gemini) into various software applications (such as Telegram, Gmail, Slack, and websites).

??AutoDev: The AI-powered coding wizard（AI 驱动编程助手）with multilingual support ?, auto code generation ??, and a helpful bug-slaying assistant ?! Customizable prompts ? and a magic Auto Dev/Testing/Document/Agent feature ? included! ?

An Open Source Python alternative to NotebookLM's podcast feature: Transforming Multimodal Content into Captivating Multilingual Audio Conversations with GenAI

Gradio WebUI for creators and developers, featuring key TTS (Edge-TTS, kokoro) and zero-shot Voice Cloning (E2E, F5-TTS, CosyVoice), with Whisper audio processing, RVC voice changer, YouTube download, UVR5 vocal isolation, and multilingual translation.

LightSeq: A High Performance Library for Sequence Processing and Generation

[CCS'24] A dataset consists of 15,140 ChatGPT prompts from Reddit, Discord, websites, and open-source datasets (including 1,405 jailbreak prompts).