Popular GitHub Repositories for Jsonl

This is a obsidian plugin to help with the creation of personal jsonl datasets for text generation models.

Hyperparam local dataset viewer

an easy way to create JSONL files for fine-tuning openai models.

A fast TUI application (with optional webui) to visually navigate and inspect JSON and JSONL data. Easily localize parse errors in large JSONL files. Made with LLM fine-tuning workflows in mind.

JSONL generator designed for models like Google PaLM 2 and OpenAI GPT-3.5

⚡Powered by Goggle TPUs and the latest (Aug 27, 2024) Gemini 1.5 Pro and Flash Models to generate high-quality engineered prompts, analyze text and images, and create datasets for fine-tuning AI models, helping you to become a prompt engineering pro

Craft conversational datasets (JSONL format with rich metadata) using LLMs. Specify parameters manually or use a creative brief for LLM-generated arguments with automatic topic/scenario variation. Optional web search improves persona grounding. Ideal for LoRA tuning, persona training, and creative writing. Includes Hugging Face Hub upload.

This script helps to automate the process of preparing data for finetuning on OpenAI models, specifically GPT-3.5 and Babbage

WP Fine-tuning est un plugin qui exporte vos publications de ou des types de contenus de votre choix, dans un fichier .jsonl prêt à être importé sur OpenAI. Boostez votre IA personnalisée à partir de votre site WordPress

WhatsApp Chat to JSONL Converter is a command-line tool that transforms WhatsApp chat exports into JSON Lines (JSONL) format. It facilitates the fine-tuning of OpenAI GPT models and other conversational AI applications by offering features such as message parsing, content moderation, anonymization, conversation grouping, and detailed logging.

Python script to transform a set of localization .json files into a .jsonl file for LLM fine-tuning.

Extracts Google Sheets to JSONL for fine-tuning, estimates task costs with tiktoken.

Data Processing for GPT-3 which processes text files into jsonl + create a merge, which combines them. Written in node

sharegpt jsonl vim editor

这个Python脚本是一个强大的工具，它利用开源大型语言模型（例如谷歌的Flan-T5）来清洗、澄清和增强存储在`.jsonl`（JSON Lines）格式中的文本数据。

A JSONL generator to create training data for GPT3.5 and newer

Fine Tunning Data prepare for Wine Service Chatbot App

Transform doccano JSONL to the format expected by AutoML

Generate rich JSONL datasets from topics to fine-tune Large Language Models. This tool transforms topics into diverse Q&A pairs by leveraging multiple AI providers to ensure variety and quality in training data.

This is a simple web application that allows users to create JSONL files for fine-tuning OpenAI's GPT models. The application includes fields for entering "System", "User", and "Assistant" messages, stores data in the browser's local storage to prevent data loss on refresh, and supports multiple languages (English, Portuguese, Spanish, and Hindi).