Popular GitHub Repositories for Tinyllama

[NeurIPS 2023] LLM-Pruner: On the Structural Pruning of Large Language Models. Support Llama-3/3.1, Llama-2, LLaMA, BLOOM, Vicuna, Baichuan, TinyLlama, etc.

A Framework of Small-scale Large Multimodal Models

Chat with AI large language models running natively in your browser. Enjoy private, server-free, seamless AI conversations.

A CLI to manage install and configure llama inference implemenation in multiple languages

A set of bash scripts to automate deployment of GGML/GGUF models [default: RWKV] with the use of KoboldCpp on Android - Termux

OpenVINO LLM Node.js C++ addon

This application allows users to upload PDF files, process them, and ask questions about the content using a locally hosted language model. The system uses Retrieval-Augmented Generation (RAG) to provide accurate answers based on the uploaded PDFs.

TinyLlama on Cortex-M55 using CMSIS-DSP and Helium vector instructions

A simple Python script for running LLMs on Intel's Neural Processing Units (NPUs)

Most simple and minimal code to run an LLM chatbot from HuggingFace hub with OpenVINO

The project was undertaken as part of the Intel Unnati Industrial Training program for the year 2024. The primary objective of this project aligns with Problem Statement PS-04: Introduction to GenAI LLM Inference on CPUs and subsequent LLM Model Finetuning for the development of a Custom Chatbot.

Fine-tuning the Tiny Llama model to mimic my professor's writing style using the Llama Factory. The project involves data collection, preprocessing, preparation, fine-tuning, and evaluation.

News QA generation and fine tuning an LLM for QA generation (under development)

The LLM FineTuning and Evaluation project ? enhances FLAN-T5 models for tasks like summarizing Spanish news articles ???. It features detailed notebooks ? on fine-tuning and evaluating models to optimize performance for specific applications. ?✨

Repository for course project for the Applied ML course

Web3 XMTP TinyLlama AI agent chat app

Prompt Injection Detection in LLaMA-based Chatbots using LLM Guard

Quantize TinyLlama-1.1B-Chat from PyTorch to CoreML (float16, int8, int4) for efficient on-device inference on iOS 18+.

A smart LLM chatbot powered by Retrieval-Augmented Generation (RAG) and FAISS, capable of answering questions from your own documents.

Tinyllama from scratch