tokenx

? Industrial-strength Natural Language Processing (NLP) in Python

? Token-Oriented Object Notation – JSON for LLMs at half the token cost

Context-Free Grammar Parser

ChatGPT Java SDK支持流式输出、Gpt插件、联网。支持OpenAI官方所有接口。ChatGPT的Java客户端。OpenAI GPT-3.5-Turb GPT-4 Api Client for Java

Flops counter for convolutional networks in pytorch framework

Easy token price estimates for 400+ LLMs. TokenOps.

Specify a github or local repo, github pull request, arXiv or Sci-Hub paper, Youtube transcript or documentation URL on the web and scrape into a text file and clipboard for easier LLM ingestion

A suite of image and video neural tokenizers

LunaSec - Dependency Security Scanner that automatically notifies you about vulnerabilities like Log4Shell or node-ipc in your Pull Requests and Builds. Protect yourself in 30 seconds with the LunaTrace GitHub App: https://github.com/marketplace/lunatrace-by-lunasec/

Online playground for OpenAPI tokenizers