Popular GitHub Repositories for Profiler

Profiling and inspecting memory in pytorch

A parser, editor and profiler tool for ONNX models.

A simple NLP library allows profiling datasets with one or more text columns. When given a dataset and a column name containing text data, NLP Profiler will return either high-level insights or low-level/granular statistical information about the text in that column.

MLModelCI is a complete MLOps platform for managing, converting, profiling, and deploying MLaaS (Machine Learning-as-a-Service), bridging the gap between current ML training and serving systems.

llm theoretical performance analysis tools and support params, flops, memory and latency analysis.

Pipeline Profiler is a tool for visualizing machine learning pipelines generated by AutoML tools.

DoCoreAI is a next-gen open-source AI profiler that optimizes reasoning, creativity, precision and temperature in a single step—cutting token usage by 15-30% and lowering LLM API costs

PyMemTimeProfiler 能让你深入了解 Python 代码的性能，无需装饰器、无需设置、无需麻烦。它能即时追踪应用中每个函数的内存使用和执行时间。只需运行你的脚本，就能得到一份清晰的、基于 JSON 的性能报告，专门针对你的代码库。零代码改动，最大程度的可见性。非常适合性能调优。

Profiler Application using Sentiment Analysis

AI Reddit Profiler is a Python tool that uses AI to analyze Reddit user profiles. It extracts information like karma, subreddit activity, and post history to provide insights into a user's identity, behavior, and psychological profile. Perfect for researchers and analysts interested in social media behavior analysis.

LLM-powered performance profiler for TouchDesigner. Captures live cook metrics, analyses OP graphs, and returns GPT-optimised suggestions for real-time systems.

A general and accurate RAM / MACs / FLOPs profiler for ONNX models (Currently work-in-progress)

AlphAI is a versatile Python toolkit for GPU profiling and analytics, supporting various tensor models. It enhances GPU server operations and serves as a client for American Data Science's notebook servers.

jemalloc is a memory allocator designed to reduce fragmentation and support scalable concurrency. It is widely used in various applications for its reliable performance and includes features for profiling and monitoring. ??

LLM-Profiler is a tool for evaluating the performance of online serving engine for LLMs

Example of memory usage investigation with memory-profiler

Modify run:ai and other FOSS projects code for use with PCIe card-based AI accelerators for both inference and training