Popular GitHub Repositories for Prefill

Discover the most popular open-source projects and tools related to Prefill, and stay updated with the latest development trends and innovations.

?FFPA(Split-D): Yet another Faster Flash Prefill Attention with O(1) GPU SRAM complexity for headdim > 256, ~2x↑?vs SDPA EA.

? LLM inference optimization simulator, modeling compute-bound prefill and memory-bound decode phases.

NanoPD, a minimalistic implementation of the disaggregated PD serve