Popular GitHub Repositories for Pii Redaction

Context aware, pluggable and customizable data protection and de-identification SDK for text and images

Document (PDF, Word, PPTX ...) extraction and parse API using state of the art modern OCRs + Ollama supported models. Anonymize documents. Remove PII. Convert any document or picture to structured JSON or Markdown

Enterprise-grade and API-first LLM workspace for unstructured documents, including data extraction, redaction, rights management, prompt playground, and more!

An AI-powered Personal Identifiable Information (PII) scanner.

This package features data-science related tasks for developing new recognizers for Presidio. It is used for the evaluation of the entire system, as well as for evaluating specific PII recognizers or PII detection models.

Fused Window Transformers for fMRI Time Series Analysis (https://www.sciencedirect.com/science/article/pii/S1361841523001019)

PII Masker is an open-source tool for protecting sensitive data by automatically detecting and masking PII using advanced AI, powered by DeBERTa-v3. It provides high-precision detection, scalable performance, and a simple Python API for seamless integration into workflows, ensuring privacy compliance in various industries.

A collection of samples demonstrating techniques for processing documents with Azure AI including AI Studio, OpenAI, Document Intelligence, etc.

Examples scripts that showcase how to use Private AI Text to de-identify, redact, hash, tokenize, mask and synthesize PII in text.

Deep learning, Convolutional neural networks, Image processing, Document processing, Table detection, Page object detection, Table classification. https://www.sciencedirect.com/science/article/pii/S0925231221018142

Detect and redact PII locally with SOTA performance

Deidentify people's names and gender specific pronouns

Personal Identifiable Information (PII) entity detection and performance enhancement with synthetic data generation

Lightning-fast PII detection and anonymization library with 190x performance advantage - detect emails, SSNs, names, and more in <2MB package

A python client used to interact with the Private AI's API

Anonymize / mask personal information before sending prompts to chat AI (like ChatGPT provided by OpenAI)

The Security Toolkit for managing Generative AI(especially LLMs) and Supervised Learning processes(Learning and Inference).

Implementation of a Distributed Personal Information Recognition System that identifies sensitive personal data in text documents and anonymizes data effectively, preserving statistical value.

实时座席行为智能分析系统。该系统利用GPT-3.5（低成本）、Whisper、DuckDB以及精美的React+TypeScript前端，能够转录客服电话、移除个人身份信息、提取情绪基调、对问题进行分类，并提供数据丰富的仪表盘。无需Azure、Power BI或任何厂商绑定，这是一个完全本地运行的全栈AI系统。

Implement named entity recognition (NER) using regex and fine-tuned LLM, with a total of 15 categories. The ultimate goal is to apply the model to detect personally identifiable information (PII) in student writing.