Popular GitHub Repositories for Duplicates

Simplify Your Visual Data Ops. Find and visualize issues with your computer vision datasets such as duplicates, anomalies, data leakage, mislabels and others.

AI Github assistant for your repo. Your proactive GitHub bot that auto-detects duplicates using OpenAI embeddings and Supabase magic!

Сleans prompts from duplicates and other garbage. Constructs prompt using various nodes

A project aiming to leverage text embeddings and Milvus, a high-performance vector search engine, to detect duplicate job postings.

This repository contains a bot that automates the process of downloading popular meme videos from Reddit and uploading them as YouTube Shorts. With simple setup steps, you can customize sound effects and ensure your content stays fresh without duplicates. ??

Automated Receipt & Invoice Data Extractor for Homelabs (InvoiceBillScan). Uses n8n, Telegram, Google Drive/Sheets, and AI Vision (OpenAI/Gemini) to instantly process, archive, and ledger financial documents. Prevent duplicates via MD5 checksum. Streamline personal finance automation.

Cloudflare Workers app that watches Wikipedia for newly reported notable deaths, LLM‑filters and de‑duplicates them, then publishes concise memorial posts (Telegram + X) via a lightweight public JSON API. Automates detection, verification, and multi‑platform distribution with low latency and minimal ops overhead.

Eliminar Duplicados Spreadsheet (Google Sheets)

AI-powered storage intelligence for Gmail and Google Drive. Automatically detect duplicates, analyze usage patterns, and execute cleanup actions via Slack approvals.

Transform financial news chaos into clarity. Multi-agent system that reads thousands of articles, eliminates duplicates, predicts stock impact, and delivers analyst-grade insights in seconds.