A command-line tool for deduplicating entries in a file or stream.
-
Updated
May 23, 2018 - Rust
#
deduplicator
Here are 10 public repositories matching this topic...
Sift duplicate whitespaces away!
rust string text rust-language rust-lang string-manipulation rust-library sift rust-crate dedup deduplicator string-formatting whitespace-removal
-
Updated
Apr 15, 2025 - Rust
Project to take two similar zipfiles, and to dedupe files that have the same tiemstamp in the older file.
utility zip dedupe python3 python-3 deduplication 7z deduplicate dedup deduplicator zipfile deduping deduplicating-backups
-
Updated
Oct 14, 2018 - Python
Analyse 2 paths to found identical files and hard link them to save space
linux utility tool filesystem space scanner duplicate-files scan deduplication deduplicate saving dedup deduplicator hardlinking hardlink hardlinks
-
Updated
Apr 19, 2024 - Go
A NiFi processor that deduplicates incoming data using an existing Redis connection pool service.
-
Updated
Dec 15, 2023 - Java
Duplicate file finder and de-duplicator. A tool that detects duplicate files and replaces them with symlinks to a shared file in a special shared files folder.
-
Updated
May 12, 2025 - C#
A web app that finds and removes duplicates in your Spotify playlists.
-
Updated
Aug 9, 2015 - JavaScript
GraphQL response deduplication by mapping entities.
-
Updated
Aug 12, 2021 - TypeScript
Utility for automatic Git repository deduplication
-
Updated
Jul 11, 2020 - Java
Improve this page
Add a description, image, and links to the deduplicator topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the deduplicator topic, visit your repo's landing page and select "manage topics."