Remove Duplicate Lines & Sort Lists

0 bytes uploaded

Remove duplicate lines from hostnames, email lists, SQL keys, or logs instantaneously in browser memory—keeping original order or sorting.

100% Client-Side — Verify 0 bytes uploaded in Network tabVerify 0 bytes sent in Network tab

or drop a text or data file here · Ctrl V to paste · or drop .txt, .csv, .log files · Ctrl V to paste lines
  • 100% browser-local
  • Shows exact duplicates removed
  • Case-insensitive & sort options

Instant Before & After Preview

2 duplicates removed
Before (Input)domains.txt
api.example.com
cdn.example.com
API.EXAMPLE.COM
auth.example.com
cdn.example.com
After (Output).txt
api.example.com
cdn.example.com
auth.example.com

How it works

How to deduplicate text lines cleanly

Clean giant lists of URLs, keywords, or config lines without uploading internal lists.

  1. Paste or drop line listProvide any multi-line text, CSV, or log dump.
  2. Set matching & sort orderToggle case sensitivity, trim spaces, remove empty lines, and pick Keep Order, A -> Z, or Z -> A.
  3. Inspect count & copyReview exact duplicates removed and copy or download the unique list.

FAQ

Frequently asked questions

Does Keep Original Order preserve the first occurrence of each line?

Yes. With Sort Order set to Keep Original Order, the first copy of every line stays in place while subsequent duplicates drop.

How does Case-Insensitive matching work with Trim Whitespace?

Lines like 'Api.Example.Com' and ' api.example.com ' normalize during comparison so both collapse into one clean entry.

Can I handle thousands of log lines instantaneously?

Yes. Set-based O(n) hashing in local memory deduplicates tens of thousands of lines in milliseconds.