How do I remove duplicate lines from a list?
Paste your list into FixDoks's Remove Duplicate Lines tool, one item per line. It keeps the first copy of each line and deletes the rest, while keeping your original order. Options let you ignore case, trim spaces and drop empty lines. The status line shows how many lines were removed, all in your browser.
Remove Duplicate Lines at a glance
| Input | A list, one item per line |
|---|---|
| Output | Same list with repeated lines removed, original order kept |
| Processing | In your browser; your files are not uploaded |
| Price | Free |
| Works on | Chrome, Edge, Safari and Firefox on Windows, Mac, Android and iPhone |
How to use Remove Duplicate Lines
- Paste your list with one item per line.
- Choose whether to ignore upper and lower case, trim spaces and remove empty lines.
- Click Remove duplicates. The status line shows how many lines were removed.
- Copy or download the cleaned list.
Clean up any list in seconds
Lists collected from different places almost always contain repeats: the same email address from two registration sheets, a phone number entered twice, the same keyword in two research exports. Paste the list here and FixDoks keeps the first copy of each line and removes the rest. The original order is kept, so the list still makes sense afterwards.
Options explained
- Ignore upper/lower case: treats "Rahul@Example.com" and "rahul@example.com" as the same line. Turn this on for email addresses, domain names and keywords. The first version that appears is the one kept.
- Trim spaces at line ends: removes invisible spaces before and after each line. Without this, "Pune" and "Pune " count as different lines, which is a common reason other tools miss duplicates.
- Remove empty lines: drops blank lines as well.
Examples
| Input | Output (ignore case on) |
|---|---|
| apple Banana apple banana cherry | apple Banana cherry |
Working with Excel and Google Sheets
Select a column in your spreadsheet, copy it, and paste it here. Each cell becomes one line. After removing duplicates, copy the result and paste it back into the sheet: each line goes into its own cell again. If you need to dedupe by one column but keep whole rows, use the spreadsheet's own "Remove duplicates" feature instead, because this tool compares whole lines.
Phone numbers and emails
Duplicates are only detected when lines match exactly (after the trim and case options). The numbers "+91 98765 43210" and "9876543210" are the same phone number written two ways, so they are not treated as duplicates. For best results, first make the format consistent. The find and replace tool can remove spaces and country codes in one step, for example by replacing " " with nothing.
Sort as well?
This tool keeps your order. If you also want the list in alphabetical order, use sort lines, which has its own remove duplicates option. To see which lines are in one list but not another, paste both lists into the text compare tool.
There is no line limit. Lists with hundreds of thousands of lines are handled in a second or two on a laptop, and the whole job happens on your device, which matters when the list contains customer emails or phone numbers.
Counting what was removed
After each run the status line shows how many unique lines were kept and how many were removed, including blank lines if that option is on. It is a quick way to count unique entries in a list, for example how many different customers appear in an order export.