When to use it
Remove Duplicate Lines cleans up any list so each line appears only once. Use it for email lists before a mailing, keyword and tag lists, product SKUs, URLs, names from several sign-up sheets, log files, or any data copied from spreadsheets where the same entry crept in more than once.
How to remove duplicate lines
- Paste your list into Your text, one item per line, or press Example.
- Choose your options:
- Ignore capital letters (Apple = apple)
- Ignore spaces at the start and end (on by default)
- Remove empty lines (on by default)
- Sort the result A to Z
- Read the Unique lines, with a note of how many were kept and how many duplicates were removed.
- Press Copy result or Download .txt.
A worked example
You combined three event sign-up sheets into one list of 412 email addresses. Paste them in and tick Ignore capital letters, because “Ana@Mail.com” and “ana@mail.com” are the same address. The note says “378 unique · 34 duplicates removed”. Copy the result into your mailing tool, and nobody gets your announcement twice.
Tips
- Ignore capital letters for emails and usernames; keep it off for case-sensitive data like passwords or product codes.
- Sort A to Z to make lists easier to scan and compare.
- Check the note: an unexpectedly high number of duplicates can reveal a copy-paste mistake.
- For spreadsheets, copy a single column, clean it here, and paste it back.
Other uses
- Keyword research: merge keyword exports from several tools and remove repeats.
- Tag lists: clean up hashtags or categories before importing them.
- Log files: reduce repeated error lines to see each distinct message once.
- Sign-in sheets: find out how many different people attended.
Common mistakes
- Leaving capital letters on when the list should ignore them, so near-duplicates survive.
- Pasting several columns at once. Each whole line is compared, so rows with different second columns don’t count as duplicates.
- Sorting when order matters, such as a ranked list or a sequence of steps.
- Hidden characters from web pages or PDFs that make lines look identical but differ; pasting into a plain text editor first can help.
Private by design
Your list is processed in your browser and never uploaded.
Related tools
Sort a list with Sort Lines, count lines with the Line Counter, or change words across a list with Find and Replace.