Remove duplicate lines from a list

Frequently asked questions

Which copy is kept?

By default the first one, and the line stays where it first appeared. “Keep the last” keeps the final copy, in the position of that last copy.

Can it ignore capital letters and spaces?

Yes. “Ignore case” treats Apple and apple as the same line, and the space option can ignore spaces at the ends or treat runs of spaces as one. The line you keep is written exactly as you typed it.

Can I see which lines were repeated?

Yes. The panel under the result lists the lines that appeared more than once with their counts, and “Put the count in front of each line” writes the count and a tab before each kept line. “Only the repeated lines” and “Only lines that appear once” filter instead of removing.

Are blank lines duplicates of each other?

By default yes, so only one blank line is kept. Tick “Leave blank lines alone” to keep them all.

What happens to Windows (CRLF) and Mac line endings?

Windows, Mac and Linux breaks are all read as ordinary line breaks. A file you open with “Open file” keeps its style in the result, so a CRLF file stays CRLF. Browsers turn the breaks of text you type or paste into plain LF, so that text gets LF results. If a file mixes styles, the commonest one is used and the tool says so.

Is my text uploaded anywhere?

No. Everything runs in your browser; your text is never sent to a server and is not saved on this device. Only your option choices are remembered. (If you switch to another operation, your text is held in this tab's session storage for up to a minute so it can carry over, then discarded.) It is free, with no sign-up and no watermark.