CSV Deduplicator

Duplicates are rarely identical. Decide what counts as the same record and remove the rest.

Remove duplicate rows from a CSV

Drop a CSV to get started

Or choose a file from your computer. Everything is processed in this tab, so nothing is uploaded and no account is needed.

Choose filePaste data

Try it with sample data

Exact match only catches the easy half

Removing rows that are byte for byte identical is the simple case, and it is usually the smaller one. The duplicates that survive are the ones where the email is the same but the casing differs, where the company is Acme Ltd in one row and ACME Ltd. in another, or where a trailing space slipped in during an export.

The key column is the real decision

Matching on every column finds identical rows. Matching on the email finds the same person recorded twice with different job titles. Matching on the domain collapses a company down to one row. Which one is correct depends on what the list is for, which is why it is a choice rather than a default.

Normalisation before comparison

Casing, surrounding whitespace and punctuation are noise in almost every identity field. Ignoring them before comparing turns three near misses into one match. Punctuation is left off by default because it matters in some fields, such as product codes, and can be switched on when it does not.

Keep the removed rows

Both halves are exportable. The clean list is what you use, and the removed rows are what you check when a number looks wrong. Deduplication that throws data away without showing you what it took is impossible to audit.

Questions

Is my file uploaded?

What is the difference between keeping the first and the last match?

Can I match on more than one column?

Why are some duplicates still there?

How does this differ from the Lead List Cleaner?

We already know your next customer

Describe your ideal customer. ManyPI finds validated leads, reaches out, and turns emails into sales.