KutoolsforOffice — One Suite. Five Tools. Get More Done.

How to automatically remove duplicates from a list in Excel?

AuthorSunLast modified

In Excel, we can use the Remove Duplicates feature to remove the same values from a list, but is there any trick to automatically remove duplicates from the list? In this article, I introduce the tricks on automatically removing duplicates if a duplicate appears in a specific Excel column.

Compare methods for automatically preventing duplicate entries

Auto remove duplicates from a list using Data Validation

Auto remove duplicates from a list using Kutools for Excel good idea3


Compare methods for automatically preventing duplicate entries

Both methods below prevent new duplicate values from being entered into a specified range. They do not remove duplicates that already exist in the list. The main difference is whether you want to build the validation rule yourself or apply a ready-to-use duplicate restriction.

MethodBest forSetupResult
Data ValidationUsers who want a built-in Excel solution and control over the validation formulaCreate a Custom rule with a COUNTIF formulaBlocks duplicate manual entries and displays a warning
Kutools for ExcelQuickly preventing duplicate entries without formulasSelect the range and apply Prevent DuplicateBlocks duplicate entries and displays a warning automatically
Recommendation: Use Data Validation when you prefer a built-in Excel solution or want to customize the validation formula yourself. For routine duplicate prevention, Kutools for Excel provides the faster and more convenient approach. Simply select the target range and apply Prevent Duplicate without creating or maintaining a COUNTIF formula.

Auto remove duplicates from a list using Data Validation

1. Click Data > Data Validation. See screenshot:
A screenshot of the Data Validation option in Excel Ribbon

2. In the popping dialog, under Settings tab, select Custom from the Allow list, and type the formula =COUNTIF($A$1:$A$20,A1)=1 into the Formula box. See screenshot:
A screenshot of Data Validation settings with a formula to prevent duplicates

In the formula, A1:A20 is the range in which you want to prevent duplicate entries.

3. Click OK. Now, if you type a duplicate value, a warning dialog will appear and the duplicate entry will be prevented.
A screenshot showing a warning dialog for duplicate entries


Auto remove duplicates from a list using Kutools for Excel

If you are not familiar with formulas, you can apply Kutools for Excel’s Prevent Duplicate utility to stop duplicate values from being entered into a selected range without setting up a validation formula manually.

Kutools for Excel offers over 300 advanced features to streamline complex tasks, boosting creativity and efficiency. Integrated with AI capabilities, Kutools automates tasks with precision, making data management effortless. Detailed information of Kutools for Excel...         Free trial...

Select the range or column in which you want to prevent duplicate entries, and then click Kutools > Prevent Typing > Prevent Duplicate. See screenshot:
A screenshot of the Prevent Duplicate option on the Kutools tab in Excel

Some dialogs appear to remind you of certain notices. Click Yes > OK to close the dialogs.
A screenshot of dialog boxes for confirmation after applying Prevent Duplicate

Now, when you try to enter a value that already exists in the selected range, a warning dialog appears and prevents the duplicate entry.
A screenshot showing a warning dialog when attempting to enter duplicates

Here is another related utility called Prevent Typing. You can specify characters that users are not allowed to enter, or define characters that are allowed in the selected range, as shown below:
A screenshot of Prevent Typing settings for custom character restrictions

Kutools for Excel - Supercharge Excel with over 300 essential tools, making your work faster and easier, and take advantage of AI features for smarter data processing and productivity. Get It Now

Demo: Auto Remove Duplicates Entries using Kutools for Excel

 
Kutools for Excel: Over 300 handy tools at your fingertips! Enjoy AI-powered features for smarter and faster work! Download Now!

Best Office Productivity Tools

🤖Kutools AI Aide: Revolutionize data analysis based on: Intelligent Execution   |  Generate Code  |  Create Custom Formulas  |  Analyze Data and Generate Charts  |  Invoke Kutools Functions…
Popular Features: Find, Highlight or Identify Duplicates   |  Delete Blank Rows   |  Combine Columns or Cells without Losing Data   |  Round without Formula ...
Super Lookup: Multiple Criteria VLookup  |   Multiple Value VLookup  |   VLookup Across Multiple Sheets   |   Fuzzy Lookup ....
Advanced Drop-down List: Quickly Create Drop Down List   |  Dependent Drop Down List   |  Multi-select Drop Down List ....
Column Manager: Add a Specific Number of Columns  |  Move Columns  |  Toggle Visibility Status of Hidden Columns  |  Compare Ranges & Columns ...
Featured Features: Grid Focus   |  Design View   |  Big Formula Bar   |  Workbook & Sheet Manager   |  Resource Library (Auto Text)   |  Date Picker   |  Combine Worksheets   |  Encrypt/Decrypt Cells   |  Send Emails by List   |  Super Filter   |   Special Filter (filter bold/italic/strikethrough...) ...
Top 15 Toolsets:  12 Text Tools (Add Text, Remove Characters, ...)   |   50+ Chart Types (Gantt Chart, ...)   |   40+ Practical Formulas (Calculate age based on birthday, ...)   |   19 Insertion Tools (Insert QR Code, Insert Picture from Path, ...)   |   12 Conversion Tools (Numbers to Words, Currency Conversion, ...)   |   7 Merge & Split Tools (Advanced Combine Rows, Split Cells, ...)   |   ... and more
Use Kutools in your preferred language – supports English, Spanish, German, French, Chinese, and 40+ others!

Supercharge Your Excel Skills with Kutools for Excel, and Experience Efficiency Like Never Before. Kutools for Excel Offers Over 300 Advanced Features to Boost Productivity and Save Time.  Click Here to Get The Feature You Need The Most...


Office Tab Brings Tabbed interface to Office, and Make Your Work Much Easier

  • Enable tabbed editing and reading in Word, Excel, PowerPoint, Publisher, Access, Visio and Project.
  • Open and create multiple documents in new tabs of the same window, rather than in new windows.
  • Increases your productivity by 50%, and reduces hundreds of mouse clicks for you every day!

All Kutools add-ins. One installer

Kutools for Office suite bundles add-ins for Excel, Word, Outlook & PowerPoint plus Office Tab Pro, which is ideal for teams working across Office apps.

ExcelWordOutlookTabsPowerPoint
  • All-in-one suite — Excel, Word, Outlook & PowerPoint add-ins + Office Tab Pro
  • One installer, one license — set up in minutes (MSI-ready)
  • Works better together — streamlined productivity across Office apps
  • 30-day full-featured trial — no registration, no credit card
  • Best value — save vs buying individual add-in