Okuzeka
Data Science & Analytics vocabulary · Data Collection and Cleaning

Duplicate

Meaning in data science & analytics, with examples

/ˈduːplɪkət/nounCore term

In data science & analytics, duplicate means: A record that appears more than once in a dataset, for example the same customer or order stored twice, which can make counts and totals too high.

In Turkish: mükerrer kayıt, tekrarlanan kayıt, kopya kayıt

How it is used

You find, check for or remove duplicates; the process is called deduplication, often shortened to 'dedupe'. Also used as an adjective ('duplicate rows') and a verb ('the join duplicated the orders').

Example sentences

  1. Revenue looked too high because the table had duplicates for every refunded order.

  2. Always check for duplicates after a join.

Common collocations

  • remove duplicates
  • check for duplicates
  • duplicate rows
  • duplicate records
  • data cleaningThe process of finding and fixing problems in data, such as wrong formats, typos, duplicates and missing values, so that it can be trusted for analysis.
  • data qualityHow accurate, complete, consistent and up to date data is, and therefore how far it can be trusted when people make decisions.
  • joinAn operation that combines rows from two or more tables using a shared column, such as a customer ID; as a verb, to combine tables in this way.
  • primary keyA column, or a set of columns, whose value is unique for every row in a table and is used to identify each row, such as an order ID.

This word in other fields

The same English word can have a different meaning in another field:

More terms: Data Collection and Cleaning

Practise with graded reading

Reading at the right level is the fastest way to make new words stick. Pick free English books by level: