In Datastage, duplicates can be removed using the four ways:

  • Through the Duplicate Removal Stage
  • Using the Hash File Stage.
  • Using a sort stage and setting ALLOW DUPLICATES: false
  • It can be done at any stage by doing a hash portion of the input data and checking options under Sort and Unique.
BY Best Interview Question ON 06 Jun 2020