Added duplicate detection changes