Purpose
Remove any duplicate values within any string attribute.
Category Location: All, Clean or normalize
Field Description
- Source attribute: Select the attribute to find duplicate values.
- Write to: Select or create the attribute to house the unique values.
- Delimiter: Define a delimiter to parse a single-value string.
- Ignore case sensitive: Check this box to ignore case sensitive matching.
Tips
- If there are multiple values that are the same within a single-value string attribute, you can define a delimiter to be used to parse the single-value string.
Examples
- If a string attribute has "Item 1, Item 1, Item 2, Item 2", use this task with comma as delimiter to find the duplicated entries and derive the result "Item 1, Item 2".