Purpose
Filter records from the input data source.
Category Location: All, Frequently used, Other/ Utility
Field Description
- Filter Input: If you set a filter on this task using the Filter Input option, remember that the filter will be applied throughout any tasks in the job after this task. This template is unique in that the filter applied in this section means that any records meeting that filter criteria will flow through the rest of the job. *When this option is used in other tasks, the filter is only applied to that specific task*
- Prioritize records to filter: select this checkbox to prioritize records
- Attribute to use for prioritization: select the attribute to use for the prioritization criteria (only date and real/whole number may be used)
- Sorting order of the prioritization attribute: Options are ascending or descending.
- Total number of records to process: Set the total number of records you'd like to process.
NOTE:
- For subsequent runs where purge and run is NOT used, record counts in the job/task output may differ from the number of records set and the task will prioritize new records from the input data source over existing updated records. It is recommended that you use the purge and run option to ensure consistent record counts and processing.
Tips
- This task is handy to employ when developing your job. By limiting the number of records from your input data source, your job can process the filtered records faster than if you run the job against the entire data source. Once your job logic has been verified, you can either remove the filter task, or change the filter so your entire data source is processed in subsequent runs.
Examples
- Filter Marketo or Salesforce leads by email begins with "a".