Filter Heater, filtering data during the transformation
Using the Filter Heater you can actively intervene in the import/export process. There are two different ways to filter data available:
By an IF-THEN-ELSE condition) In this case the Filter Heater expects the result of an IF-THEN-ELSE Heater. If the condition defined there is met (YES / TRUE) the current record or line is filtered out. When the condition is not met (NO / FALSE) the current record continues to be processed.
Filter duplicates out) This option enables you to exclude repeated records in the data source. There is no need to sort the incoming data for this. In order to discriminate whether a record is a duplicate, you must connect the READ fields with the Filter Heater to identify the data record uniquely. Several fields given as input will combine to form a Unique Key.