Filter Heater, filtering data during the transformation
Using the Filter Heater you can actively intervene in the import/export process. There are two different ways to filter data available:
By an IF-THEN-ELSE condition) In this case the Filter Heater expects the result of an IF-THEN-ELSE Heater. If the condition defined there is met (YES / TRUE) the current record or line is filtered out. When the condition is not met (NO / FALSE) the current record continues to be processed.
Filter duplicates out) This option enables you to exclude repeated records in the data source. There is no need to sort the incoming data for this. In order to discriminate whether a record is a duplicate, you must connect the READ fields with the Filter Heater to identify the data record uniquely. Several fields given as input will combine to form a Unique Key.
Effective for) When more than one Adapter is included on the WRITE side of the current processing step, this option can be used to select one Adapter for which the records are to be filtered or skipped. The default setting is to filter all Adapters included. However, if a specific Adapter is selected, the records are only filtered or skipped in this Adapter.
Note: If you wish to filter the records of more than one Adapter, but not all the included Adapters, you must use multiple instances of the Filter Heater to individually select those required.
Please also refer to the general information on the use of Heaters (functions)