Dynamic data import / export


simply more productive
Up to 10,000 records can be processed with the freeware version!
Welcome, Guest
Username: Password: Remember me
Welcome to the FlowHeater support forum.

Questions about using FlowHeater are answered here.

TOPIC: Exclude the last row from the processing

Exclude the last row from the processing 4 years 5 months ago #2233

  • Gennaro
  • Gennaro's Avatar
  • Offline
  • Junior Member
  • Posts: 25
how can I exclude the last row (of a text file) from the flowheater 'read side' processing?

The administrator has disabled public write access.

Re:Exclude the last row from the processing 4 years 5 months ago #2234

  • FlowHeater-Team
  • FlowHeater-Team's Avatar
  • Offline
  • Administrator
  • Posts: 240
Hi Gennaro,

There are two possible ways. For these two ways I’ve made two examples, please have a look to the attachment.
  1. You filter these row(s) on the basis of one or more field content. If Field1 = abc and Field2 = xyz then this row can be filtered. In most cases this works, but in some cases you can’t find proper conditions.
  2. You count the available lines with the .NET Script Heater before the definition start. The Script in the .NET Script Heater opens the csv text flle and read all lines in memory and count the available lines. After that the available lines will be stored in the FlowHeater Parameter "LineInFile". This parameter in combination with the AutoID Heater is the filter condition of the Filter Heater. If AutoID Value >= $LineInFile$ then filter this line!
Solution 1) Filters all lines they are match the condition, not only the last line. But this solution can work with a lot of data.
Solution 2) Filters only the last x Line(s). But this solution can only work with small text (CSV) files. Maximum about 50-200 MB, depends on your hardware.

Attachment filter_last_csv_lines.zip not found

Best wishes
Robert Stark

Did this answer your question? We would be grateful if you provide a brief comment as feedback. It may also help others who may have encountered a similar problem.
The administrator has disabled public write access.
Moderators: FlowHeater-Team
Time to create page: 0.071 seconds