Dynamic data import / export


simply more productive
Up to 100,000 records can be processed with the freeware version!
Welcome, Guest
Username: Password: Remember me
Welcome to the FlowHeater support forum.

Questions about using FlowHeater are answered here.
  • Page:
  • 1

TOPIC: Exclude the last row from the processing

Exclude the last row from the processing 5 years 2 weeks ago #2233

  • Gennaro
  • Gennaro's Avatar Topic Author
  • Offline
  • Junior Member
  • Junior Member
  • Posts: 25
how can I exclude the last row (of a text file) from the flowheater 'read side' processing?


Please Log in or Create an account to join the conversation.

Re:Exclude the last row from the processing 5 years 1 week ago #2234

  • FlowHeater-Team
  • FlowHeater-Team's Avatar
  • Offline
  • Administrator
  • Administrator
  • Posts: 265
Hi Gennaro,

There are two possible ways. For these two ways I’ve made two examples, please have a look to the attachment.
  1. You filter these row(s) on the basis of one or more field content. If Field1 = abc and Field2 = xyz then this row can be filtered. In most cases this works, but in some cases you can’t find proper conditions.
  2. You count the available lines with the .NET Script Heater before the definition start. The Script in the .NET Script Heater opens the csv text flle and read all lines in memory and count the available lines. After that the available lines will be stored in the FlowHeater Parameter "LineInFile". This parameter in combination with the AutoID Heater is the filter condition of the Filter Heater. If AutoID Value >= $LineInFile$ then filter this line!
Solution 1) Filters all lines they are match the condition, not only the last line. But this solution can work with a lot of data.
Solution 2) Filters only the last x Line(s). But this solution can only work with small text (CSV) files. Maximum about 50-200 MB, depends on your hardware.

Attachment filter_last_csv_lines.zip not found


Please Log in or Create an account to join the conversation.

Best wishes
Robert Stark

Did this answer your question? We would be grateful if you provide a brief comment as feedback. It may also help others who may have encountered a similar problem.
  • Page:
  • 1
Moderators: FlowHeater-Team
Time to create page: 0.083 seconds