- Posts: 27
Exclude the last row from the processing
- Gennaro
- Topic Author
- Offline
- User
Less
More
12 years 6 months ago #2233
by Gennaro
Exclude the last row from the processing - Post(2233) was created by Gennaro
Hi,
how can I exclude the last row (of a text file) from the flowheater 'read side' processing?
thanks
how can I exclude the last row (of a text file) from the flowheater 'read side' processing?
thanks
Please Log in or Create an account to join the conversation.
- FlowHeater-Team
- Offline
- Admin
12 years 6 months ago #2234
by FlowHeater-Team
Best wishes
Robert Stark
Replied by FlowHeater-Team on topic Re:Exclude the last row from the processing - Post(2234)
Hi Gennaro,
There are two possible ways. For these two ways I’ve made two examples, please have a look to the attachment.
Solution 1) Filters all lines they are match the condition, not only the last line. But this solution can work with a lot of data.
Solution 2) Filters only the last x Line(s). But this solution can only work with small text (CSV) files. Maximum about 50-200 MB, depends on your hardware.
There are two possible ways. For these two ways I’ve made two examples, please have a look to the attachment.
- You filter these row(s) on the basis of one or more field content. If Field1 = abc and Field2 = xyz then this row can be filtered. In most cases this works, but in some cases you can’t find proper conditions.
- You count the available lines with the .NET Script Heater before the definition start. The Script in the .NET Script Heater opens the csv text flle and read all lines in memory and count the available lines. After that the available lines will be stored in the FlowHeater Parameter "LineInFile". This parameter in combination with the AutoID Heater is the filter condition of the Filter Heater. If AutoID Value >= $LineInFile$ then filter this line!
Solution 1) Filters all lines they are match the condition, not only the last line. But this solution can work with a lot of data.
Solution 2) Filters only the last x Line(s). But this solution can only work with small text (CSV) files. Maximum about 50-200 MB, depends on your hardware.
Attachment filter_last_csv_lines.zip not found
Best wishes
Robert Stark
Attachments:
Please Log in or Create an account to join the conversation.
Time to create page: 0.248 seconds