Skip to main content
simply more productive

The Data Specialist

Thanks to our intuitive transformation designer, you can convert data effortlessly to a variety of formats without knowing how to program. It’s not only efficient, it’s also easy to use.
Up to 100,000 records can be processed with the freeware version!
Flowheater Chart

Ignore duplicate line(s) of data

More
6 years 1 month ago #3492 by JD Cox
One of our customer’s system is mysteriously duplicating lines in some orders.  Their IT department is trying to find solution. But, until they do they’ve reached out to me and ask that we ignore duplicates in the order file.  I’m trying to create a .NET to identify the duplicates and change the item to ‘xxxx’ so I can filter it on the other side.  But, I’m not having any success.  Ignoring it in the .NET script would be even better.  In the attached file there are three orders with two lines each.  I want to ignore the second line for order B456.
As always, thanks for the help.
Attachments:

Please Log in or Create an account to join the conversation.

More
6 years 1 month ago #3493 by JD Cox
Well...I never thought of using GroupBy.  I use it all the time to combine duplicates and sum the quantities.
I guess I was over thinking it.  Thanks, I got it.

Please Log in or Create an account to join the conversation.

More
6 years 1 month ago #3494 by FlowHeater-Team
Replied by FlowHeater-Team on topic Ignore duplicate line(s) of data - Post(3494)
Just for your information. A better way to filter duplicate lines/contentis to use the Filter Heater with the enabled option “Filter duplicates out”, like the screenshot below.

Note: To use the GroupBy Heater for filtering duplicate line just working when the input stream is sorted based on the grouped field!
 

Best wishes
Robert Stark

Please Log in or Create an account to join the conversation.

More
6 years 1 month ago #3495 by JD Cox
Thanks Robert,

That is a better option and clears up the line count issue I was having with the GroupBy.

JD

Please Log in or Create an account to join the conversation.

Time to create page: 0.272 seconds
FlowHeater Logo

FlowHeater - The Data Specialist

Efficient data integration and transformation with FlowHeater – the perfect solution for a seamless transfer of your data.

Legal information

Support & Contact

Contact

Phone:
0951 / 9933 9792

eMail:
This email address is being protected from spambots. You need JavaScript enabled to view it.


Copyright © 2009-2025 by FlowHeater GmbH. All rights reserved.