Skip to main content
simply more productive

The Data Specialist

Thanks to our intuitive transformation designer, you can convert data effortlessly to a variety of formats without knowing how to program. It’s not only efficient, it’s also easy to use.
Flowheater Chart

Ignore duplicate line(s) of data

More
5 years 11 months ago #3492 by JD Cox
Ignore duplicate line(s) of data was created by JD Cox
One of our customer’s system is mysteriously duplicating lines in some orders.  Their IT department is trying to find solution. But, until they do they’ve reached out to me and ask that we ignore duplicates in the order file.  I’m trying to create a .NET to identify the duplicates and change the item to ‘xxxx’ so I can filter it on the other side.  But, I’m not having any success.  Ignoring it in the .NET script would be even better.  In the attached file there are three orders with two lines each.  I want to ignore the second line for order B456.
As always, thanks for the help.
Attachments:

Please Log in or Create an account to join the conversation.

More
5 years 11 months ago #3493 by JD Cox
Replied by JD Cox on topic Ignore duplicate line(s) of data
Well...I never thought of using GroupBy.  I use it all the time to combine duplicates and sum the quantities.
I guess I was over thinking it.  Thanks, I got it.

Please Log in or Create an account to join the conversation.

More
5 years 11 months ago #3494 by FlowHeater-Team
Replied by FlowHeater-Team on topic Ignore duplicate line(s) of data
Just for your information. A better way to filter duplicate lines/contentis to use the Filter Heater with the enabled option “Filter duplicates out”, like the screenshot below.

Note: To use the GroupBy Heater for filtering duplicate line just working when the input stream is sorted based on the grouped field!
 

Best wishes
Robert Stark

Did this answer your question? We would be grateful if you provide a brief comment as feedback. It may also help others who may have encountered a similar problem.

Please Log in or Create an account to join the conversation.

More
5 years 11 months ago #3495 by JD Cox
Replied by JD Cox on topic Ignore duplicate line(s) of data
Thanks Robert,

That is a better option and clears up the line count issue I was having with the GroupBy.

JD

Please Log in or Create an account to join the conversation.

Time to create page: 0.275 seconds
FlowHeater Logo

FlowHeater - The Data Specialist

Efficient data integration and transformation with FlowHeater – the perfect solution for a seamless transfer of your data.

Legal information

Support & Contact

Contact

Phone:
0951 / 9933 9792

eMail:
This email address is being protected from spambots. You need JavaScript enabled to view it.


Copyright © 2009-2024 by FlowHeater GmbH. All rights reserved.