Skip to main content
simply more productive

The Data Specialist

Thanks to our intuitive transformation designer, you can convert data effortlessly to a variety of formats without knowing how to program. It’s not only efficient, it’s also easy to use.
Flowheater Download

Newbie Question - More advanced than me....?

  • Keith Weatherhead
  • Topic Author
  • Offline
  • User
  • User
More
5 years 7 months ago #3460 by Keith Weatherhead
Newbie Question - More advanced than me....? was created by Keith Weatherhead
I have a big CSV file (1.2MM lines, 385MB in size) containing 42 fields, lines can be in excess of 1,000 chars/line.
Of those 42 fields...

a. I have 4 date fields in... "yyyymmdd" format that I want to put in "mmddyyyy" format
b. I have 26 fields that may have a trailing negative field "123-" that I want to format as "-123

I presume that the Heaters can handle such transformations, am I correct? Which are the best
to use to make these transformations? I do not mind going from CSV to CSV if I need to, but the
ultimate solution is to get the O/P as a SQLite file if I can make a single transformation.

Any help or guidance would be most appreciated, the project was supposed to be done days ago
and life has simply got in the way as usual.

Please Log in to join the conversation.

More
5 years 7 months ago #3461 by FlowHeater-Team
Replied by FlowHeater-Team on topic Newbie Question - More advanced than me....?
Hi Keith,

For this you do not need any Function/Heater . You just have to use the “magic” automatically type transformation.

How to configure this:
Open the TextFile Apdater on the READ side and swich to the tab “Format”. Apply the format settings you expect on the READ side for data type Date and Number fields. After that you have to change for the certain fields the data type from default data type “STRING” to “DATE” or “NUMBER” (Decimal). Just switch to the tab “Fields / Data types” mark one field and select the desired type. This you have to do with all field you would like to transform.

Close this and open the TextFile Apdater or even the SQLite Adapter on the WRITE side. Switch to the “Format” tab and apply your desired format setting you wants to export to CSV or import into the SQLite database. On the WRITE you can use the default data type “STRING”, only in special case you have to change here some data types.

That’s all. Youl find a short example of this magic format transformation attached.









File Attachment:

File Name: type-trans...tion.zip
File Size:2 KB

Best wishes
Robert Stark

Did this answer your question? We would be grateful if you provide a brief comment as feedback. It may also help others who may have encountered a similar problem.

Please Log in to join the conversation.

  • Keith Weatherhead
  • Topic Author
  • Offline
  • User
  • User
More
5 years 7 months ago #3462 by Keith Weatherhead
Replied by Keith Weatherhead on topic Newbie Question - More advanced than me....?
WOW, Robert

Thank-you... within 30 minutes of configuring & doing some test runs, I was ready to rip the entire file (1.2 million lines) and 12 minutes later I had a patched file !!! Fantastic !!! FlowHeater just won a much higher position in my toolbox ! Thanx !! Keith

Please Log in to join the conversation.

Time to create page: 0.337 seconds

FlowHeater - The Data Specialist

Efficient data integration and transformation with FlowHeater – the perfect solution for a seamless transfer of your data.

Rechtliches

Support & Contact

Kontaktinformation

Telefon:0951 / 99339792 E-Mail:This email address is being protected from spambots. You need JavaScript enabled to view it.

Copyright © 2009-2024 by FlowHeater GmbH. All rights reserved.