Newbie Question - More advanced than me....?

I have a big CSV file (1.2MM lines, 385MB in size) containing 42 fields, lines can be in excess of 1,000 chars/line.
Of those 42 fields...

a. I have 4 date fields in... "yyyymmdd" format that I want to put in "mmddyyyy" format
b. I have 26 fields that may have a trailing negative field "123-" that I want to format as "-123

I presume that the Heaters can handle such transformations, am I correct? Which are the best
to use to make these transformations? I do not mind going from CSV to CSV if I need to, but the
ultimate solution is to get the O/P as a SQLite file if I can make a single transformation.

Any help or guidance would be most appreciated, the project was supposed to be done days ago
and life has simply got in the way as usual.

Hi Keith,

For this you do not need any Function/Heater . You just have to use the “magic” automatically type transformation.

How to configure this:
Open the TextFile Apdater on the READ side and swich to the tab “Format”. Apply the format settings you expect on the READ side for data type Date and Number fields. After that you have to change for the certain fields the data type from default data type “STRING” to “DATE” or “NUMBER” (Decimal). Just switch to the tab “Fields / Data types” mark one field and select the desired type. This you have to do with all field you would like to transform.

Close this and open the TextFile Apdater or even the SQLite Adapter on the WRITE side. Switch to the “Format” tab and apply your desired format setting you wants to export to CSV or import into the SQLite database. On the WRITE you can use the default data type “STRING”, only in special case you have to change here some data types.

That’s all. Youl find a short example of this magic format transformation attached.

WOW, Robert

Thank-you... within 30 minutes of configuring & doing some test runs, I was ready to rip the entire file (1.2 million lines) and 12 minutes later I had a patched file !!! Fantastic !!! FlowHeater just won a much higher position in my toolbox ! Thanx !! Keith