Bug when dealing with very large files

Hello,

I find that when I use FlowHeater to transfer files with over 20,000,000 rows into SQL I always get an error message at the end:

“Execution Timeout Expired: The timeout period elapsed prior to completion of the operation or the server is not responding”

It appears that this message appears after the last row is inserted, so the operation is effectively finished, but instead of completing normally, FlowHeater generates this message..

Mike
Request received via Email

Hi Mike,

This error message is related to the FlowHeater standard settings for databases transaction. By default the database Adapters using one database transaction for the import process. This works for small data. For large data, the database server cannot handle such transaction in a certain timeframe and FlowHeater run into the defined command timeout!

You can change the default database transactions setting on the advanced tab into the adapter configurator.

In your case, you´ll get the best result with the following settings.
-> Use database transactions (YES)
-> Perform AutoCommit after 10.000 written records (YES)

Note: I do not recommend disabling database transaction because you will lose performance during the import process!

I guess these settings should solve your issue.

Yes that solved the problem. Thank you, Robert.