- Posts: 2
SAVE SELECTED DATA TO NEW TABLE BEFORE UPDATE
- Frank Murphy
- Topic Author
- Offline
- User
Less
More
5 years 8 months ago #3506
by Frank Murphy
SAVE SELECTED DATA TO NEW TABLE BEFORE UPDATE - Post(3506) was created by Frank Murphy
We use our licensed Flowheater Designer very successfully on a daily basis to insertinto and update our database (currently 5.1 million plus rows).The updates are transaction driven and in two of these - NAMECHANGES and ADDRESS CHANGES – it would be very useful to be able to capture the
old data in two other tables immediately before the insert process. Is this possible with Flowheater and, if so, whatwould be the recommended approach? Volumes are modest (Names about 300 daily and Addresses 3,000 daily outof total update rows of 60K – 100K) so using LOOKUP seems like a sledgehammer
to open a nut; the input source is Excel (where we refine the raw input ready
for insert).Were we doing this work manually from the front end, then forNAMES CHANGES we would be using something along the lines of
$tblEvents = $dal->Table("Old_Name"); Thistable would have new Auto Increment PRIMARY KEY
$tblEvents->Value["Comp_Number"]=$oldvalues["Comp_Number"];(VARCHAR and original table PRIMARY KEY)
$tblEvents->Value["Comp_Name"]=$oldvalues["Comp_Name"];(VARCHAR)
$tblEvents->Value["Postcode"]=$oldvalues["Postcode"];
$tblEvents->Add();
but manual process times prevent this. The ADDRESS CHANGES has more fields but isthe principles are identical.
old data in two other tables immediately before the insert process. Is this possible with Flowheater and, if so, whatwould be the recommended approach? Volumes are modest (Names about 300 daily and Addresses 3,000 daily outof total update rows of 60K – 100K) so using LOOKUP seems like a sledgehammer
to open a nut; the input source is Excel (where we refine the raw input ready
for insert).Were we doing this work manually from the front end, then forNAMES CHANGES we would be using something along the lines of
$tblEvents = $dal->Table("Old_Name"); Thistable would have new Auto Increment PRIMARY KEY
$tblEvents->Value["Comp_Number"]=$oldvalues["Comp_Number"];(VARCHAR and original table PRIMARY KEY)
$tblEvents->Value["Comp_Name"]=$oldvalues["Comp_Name"];(VARCHAR)
$tblEvents->Value["Postcode"]=$oldvalues["Postcode"];
$tblEvents->Add();
but manual process times prevent this. The ADDRESS CHANGES has more fields but isthe principles are identical.
Please Log in or Create an account to join the conversation.
- FlowHeater-Team
- Offline
- Admin
5 years 8 months ago #3507
by FlowHeater-Team
Best wishes
Robert Stark
Replied by FlowHeater-Team on topic SAVE SELECTED DATA TO NEW TABLE BEFORE UPDATE - Post(3507)
Hi Frank,
Two solution are possible.
Fast solution)
In case of your database supports database triggers, you could define a “before update trigger”. In this trigger function, you copy the current content to another table before FlowHeater overrides this data with the new data.
Slow solution, with FlowHeater)
Because FlowHeater does not read the content of the current record before updating, you have the read the desired content in separate or tow processing step and check whether update or insert needed for this record.
Step 1) Read just the primary keys of your import/update source into a InMemory table .
Step 2) Read the Table content you wants to update and check whether the primary key exit in the InMemory table . For this you have can use the SQL , Lookup or the String Replace Heater . Note this check is very fast! In case, the primary key doesn´t exits just filter out this record. In case you have a match write/insert the desired content into your new table.
Step 3) Update your content as usual
Two solution are possible.
Fast solution)
In case of your database supports database triggers, you could define a “before update trigger”. In this trigger function, you copy the current content to another table before FlowHeater overrides this data with the new data.
Slow solution, with FlowHeater)
Because FlowHeater does not read the content of the current record before updating, you have the read the desired content in separate or tow processing step and check whether update or insert needed for this record.
Step 1) Read just the primary keys of your import/update source into a InMemory table .
Step 2) Read the Table content you wants to update and check whether the primary key exit in the InMemory table . For this you have can use the SQL , Lookup or the String Replace Heater . Note this check is very fast! In case, the primary key doesn´t exits just filter out this record. In case you have a match write/insert the desired content into your new table.
Step 3) Update your content as usual
Best wishes
Robert Stark
Please Log in or Create an account to join the conversation.
- Frank Murphy
- Topic Author
- Offline
- User
Less
More
- Posts: 2
5 years 8 months ago #3508
by Frank Murphy
Replied by Frank Murphy on topic SAVE SELECTED DATA TO NEW TABLE BEFORE UPDATE - Post(3508)
Many thanks for your thoughts which are very helpful. Our preferred route is to use FlowHeater to we will set up and try the Slow solution when time permits later this month. We will let you know how it works out.
Thanks again for your help.
Thanks again for your help.
Please Log in or Create an account to join the conversation.
Time to create page: 0.264 seconds