Flowheater not processing all the data within a database

Hi
I have a very simple extraction that reads a table omitting items where a field equals a "C" using a SQL Select on the Input Side.
It's been running fine but yesterday when I ran it it stopped processing items after a certain number of records within the table.
There are 12245 records in the table. The extract stops after record 12223 and wont process any more records even though there are valid records after that record..
The output windows says it's processed 9752 records.

Any help gratefully received.

System wouldn't allow me to upload the FHD - got an error

Hi Ken,

Are you sure that your where clause "... where field = 'C' ..." does not filter the desired result?

The issue related to the attachments has been fixed. Thanks for your notification. Could you please post a screenshot and or your created FlowHeater definition for further analysis, Thanks.
 

Hello Robert - FHD Uploaded . Screenshots of 1) The Access Table Data, 2) the SQL Statement from the FHD and 3) The output and where it stops.

This FHD hasn't been changed since May 2017 and has been running successfully on a twice monthly basis ever since.

Hi Ken,
This sounds suspect

I´ve modified your Definition. Please try to run this one and post the last lines.

Perhaps an Index or something else is corrupt. Please try to compact and repair your Access database.

 
 

Good morning Robert

Test output attached and it read all records

Rgds
Ken

Hi Ken,

for me everything looks fine  You just expect that your data are ordered?

I guess in case you change your READ SQL with an “Order By” clause like the below listed example your export should work like expected 😊

       select * from [Job] where type <> 'C' order by Job_id
 

That is really strange but thank you. Each entry in Job_id is an auto-increment and I can't see any anomalies in the data.
Adding the sort order to the SQL statement seems to have fixed it as the output is now everything as I would expect (excluding the "C" items)

If I ever wanted to limit the range of Job_id what would I do?
I tried to add a filter and an if-then-else to drop anything less than 8000 but it failed to output anything.

Ken Starnes wrote:

If I ever wanted to limit the range of Job_id what would I do?
I tried to add a filter and an if-then-else to drop anything less than 8000 but it failed to output anything.

 

When I say it fails to output anything what I really mean is that it doesn't output the Job_id field I just get a Zero.
Do I need something like the Clone Heater and how do I get that to work with the IF. I can't work out how to get a then or an else.

Hi Ken,

To filter data, you could extend your SELECT on the READ side like this

        select * from [Job] where type <> 'C' and Job_id >= 8000 order by Job_id

or you could use the IF-THEN-ELSE Heater together with the Filter Heater . You´ll find a simple example attached.

 

 
 

Thank you Robert - I can see where I was going wrong now and thanks for the advice on the SQL statement - didn't think of that as I so rarely use it.