Empno(p.key) country Emporg currenttimestamp Targettimestamp
My problem is In my source table I have 10000 records. While I run the job(ETL),out of 10000 records only 4000 records are Inserted into the target table. If I run the job again, I need to run the job from 4001 onwards not from the begining.
I have made the design in my job(ETL.datastage). But architect he wants that I need to execute this logic in sql.
I don't have idea how to do this?. Any help would be really appreciated.
how are you loading the data into the table? Are you using LOAD INTO? If yes, then have a look at the IGNORE number LINES option but as Rudy has said you should focus your efforts on fixing the ETL job.