Hi All,

This is my first thread in this forum.

My source table name is Emp and Target table name is Emp_Org.

Given below is the structure of the source table

Empno(p.key) deptno(p.key) empname currenttimestamp

Target Table MetaData.

Empno(p.key) country Emporg currenttimestamp Targettimestamp

My problem is In my source table I have 10000 records. While I run the job(ETL),out of 10000 records only 4000 records are Inserted into the target table. If I run the job again, I need to run the job from 4001 onwards not from the begining.

I have made the design in my job(ETL.datastage). But architect he wants that I need to execute this logic in sql.

I don't have idea how to do this?. Any help would be really appreciated.

sounds like this is the problem right here

fix your ETL job

Hi,

how are you loading the data into the table? Are you using LOAD INTO? If yes, then have a look at the IGNORE number LINES option but as Rudy has said you should focus your efforts on fixing the ETL job.