Results 1 to 5 of 5
  1. #1
    Join Date
    Nov 2004
    Posts
    51

    Unanswered: Tranferring data from SQL Server in incremental way

    Hi All
    I have this table which has about 30 thousand records

    I want to send all the records everyday at night to the other interface(TIBCO) in form of XML.

    I can send all the records at once or maybe 10 records at a time

    1. If I make one XML with all the records and send it, its risky as XML would be quite big, also it would be time consuming and would generate a big load on the program(.NET program will create XML). Also, any abnormal error would kill the whole process and we would have to start again

    2. Processing 10 or 20 records at a time and then sending the XML(with these 10 or 20 records) and doing this till all the records are sent. If there is any error in between in the program(.NET), the program can start from that step again. Now the problem is how I can keep track of the record number already sent to the other interface
    Can someone help?
    Thanks

  2. #2
    Join Date
    May 2004
    Location
    Seattle
    Posts
    1,313
    that sounds like a job for a super-programmer, way out of my league.


  3. #3
    Join Date
    Nov 2002
    Location
    Jersey
    Posts
    10,322
    Quote Originally Posted by jezemine
    that sounds like a job for a super-programmer, way out of my league.

    HEY!

    I was gonna post that (but thought better of it)


    Ummmm, just what the hell is TIBCO and how do you "talk" to it?
    Brett
    8-)

    It's a Great Day for America everybody!

    dbforums Yak CorralRadio 'Rita
    dbForums Member List
    I'm Good Once as I ever was

    The physical order of data in a database has no meaning.

  4. #4
    Join Date
    May 2004
    Location
    Seattle
    Posts
    1,313
    Quote Originally Posted by Brett Kaiser
    HEY!

    I was gonna post that (but thought better of it)
    we all envy your better-posting-judgement.


  5. #5
    Join Date
    Jan 2007
    Location
    UK
    Posts
    11,434
    Provided Answers: 10
    I think the answer might be something similar to the "checkbit" (and similar) transfer methods.
    Basically you send some information along with the packet and check the packet against the "checkbit". I suppose you can then send the checkbit back and... check it... If it's right then the packet sent correctly, if not, re-send.

    Wow, that's a confusing mess - have fun deciphering
    George
    Home | Blog

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •