If this is your first visit, be sure to check out the FAQ by clicking the link above. You may have to register before you can post: click the register link above to proceed. To start viewing messages, select the forum that you want to visit from the selection below.

 
Go Back  dBforums > General > Database Concepts & Design > Looking for alternate data transfer method

Reply
 
LinkBack Thread Tools Search this Thread Display Modes
  #1 (permalink)  
Old 08-10-09, 11:15
earthdog earthdog is offline
Registered User
 
Join Date: Nov 2007
Posts: 5
Looking for alternate data transfer method

Hi All!

the case:

-4 DB2/400 systems in 4 countries.

the need:

-Build a centralised DW having all the details of the tables.

the target:

-DW in MS SQL2008, and the tool is COGNOS 8.4

the problem:

-SSIS speeds with the MS OLE DB provider (which the fastest among ibm ole db and odbc) are not acceptable, although it is not a problem of SSIS but the VPNs'

the solution:

ALTERNATE METHOD of getting the data...

I am open to ideas...

thanks

Elias
Reply With Quote
  #2 (permalink)  
Old 08-10-09, 12:10
gvee gvee is offline
www.gvee.co.uk
 
Join Date: Jan 2007
Location: UK
Posts: 10,156
If DB2 can export to CSV then that's the route I would go down next.
BCP in SQL Server is very powerful (and fast!).

Alternatively - have you got the quick load option turned on in SSIS? This can dramatically increase performance.
__________________
George
Twitter | Blog
Reply With Quote
  #3 (permalink)  
Old 08-10-09, 12:11
dportas dportas is offline
Registered User
 
Join Date: Dec 2007
Location: London, UK
Posts: 732
You could use an integration tool with native DB2 connectivity (IBM DataStage for example?)

Or you could extract to an intermediate file first and transfer that to Windows. SSIS has support for converting EBCDIC and packed decimal data from a file.

You might get more help in the DB2 forum.
Reply With Quote
  #4 (permalink)  
Old 08-10-09, 12:38
earthdog earthdog is offline
Registered User
 
Join Date: Nov 2007
Posts: 5
thanks guys!!

The process that i am thinking is
-transfer the data to intermeddiate files (csv?)
-Zip them
-transfer them from remote to local (ftp?
-use SSIS to get the csvs' from zipped files to sql server 2008

the problem is that i dont quite know how to do the first steps..So i suppose i 'll check in db2 forum

Elias
Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On