Results 1 to 6 of 6
  1. #1
    Join Date
    May 2010
    Posts
    2

    Cool Unanswered: [Query: Technical] DB2 9.1 bulk load

    Hi All,

    We have a project requirement to upload around 54 million records (available in the form of a csv file) into a DB2 table.
    The destination table is empty, has 37 columns (all simple data types no LOBs) and has no column constraints or composite keys.

    We tried this activity with the import/load command, but it took us around 6 hrs to load 4 million records! DB2 Data studio did not help us as well.

    Can someone please let us know of any easier/faster method to bulk load such a large volume of data in DB2.

    Thanks
    Chandra.

  2. #2
    Join Date
    Jun 2007
    Location
    germany
    Posts
    155
    buy more iron.
    Dick Brenholtz, Ami in Deutschland

  3. #3
    Join Date
    May 2010
    Posts
    2

    [Query: Technical] DB2 9.1 bulk load

    Mate,

    u got to be kidding me to have posted such a humorous reply..

    jokes apart..

    can u pls provide me with some really technical solution, as we need to find a way to get this Bulk load thing completed at the earliest?

    Cheers
    Chandra.

  4. #4
    Join Date
    Jun 2007
    Location
    germany
    Posts
    155
    what is the 'purest' input format for data to the load utility?

    a csv file will work,
    but does the utility have to perform some kind of 'reformatting'
    before the actual loading to the tables takes place?

    apparently this is a 'one-off' exercise.
    either bite the bullet and do the load as is
    or
    'normalize' your csv file to a type that requires no formatting by the utility - which will also take time - but may make the load process run faster.
    Dick Brenholtz, Ami in Deutschland

  5. #5
    Join Date
    Nov 2005
    Location
    IL
    Posts
    557
    Are you sure you are using LOAD? I have never seen it take that long to load that few records. Post your command.
    --
    IBM Certified DBA on DB2 for Linux, UNIX, and Windows

    DB2 v9.7.0.6 os 6.1.0.0

  6. #6
    Join Date
    Jan 2009
    Location
    Zoetermeer, Holland
    Posts
    746
    Look at the disk-layout and tablespaces. No SMS I hope? No raid5 I hope? You need the best write-performance and DMS tablespaces already in the right size and spread over as many disks as possible. And "util_heap_sz " max.size?

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •