If this is your first visit, be sure to check out the FAQ by clicking the link above. You may have to register before you can post: click the register link above to proceed. To start viewing messages, select the forum that you want to visit from the selection below.

 
Go Back  dBforums > Database Server Software > DB2 > db2 9.7 - Bulk data load consideration

Reply
 
LinkBack Thread Tools Search this Thread Display Modes
  #1 (permalink)  
Old 09-27-11, 17:32
dgunas dgunas is offline
Registered User
 
Join Date: Dec 2008
Location: Chennai
Posts: 110
db2 9.7 - Bulk data load consideration

DB2 9.7 FP 3a /Win 2008 R2

our DB size is around 550GB, contain around 25 tables and around 100 indexes.
each table contains average 60 million rows.
This is a HADR enviornment, the system daily produces around 50 transaction logs each 10MB size.
Daily we load data into the DB , around 15K rows (include image -each image 2-4 KB size)

I am going to do a bulk load (which will effect most tables) and expecting around 250,000 rows including images .

The question is :--
1. How can I workout that howmany transaction logs will be produced during the load
2. As this is a HADR enviornment, will this effect log shipping? bandwidth is enouth?
(current banwidth is 4mbps between primary and standby).
3. Update Statistics is required immediatley?

4. Also any other concern?

Please advise.
Thanks, valan
__________________
Reply With Quote
  #2 (permalink)  
Old 09-28-11, 12:34
dgunas dgunas is offline
Registered User
 
Join Date: Dec 2008
Location: Chennai
Posts: 110
hi,
anyone can give some ideas please?

Also, i mentioned the bulkload. but i am not going to use the import or LOAD.
going to use the standard insert statement.

Thx.
__________________
Reply With Quote
  #3 (permalink)  
Old 09-28-11, 13:05
ARWinner ARWinner is offline
Registered User
 
Join Date: Jan 2003
Posts: 3,575
1) We cannot give you a specific amount. There are a lot of things that determine how many log files will be generated. I suggest you test it out in a test environment and see.

2) Of course it will affect log shipping. You are adding work load to the system. Whether the bandwidth is enough depends on the outcome of how many log files are being created.

3) You are adding less than 0.5% rows each time. Stats may not be needed each time the bulk load is performed. It depends on the kind of data you are loading.

Andy
Reply With Quote
  #4 (permalink)  
Old 09-28-11, 15:40
dgunas dgunas is offline
Registered User
 
Join Date: Dec 2008
Location: Chennai
Posts: 110
Thanks Andy.
I can not try this on the test system as the DB is very small and not enough space.

Is it advisable to suspend the HADR (Deactivate the DB on standby node), once the load has been completed then resume the HADR?
__________________
Reply With Quote
  #5 (permalink)  
Old 09-28-11, 16:38
ARWinner ARWinner is offline
Registered User
 
Join Date: Jan 2003
Posts: 3,575
I do not think so. But I am no expert on HADR.

Andy
Reply With Quote
  #6 (permalink)  
Old 09-28-11, 21:59
Marcus_A Marcus_A is offline
Registered User
 
Join Date: May 2003
Location: USA
Posts: 5,196
I don't think you need to worry about HADR if you are only inserting 250,000 rows, assuming your log buffer is set correctly. But I am not sure what you mean by bulk load.

You should be able to test this on some system using a subset of the rows, and extrapolate to a larger number of rows.
__________________
M. A. Feldman
IBM Certified DBA on DB2 for Linux, UNIX, and Windows
IBM Certified DBA on DB2 for z/OS and OS/390
Reply With Quote
  #7 (permalink)  
Old 09-29-11, 06:37
dr_te_z dr_te_z is offline
Registered User
 
Join Date: Jan 2009
Location: Zoetermeer, Holland
Posts: 555
Quote:
Originally Posted by dgunas View Post
Is it advisable to suspend the HADR (Deactivate the DB on standby node), once the load has been completed then resume the HADR?
Is the bulk running during downtime or not? If it is not in downtime you must not deactivate your HADR either. You have HADR to guarantee db-uptime so why take extra risks.
On the other hand: when you do run during downtime, why use INSERT's? LOAD's are much faster....
Reply With Quote
  #8 (permalink)  
Old 09-29-11, 06:56
przytula_guy przytula_guy is offline
Registered User
 
Join Date: Apr 2006
Location: Belgium
Posts: 1,159
do not forget copy yes when using load and hadr - and logging of index create
__________________
Best Regards, Guy Przytula
Database Software Consultant
DB2 UDB LUW Certified V7-V8-V9-V9.7 DB Admin - Dprop..
Information Server Datastage Certified
http://www.infocura.be
Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On