If this is your first visit, be sure to check out the FAQ by clicking the link above. You may have to register before you can post: click the register link above to proceed. To start viewing messages, select the forum that you want to visit from the selection below.

 
Go Back  dBforums > Database Server Software > MySQL > Import getting slower and slower

Reply
 
LinkBack Thread Tools Search this Thread Display Modes
  #1 (permalink)  
Old 04-22-04, 07:24
tmoeller tmoeller is offline
Registered User
 
Join Date: Apr 2003
Posts: 30
Import getting slower and slower

Hi,

we are using navicat to import Excel files to mysql. we have one problem for larger files like with 20000 rows or more. first the import is fast but after 1000 rows or so ist getting slower and slower.

is there a parameter for setting a buffer size in mysql which could be responsible for this behaviour!

Thanks

Thorsten
Reply With Quote
  #2 (permalink)  
Old 04-27-04, 10:02
snorp snorp is offline
Registered User
 
Join Date: Apr 2004
Location: Europe->Sweden->Stockholm
Posts: 71
Have you turned off index updating while importing (I don't know if navicat does this for you)? Turning index updating off will probably make your import take closer to linear time...

"ALTER TABLE tab DISABLE KEYS" turns off (non-unique) index updating for MyISAM tables. I don't know about InnoDB. If you are sure that you have no duplicates in the data you import it is probably faster to drop indices and re-create them after the import is done (if you import into empty tables at least).

And yeah, don't forget to "ALTER TABLE tab ENABLE KEYS" after the import, if you have disabled them prior.
Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On