If this is your first visit, be sure to check out the FAQ by clicking the link above. You may have to register before you can post: click the register link above to proceed. To start viewing messages, select the forum that you want to visit from the selection below.

 
Go Back  dBforums > Database Server Software > MySQL > Rapidly Growing Database

Reply
 
LinkBack Thread Tools Display Modes
  #1 (permalink)  
Old 02-20-10, 02:56
thinknew thinknew is offline
Registered User
 
Join Date: Feb 2010
Posts: 2
Rapidly Growing Database

I built a member based analytics system. All data is stored in a mysql db.

This system is growing rapidly and I have several tables that are approaching a gig in size. I don't see a lot of lag yet but I am worried about the future.

Since this is a member based system should I split the tables up among several tables by member or should i separate it by a database for each member?

What would be the best approach to this?

Also what size is a troublesome size for a mysql table or db?

Thanks in advance!
Reply With Quote
  #2 (permalink)  
Old 02-21-10, 07:42
mike_bike_kite mike_bike_kite is offline
vaguely human
 
Join Date: Jun 2007
Location: London
Posts: 2,517
Quote:
Originally Posted by thinknew
I built a member based analytics system. This system is growing rapidly and I have several tables that are approaching a gig in size.
We can only imagine what a "member based analytics system" is but a gig of data for a relatively new system is a little worrying. Can you give any info on what it is you're storing? Why is it growing so rapidly? is it because you're getting too many members or is their an issue with the design? Perhaps:
  • you're storing too much data - (a gig of growth for a new system is a lot)
  • you're not cleaning old data?
  • you should charge by usage and then the amount of data being stored will reduce?
  • if you envisage many more users (and a lot more growth) then the system should be installed on the client side rather than on a server?
Splitting tables is usually a bad idea and nearly always results in poorer overall system performance and way more maintenance issues.

Mike
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On