If this is your first visit, be sure to check out the FAQ by clicking the link above. You may have to register before you can post: click the register link above to proceed. To start viewing messages, select the forum that you want to visit from the selection below.

 
Go Back  dBforums > Database Server Software > MySQL > mysql - table size limits

Reply
 
LinkBack Thread Tools Search this Thread Display Modes
  #1 (permalink)  
Old 11-05-03, 15:25
deepakram deepakram is offline
Registered User
 
Join Date: Oct 2003
Location: Detroit
Posts: 11
mysql - table size limits

Hi,
Since I am new to the DB world, I would like to know what is the limit mysql imposes on the table size.
I have to design a database, that is up 27 x 7 x 365(pretty much!)
Every hour it logs data which accumulates to about 27K rows.
So, my question is, If I have just a Table ( with 5 coloumns), will I overflow very soon ?
Is there a better way, to design the tables? Say, create a Table @ day?
Currenty, in my design I have 3 tables, each having about 5 columns.
Atleast 1 table will size about to 27K rows of data at the end of one day.

I have here with me a Windows 2K mcahine ( 1.5GHz Pentium), 1GB Ram, 40GB HardDisk. I am thinking about RAID too. and also possibly SCSI disks to improve performance (if necessary ).

Pls feel free to comment on the above!
Thanks,

Deepak Ram
Reply With Quote
  #2 (permalink)  
Old 11-05-03, 15:47
bstjean bstjean is offline
Registered User
 
Join Date: Sep 2002
Location: Montreal, Canada
Posts: 219
Re: mysql - table size limits

Quote:
Originally posted by deepakram
Hi,
Since I am new to the DB world, I would like to know what is the limit mysql imposes on the table size.
I have to design a database, that is up 27 x 7 x 365(pretty much!)
Every hour it logs data which accumulates to about 27K rows.
So, my question is, If I have just a Table ( with 5 coloumns), will I overflow very soon ?
Is there a better way, to design the tables? Say, create a Table @ day?
Currenty, in my design I have 3 tables, each having about 5 columns.
Atleast 1 table will size about to 27K rows of data at the end of one day.

I have here with me a Windows 2K mcahine ( 1.5GHz Pentium), 1GB Ram, 40GB HardDisk. I am thinking about RAID too. and also possibly SCSI disks to improve performance (if necessary ).

Pls feel free to comment on the above!
Thanks,

Deepak Ram
It all depends on your OS, filesystem and size of rows of your table and table handler.

See http://www.mysql.com/doc/en/Table_size.html

When using MyISAM table handler, you can also workaround the filesystem filesize limit by using MERGE tables. When using InnoDB, you can just create multiple tablespaces.

You case is not exceptional... The Genome project and a few other companies are using MySQL to store Terabytes of data in a few billion rows...

And 237 million rows a year ain't so bad... as long as you have the proper hardware and decent design.

Hope this helps.
Reply With Quote
  #3 (permalink)  
Old 11-05-03, 16:12
deepakram deepakram is offline
Registered User
 
Join Date: Oct 2003
Location: Detroit
Posts: 11
Re: mysql - table size limits

Thanks for the reply,
is there a website, where I can go and look into how database for such high storage applications are done? as you said, the genome project for example ?

Thnks in Advance.
Deepak Ram




Quote:
Originally posted by bstjean
It all depends on your OS, filesystem and size of rows of your table and table handler.

See http://www.mysql.com/doc/en/Table_size.html

When using MyISAM table handler, you can also workaround the filesystem filesize limit by using MERGE tables. When using InnoDB, you can just create multiple tablespaces.

You case is not exceptional... The Genome project and a few other companies are using MySQL to store Terabytes of data in a few billion rows...

And 237 million rows a year ain't so bad... as long as you have the proper hardware and decent design.

Hope this helps.
Reply With Quote
  #4 (permalink)  
Old 11-05-03, 16:16
bstjean bstjean is offline
Registered User
 
Join Date: Sep 2002
Location: Montreal, Canada
Posts: 219
Re: mysql - table size limits

Quote:
Originally posted by deepakram
Thanks for the reply,
is there a website, where I can go and look into how database for such high storage applications are done? as you said, the genome project for example ?

Thnks in Advance.
Deepak Ram
Well, you can have a description of volume/perf/setup

http://www.mysql.com/press/user_stories/
Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On