I have one table in mysql db and its around 300+ gb in size. Querying it has become a performance overhead now.
I am looking for insights on storing and querying such size of data in a fast manner.
Any advice would be highly appreciable.
I have one table in mysql db and its around 300+ gb in size. Querying it has become a performance overhead now.
I am looking for insights on storing and querying such size of data in a fast manner.
Any advice would be highly appreciable.
Is the table normalized? If not, one of the first steps you could look at is seeing if you could break up the one large table into several, normalized tables until it reaches BCNF form.
The benefits of normalizing the table would be that you would be querying much smaller tables which should help increase your speed, as you don't have to go through as many unnecessary columns.
There's a lot of write-ups on normalization, so I won't bother going over it in much detail.
http://searchsqlserver.techtarget.com/definition/normalization
http://searchoracle.techtarget.com/answer/What-is-the-Boyce-Codd-normal-form