Very large database, very small portion most being retrieved in real time
Posted
by mingyeow
on Server Fault
See other posts from Server Fault
or by mingyeow
Published on 2010-05-20T17:39:50Z
Indexed on
2010/05/20
17:50 UTC
Read the original article
Hit count: 1070
Hi folks, I have an interesting database problem. I have a DB that is 150GB in size. My memory buffer is 8GB.
Most of my data is rarely being retrieved, or mainly being retrieved by backend processes. I would very much prefer to keep them around because some features require them.
Some of it (namely some tables, and some identifiable parts of certain tables) are used very often in a user facing manner
How can I make sure that the latter is always being kept in memory? (there is more than enough space for these)
More info: We are on Ruby on rails. The database is MYSQL, our tables are stored using INNODB. We are sharding the data across 2 partitions. Because we are sharding it, we store most of our data using JSON blobs, while indexing only the primary keys
© Server Fault or respective owner
