How to distribute a unique database already in production?

Posted by JVerstry on Programmers See other posts from Programmers or by JVerstry
Published on 2012-09-30T15:02:17Z Indexed on 2012/09/30 15:48 UTC
Read the original article Hit count: 277

Filed under:

database

|

scalability

|

sharding

Let's assume a successful web spring application running on a MySql or PostGre kind of database. The traffic is becoming so high and the amount of data is becoming so big that a distributed dataase solution needs to be implemented. It is a scalability issue.

Let's assume this application is using Hibernate and the data access layer is cleanly separated with DAO objects.

What would be the best strategy to scale this database? Does anyone have hands on experience to share? Is it possible to minimize sharding code (Shard) in the application?

Ideally, one should be able to add or remove databases easily. A failback solution is welcome too.

I am not looking for you could go for sharding or you could go no sql kind of answers. I am looking for deeper answers from people with experience.

© Programmers or respective owner

Related posts about database

SQL SERVER Retrieve and Explore Database Backup without Restoring Database Idera virtual database

as seen on Dot net Slackers - Search for 'Dot net Slackers'
I recently downloaded Ideras SQL virtual database, and tested it. There are a few things about this tool which caught my attention.My ScenarioIt is quite common in real life that sometimes observing or retrieving older data is necessary; however, it had changed as time passed by. The full database… >>> More
Cloning A Database On The Same Server Using Rman Duplicate From Active Database

as seen on Oracle Blogs - Search for 'Oracle Blogs'
To clone a database using Rman we used to require an existing Rman backup, on 11g we can clone databases using the "from active" database option. In this case we do not require an existing backup, the active datafiles will be used as the source for the clone. In order to clone with the source database… >>> More
cPickle ImportError: No module named multiarray

as seen on Stack Overflow - Search for 'Stack Overflow'
Hello, I'm using cPickle to save my Database into file. The code looks like that: def Save_DataBase(): import cPickle from scipy import * from numpy import * a=Results.VersionName #filename='D:/results/'+a[a.find('/')+1:-a.find('/')-2]+Results.AssType[:3]+str(random.randint(0,100))+Results.Distribution+"… >>> More
SQL SERVER – 2008 – Introduction to Snapshot Database – Restore From Snapshot

as seen on SQL Authority - Search for 'SQL Authority'
Snapshot database is one of the most interesting concepts that I have used at some places recently. Here is a quick definition of the subject from Book On Line: A Database Snapshot is a read-only, static view of a database (the source database). Multiple snapshots can exist on a source database and… >>> More
OTN ???? ?????? ???????

as seen on Oracle Blogs - Search for 'Oracle Blogs'
Database ?? Database ??????? Database ?????????? Java WebLogic Server/????????·???? SOA/BPM/????? ???????/???? ID??/?????? ?????EPM/BI EPM/BI ??????? EPM/BI ???? OS/??? ???? ????? MySQL Database ?? ???? ?? ????????? ??? ?? ORACLE MASTER… >>> More

Related posts about scalability

scalability: when to use CDN?

as seen on Server Fault - Search for 'Server Fault'
i've read about CDN but dont know exactly what it is for. lets say i've got an international social network (text and image content), and it's growing in traffic from different countries, do i have use of CDN? the picture i got from the sources i've read is that it copy your content and put it in… >>> More
php vs python. scalability

as seen on Stack Overflow - Search for 'Stack Overflow'
Why is PHP considered more scalable than python? I've heard may times that one of the reasons PHP is "better" than python is that PHP is more easily scalable, and that Yahoo proves that(assumig Yahoo still uses PHP). Whats the difference between PHP and Python when it comes to scalability? -- edit… >>> More
Elastic Caching Platforms Balance Performance, Scalability, And Fault Tolerance

as seen on Devx - Search for 'Devx'
In this blog, a Forrester expert explains the benefit of elastic caching platforms. >>> More
Elastic Caching Platforms Balance Performance, Scalability, And Fault Tolerance

as seen on Internet.com - Search for 'Internet.com'
In this blog, a Forrester expert explains the benefit of elastic caching platforms. >>> More
Mochiweb's Scalability Features

as seen on Stack Overflow - Search for 'Stack Overflow'
From all the articles I've read so far about Mochiweb, I've heard this over and over again that Mochiweb provides very good scalability. My question is, how exactly does Mochiweb get its scalability property? Is it from Erlang's inherent scalability properties or does Mochiweb have any additional… >>> More