Data sync solution?

Posted by user321088 on Stack Overflow See other posts from Stack Overflow or by user321088
Published on 2010-04-20T08:24:40Z Indexed on 2010/04/20 8:33 UTC
Read the original article Hit count: 389

Filed under:

synchronization

|

sync

|

mysql

|

database

|

datasynchronization

For some security issues I'm in an envorinment where third party apps can't access my DB. For this reason I should have some service/tool/script (dunno what yet... i'm open to the best option, still reading to see what I'm gonna do...) which enables me to generate on a regular basis(daily, weekly, monthly) some csv file with all new/modified records for a certain application.

I should be able to automate this process and also export at any time a new file. So it should keep track for each application which records he still needs.

Each application will need some data in some other format (csv/xls/sql), also some fields will be needed for some application and some aren't... It should be fairly flexible...

What is the best option for me? Creating some custom tables for each application? Based on that extracting modified data?

© Stack Overflow or respective owner

Related posts about synchronization

Thread Synchronization and Synchronization Primitives

as seen on DotNetBlocks - Search for 'DotNetBlocks'
When considering synchronization in an application, the decision truly depends on what the application and its worker threads are going to do. I would use synchronization if two or more threads could possibly manipulate the same instance of an object at the same time. An example of this in C# can… >>> More
Inner synchronization on the same object as the outer synchronization

as seen on Stack Overflow - Search for 'Stack Overflow'
Recently I attended a lecture concerning some design patterns: The following code had been displayed: public static Singleton getInstance() { if (instance == null) { synchronized(Singleton.class) { //1 Singleton inst = instance; //2 if (inst == null) { … >>> More
SugarSync: Online Backup and Synchronization

as seen on Internet.com - Search for 'Internet.com'
Despite a few flaws, SugarSync offers small businesses a way to synchronize files across multiple computers and smartphones. Plus, it includes online data backup. >>> More
SugarSync: Online Backup and Synchronization

as seen on Internet.com - Search for 'Internet.com'
Despite a few flaws, SugarSync offers small businesses a way to synchronize files across multiple computers and smartphones. Plus, it includes online data backup. >>> More
Send regular keyboard samples OR keyboard state changes over network

as seen on Game Development - Search for 'Game Development'
Building a multi player asteroids game where ships compete with each other. Using UDP. Wanted to minimize traffic sent to server. Which would you do: Send periodic keyboard state samples every from client every to match server physics update rate e.g. 50 times per second. Highly resilient to packet… >>> More

Related posts about sync

Coherence - How to develop a custom push replication publisher

as seen on Oracle Blogs - Search for 'Oracle Blogs'
CoherencePushReplicationDB.zipIn the example bellow I'm describing a way of developing a custom push replication publisher that publishes data to a database via JDBC. This example can be easily changed to publish data to other receivers (JMS,...) by performing changes to step 2 and small changes to… >>> More
12c??? - Active Data Guard Far Sync

as seen on Oracle Blogs - Search for 'Oracle Blogs'
?? ================ Active Data Guard Far Sync?Oracle 12c????(???Far Sync Standby),Far Sync?????????????(Primary Database)?????????Far Sync??,??(Primary Database) ??(synchronous)??redo?Far Sync??,??Far Sync????redo??(asynchronous)???????(Standby Database)???????????????????????Far Sync?… >>> More
Using "offline files sync" to sync with a local resource [closed]

as seen on Super User - Search for 'Super User'
Possible Duplicate: Which is the best application to Sync two folders? I have been trying get my machine (XP-Pro SP3) to sync files to a local USB drive in the same way as I can with mapped network drives. I particularly want to the sync to happen automatically when the USB is connected - in… >>> More
Can't sync iphone when sync podcasts selected

as seen on Super User - Search for 'Super User'
I've gone through the following steps: Loaded up iTunes 10 on a Windows7 machine Went to iTunes store and subscribed to a podcast Selected sync podcasts Clicked sync However, it always hangs on step 1 of 3 - it just gives a status of 'Backing up' and never progresses past that. I've waited over… >>> More
Sync database with filter using SyncOrchestrator with Sync Framework 2.0

as seen on Stack Overflow - Search for 'Stack Overflow'
Hi, I want to synchronize two SQL databases. But since one of the databases only requires a subset of the data I am looking for a filter option. Is there a possibility to add a Filter to the SyncOrchestrator or do I have to add the filter to the SyncProvider? According to this: http://social.microsoft… >>> More