Minimizing data sent over a webservice call on expensive connection
- by aceinthehole
I am working on a system that has many remote laptops all connected to the internet through cellular data connections.
The application will synchronize periodically to a central database. The problem is, due to factors outside our control, the cost to move data across the cellular networks are spectacularly expensive.
Currently the we are sending a compressed XML file across the wire where it is being processed and various things are done with (mainly stuffing it into a database).
My first couple of thoughts were to convert that XML doc to json, just prior to transmission and convert back to XML just after receipt on the other end, and get some extra compression for free without changing much. Another thought was to test various other compression algorithms to determine the smallest one possible. Although, I am not entirely sure how much difference json vs xml would make once it is compressed.
I thought that their must be resources available that address this problem from an information theory perspective. Does anyone know of any such resources or suggestions on what direction to go in. This developed on the MS .net stack on windows for reference.
