Can in-memory SQLite databases scale with concurrency?

Posted by Kent Boogaart on Stack Overflow See other posts from Stack Overflow or by Kent Boogaart
Published on 2010-04-02T13:40:44Z Indexed on 2010/04/02 14:03 UTC
Read the original article Hit count: 230

Filed under:

sqlite

|

in-memory

|

concurrent

|

sql

|

scalability

In order to prevent a SQLite in-memory database from being cleaned up, one must use the same connection to access the database. However, using the same connection causes SQLite to synchronize access to the database. Thus, if I have many threads performing reads against an in-memory database, it is slower on a multi-core machine than the exact same code running against a file-backed database.

Is there any way to get the best of both worlds? That is, an in-memory database that permits multiple, concurrent calls to the database?

© Stack Overflow or respective owner

Related posts about sqlite

How to add SQLite (SQLite.NET) to my C# project

as seen on Stack Overflow - Search for 'Stack Overflow'
I followed the instructions in the documentation: Scenario 1: Version Independent (does not use the Global Assembly Cache) This method allows you to drop any new version of the System.Data.SQLite.DLL into your application's folder and use it without any code modifications or recompiling… >>> More
dotConnect or "sqlite.phxsoftware.com" for using Entity Framework with SQLite

as seen on Stack Overflow - Search for 'Stack Overflow'
Which is the better choice out of dotConnect or "sqlite.phxsoftware.com" for using Entity Framework with SQLite (in C#)? >>> More
SQLite table does not exist exception for existing SQLite database (and table)

as seen on Stack Overflow - Search for 'Stack Overflow'
I've followed the instructions given here for introducing an existing SQLite database to your Android app. When I query the table "android_metadata" this is fine. But when I run a similar query on my own table "words" (which has _id for primary integer key) I get a table does not exist exception… >>> More
Android Jelly bean database is locked (code 5)

as seen on Stack Overflow - Search for 'Stack Overflow'
Im getting a database is locked (code 5) in my ListActivity the code works in the other versions of the Emulator but fails in the 4.1 version of the emulator E/SQLiteLog( 2132): (5) database is locked E/SQLiteDatabase( 2132): Failed to open database '/data/data/id.online.mydroid/databases/geo… >>> More
Android:accessing assets folder sqlite databse file with .sqlite extension

as seen on Stack Overflow - Search for 'Stack Overflow'
How to read data from the assets folder sqlite database file with .sqlite extension in my android application? Thanks >>> More

Related posts about in-memory

single level paging memory manager ...time it takes to access the memory

as seen on Super User - Search for 'Super User'
If I have a system with a single level paging memory manager ( without TLB).. How much time is needed for this system to access the memory ? I've been reading twice as long without the memory manager .. Is this true ? If not how long without a memory manager ( give or take ) would it be. >>> More
Optimizing Memory Usage in a .NET Application with ANTS Memory Profiler

as seen on Simple Talk - Search for 'Simple Talk'
Most people have encountered an OutOfMemory problem at some point or other, and these people know that tracking down the source of the problem is often a time-consuming and frustrating task. Florian Standhartinger gives us a walkthrough of how he used the ANTS Memory Profiler to help make an otherwise… >>> More
Why is Available Physical Memory (dwAvailPhys) > Available Virtual Memory (dwAvailVirtual) in call G

as seen on Stack Overflow - Search for 'Stack Overflow'
I am playing with an MSDN sample to do memory stress testing (see: http://msdn.microsoft.com/en-us/magazine/cc163613.aspx) and an extension of that tool that specifically eats physical memory (see http://www.donationcoder.com/Forums/bb/index.php?topic=14895.0;prev_next=next). I am obviously confused… >>> More
Understanding the memory consumption on iPhone

as seen on Stack Overflow - Search for 'Stack Overflow'
Hello! I am working on a 2D iPhone game using OpenGL ES and I keep hitting the 24 MB memory limit – my application keeps crashing with the error code 101. I tried real hard to find where the memory goes, but the numbers in Instruments are still much bigger than what I would expect. I ran the application… >>> More
MPMoviePlayerController on large videos causes massive memory spike, and a level 1 memory warning

as seen on Stack Overflow - Search for 'Stack Overflow'
When viewing images my application hums along nicely with low memory consumption, once I try to watch a video using MPMoviePlayerController memory usage spikes way up, dwarfing the previous memory graph and if I play the video it causes a 'memory warning. Level=1' message. The video files (mp4) aren't… >>> More