Last year I was working on something using SQLite, users could perform analytical queries that would scan the entire 3gb db and generate aggregates. It would take at least 45 seconds to do the queries.
I did a dump of the db and imported to DuckDB. The same queries now only take 1.5 seconds with exactly the same SQL.
Obviously there is a trade off, inserts are slower on DuckDB. But for a low write, analytical read app it's perfect.
I tried to use the SQLite connector but struggled to get it working. Need to circle back and have another go.
With their SQLite and Postgres connectors, as a Django dev I would love an app that lets you run specific queries on your DB via DuckDB almost transparently. Would be awesome for analytical dashboards.
Last year I was working on something using SQLite, users could perform analytical queries that would scan the entire 3gb db and generate aggregates. It would take at least 45 seconds to do the queries.
I did a dump of the db and imported to DuckDB. The same queries now only take 1.5 seconds with exactly the same SQL.
Obviously there is a trade off, inserts are slower on DuckDB. But for a low write, analytical read app it's perfect.
I tried to use the SQLite connector but struggled to get it working. Need to circle back and have another go.
With their SQLite and Postgres connectors, as a Django dev I would love an app that lets you run specific queries on your DB via DuckDB almost transparently. Would be awesome for analytical dashboards.