Hacker News new | past | comments | ask | show | jobs | submit login

True. However, the top 1% of users have 1000+ TB data warehouses where Postgres or MariaDB is not an option. These use cases do not require ACID/OLTP, though. This is why projects like Presto thrive. I think the next obvious leap for data management is bridging the OLTP OLAP gap and having the same database providing both, using the same query engine and different storage engines. Moving data from OLTP systems to OLAP always had its challenges; many companies, OSS projects, etc. wanted to solve it, with mixed results.



I manage about a petabyte of data using a Citus as the distributed query engine on top of Postgres nodes. It’s nice because you can query with Postgres but there’s a decent number of sharp edges at scale.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: