Hacker News new | past | comments | ask | show | jobs | submit login

Do you store raw data ingested from Kafka directly in S3 or have an intermediate database for hot data?



The raw data is stored directly into S3 every hour, but there are multiple systems that process the data directly from Kafka in order to produce the real-time pre-aggregated views.




Join us for AI Startup School this June 16-17 in San Francisco!

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: