Hacker News new | past | comments | ask | show | jobs | submit login

This is very cool!.

Last time I checked duckdb didn't have the concept of a metastore so do you have an internal convention for table locations and folder structure ?.

What do you use for reports/visualizations? notebooks ?.




Yeah, dagster has a concept of metadata and assets so we have some code that'll map dagster's own logical representation to physical s3 locations.

Reports and viz varies a lot, the finance department uses tableau where as for more 'data sciencey' stuff we normally just use notebooks.


Hadn't heard of that dagster feature, thats really cool.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: