Hacker Newsnew | past | comments | ask | show | jobs | submitlogin
Ask HN: Functional Design of a AWS Data Lake
2 points by ironfootnz on June 19, 2019 | hide | past | favorite | 1 comment
Working on the high level 30k feet from the ground is a easy job to do, I ask my fellow members of HN.

How do you specify the functional design of a datalake under aws cloud?

Here's my background.

I'm trying to implement a function to the zones in the lake: landing, raw, trusted and refined.

To get access to the zones I came up with a user community:

- General users - Employees - Data People (scientist, analysts) - Third-party SasS - Partners

As I'm considering AWS Cognito to manage the policies around the user pool, I strugle setting the policies for each group and individual, they always endup overlapping.

How did you guys sort that out? Can you share your views, thoughts a link that I can read better into the functional details?



Would love to see answers on this as a relative noob with the framework.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: