I have a dumb question. Could I use flow to import a text file into a postgresql... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		brunoqc on July 29, 2021 \| parent \| context \| favorite \| on: What the Heck is a Data Mesh? I have a dumb question. Could I use flow to import a text file into a postgresql database? The text file is not append-only. There's a lot of tools to import logs into stuff like kafka but not to import whole files (that can change) to a database.

jgraettinger1 on July 29, 2021 [–]

Yep. You can, for example, have it watch file(s) in S3, and every time a file changes it will flow its records through into a table it creates in your DB, keyed on your (arbitrary) primary key.

brunoqc on July 29, 2021 | [–]

Any way to watch local files too? S3 might be fine, but just asking.

ta988 on July 30, 2021 | | [–]

inotify?

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact