Thanks so if we do a join on two large tables, does it wait for the query to com... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		tarun_anand on July 28, 2023 \| parent \| context \| favorite \| on: Launch HN: PeerDB (YC S23) – Fast, Native ETL/ELT ... Thanks so if we do a join on two large tables, does it wait for the query to complete or it can start straight away. Or the reverse, is it possible to have a forever running query that can stream results as and when new data comes...

saisrirampur on July 29, 2023 [–]

Yes, PeerDB can stream query data continuously. You need to specify a watermark column (incremental id or timestamp column) as a part of the mirror. PeerDB uses this column to keep track of data that needs to be synced.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact