Hacker News new | past | comments | ask | show | jobs | submit login

That would explain why my ETLs are failing at 3am in the morning !!!



If it makes you feel any better; same thing happened to me. Ugly Frankenstein process to get our data out of a third party vendor who can only e-mail us reports failed half-way through its run, and I was about to spend hours digging through to see why until I saw this.


Hehehe.... my condolences... we're still trying to recover


Your ETL processes write to google drive or are dependent on email?

Earnest question, don't mean to sound derisive.


User emails file to drive

script connects to drive and parses list of files within

script copies files into redshift and moves original file to different directory or deletes it

alas what can be done? this is what the company gets for building like this ^.^


My understanding is part of google cloud failed(Google Cloud Storage), causing many outages, including but not limited to google drive/email.


I'm assuming some kind of workflow which uses email notifications, and only goes to the next step if the email notification succeeds..?




Consider applying for YC's Spring batch! Applications are open till Feb 11.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: