Hacker Newsnew | past | comments | ask | show | jobs | submitlogin
Big data is at least four different problems (2015) [video] (youtube.com)
48 points by brudgers on Nov 8, 2022 | hide | past | favorite | 5 comments


Can anyone recommend any articles/blogs/etc on big data success stories outside of ad tech and retail web tech? And I mean big, business defining successes.

It's not to say they don't exist, obviously analytics is super important, but after being involved in it for 10+ years, it is rare that I have seen any game changing results come from big data analytics teams. Lots of small incremental improvements, sure, but I wonder about the ROI given the infra costs.


Would you consider fintech or algorithmic trading a use case?

Or analytics for sports? The sabermetric revolution uses big data for video analysis now - something like 6 TB per game.

Flexport might be another example. Although I’m not privy exactly to how they use data.


Interesting he brings up zynga and their impressive petabytes worth of clicks. They weren't able to sustain a business off of that insight so was that a technology failure or a business model failure.


Paraphrased from description:

- Large amounts of source data

- Large amount of processing/analytics of data (ML and other models)

- Large flow of data (data per time unit)

- Diverse input sources (combining data from different sources and formats)

Obviously these aren't mutually exclusive.


Thank you for parsing out this data




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: