Recently in HN there's a repost on how big data is dead (2023) and both HN posts had garnered more than a combined 800 comments and 1000 points, both very substantial in term of interests on this controversial topic [1], [2]. I think someone will post the same topic and link again next year and probably will get similar number of comments and points.
In comments sections for repost, I did mentioned that big data is not dead but just having its AI winter moment, and big data is not only about volume (of storage) but also on the memory requirements (of RAM) [3].
Fast forward a few months, it seems the AI LLM is reviving the big data scenario and is seems that big data is far from dead but it's very much healthy in the era of LLMs, cloud or local. Wait until IoT and machine-to-machine (M2M) based systems are in full effects and big data will not just surviving but will be thriving.
In comments sections for repost, I did mentioned that big data is not dead but just having its AI winter moment, and big data is not only about volume (of storage) but also on the memory requirements (of RAM) [3].
Fast forward a few months, it seems the AI LLM is reviving the big data scenario and is seems that big data is far from dead but it's very much healthy in the era of LLMs, cloud or local. Wait until IoT and machine-to-machine (M2M) based systems are in full effects and big data will not just surviving but will be thriving.
[1] Big data is dead (2023) - original
https://news.ycombinator.com/item?id=34694926
[2] Big data is dead (2023) - repost
https://news.ycombinator.com/item?id=40488844
[3] Comments on: Big data is dead (2023):
https://news.ycombinator.com/item?id=40489607