Great writeup. There are other scaling axes of course, around data (even synthetic data) and improving AI generation at the 'software' layer (smarter design / training efficiencies / inference speed ups) — progress in those might make the the currently-unthinkable orders of magnitude $500b and beyond not as necessary?
Thank you , I am not sure if those dimensions will deliver the kind of generational boosts needed to keep the exponential going.
I could be quite wrong of course but it is not a certain bet that we will get fundamental breakthroughs from them.
There are specific areas which are always going to have major improvements .
In the semi conductor industry, Low power processors or multi core dies etc produced some results when core innovations slowed down during 2008-2018, i.e. till before the current EUV breakthrough driven generations of chip advances.
The history of EUV lithography and ASML’s success is an unlikely tale and it happened after both public and industry consortium funding of work for 2 decades that was abandoned multiple times .
Breakthroughs will happen eventually, but each wave ( we are on the fourth one for AI?) stagnates after initial rapid progress .
We are 100% going to get 'hey remember when LLMs were pure and not explicitly (or more dangerously: subtly) recommending things' nostalgia in years to come.
There are parallels to early web here I'm sure of it.
I think I'm a little more worried about AI being subtly influenced in its training data -- they can't explain why they give the tokens they do, and even chain of thought / explain your working thinking is similarly made up and hallucination-prone
Slick front page with one of the best documentation pages I've come across. A sprawling v4 rewrite is in the works and Julian seems to have been picking up steam on it lately.
No, but I would like to start a startup / open source project in this area. I maintain the website OpenSustain.tech and through it I came in contact with various projects that are being created in this area. I think UK is a good location for a startup in this field. There are a lot of investors here and a lot of funding for sustainable projects.
Very cool. Do you mind if I send you an email at team@protontypes.eu? We have an on-going (academic) research effort that may fit the criteria on your contribution guide : )