That's an orthogonal concern IMO. Running a batch in Europe is about tapping into another source of opportunities. There are plenty of founders that won't or aren't able to attend YC in SF
disagree, there are a few organisations exploring novel paths. It's just that throwing new data at an "old" algorithm is much easier and has been a winning strategy. And, also, there's no incentive for a private org to advertise a new idea that seems to be working (mine's a notable exception :D).
yep, even with greedy sampling and fixed system state, numerical instability is sufficient to make output sequences diverge when processing the same exact input
That doesn't matter, are you familiar with any theoretical results in which the computation is somehow limited in ways that practically matter when the context length is very long? I am not
It is a sensible position. YC and VCs are backing businesses, not charitable causes or research initiatives. It is the founders' responsibility to liaise the two sides in order to signal that the pursuit of their particular purpose is an undeniably attractive and fast-growing investment. Which obviously entails more work and has fewer market opportunities compared to the case "money is the purpose".
After getting backed and receiving adequate funding, all that matters is maintaining a good growth rate to remain a purpose-driven business.
aligns with (or is based on) Demis Hassabis' assessment from yesterday on missing cognitive capabilities for AGI: long-term memory, reasoning, hierarchical planning. He then goes on to suggest scientific creativity may be essential.
