Hacker News new | past | comments | ask | show | jobs | submit login

No I disagree. I would want ChatGPT to abstract away expert models - biochemistry model, coding model, physics model and maybe O3 would use these models as tools to come up with an answer.

The point being that a separate expert model would be better at its own field than a single model that tries to be good at everything. Intuitively it makes sense, in practice I have seen anecdotes where finetuning a small model on domain data makes the model lose coherence on other topics.






> have seen anecdotes where finetuning a small model on domain data makes the model lose coherence on other topics

This is expected behaviour.


i know. so why don't we have domain specific models as tools in consumer llm products



Consider applying for YC's Summer 2025 batch! Applications are open till May 13

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: