Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

> and that seems highly likely to continue for the next few (at least)

Why? Text training data is already exhausted.




Yes, turns out in the context of machines, all of the names we've given to things and concepts is not a very large set in the scheme of things.

Next focus will hopefully be on reasoning abilities. Probably gonna take another decade and a similar paper to attention is all you need before we see any major improvements...but then again all eyes are on these models atm so perhaps it'll be sooner than that.




Consider applying for YC's Fall 2025 batch! Applications are open till Aug 4

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: