Yes, turns out in the context of machines, all of the names we've given to things and concepts is not a very large set in the scheme of things.
Next focus will hopefully be on reasoning abilities. Probably gonna take another decade and a similar paper to attention is all you need before we see any major improvements...but then again all eyes are on these models atm so perhaps it'll be sooner than that.
Why? Text training data is already exhausted.