They’re great if word count is your measure. But it’s hard for LLMs to know the whole current SOTA and come up with something innovative and insightful. The same as 99% of human proposals.
Can LLMs come up with the 1% ideas that breakthrough?
Paired with great execution
LLMs definitely know more of the current SOTA in everything than anyone alive, and that doesn't even count in the generous amount of searching capability granted to them by vendors. They may fail to utilize results fully due to limited reasoning ability, but they more than make up for it in volume.
> Can LLMs come up with the 1% ideas that breakthrough? Paired with great execution
It's more like 0.01%, and it's not the target anyway. The world doesn't run on breakthroughs and great execution, it runs on the 99.99% of the so-so work and incremental refinement.
