The vast majority of human progress is not revolutionary, but incremental. Even ChatGPT was an incremental improvement on GPT 3, which was an incremental improvement on GPT 2, which was an incremental improvement on decoder-only transformers.
Still, if you stack enough small changes together it becomes a difference in kind. A tsunami is “just” a bunch of water but it’s a lot different than a splash of water.
Fair and I agree. I guess it raised flags for me that shouldn’t have: why is is a blog post at all (it’s a new thing) and why is it gaining traction on HN (it’s an OpenAI thing)
Still, if you stack enough small changes together it becomes a difference in kind. A tsunami is “just” a bunch of water but it’s a lot different than a splash of water.