it's hardly science it's mostly experimentation + ablations on new ideas. but yeah idk if they are asking llms to generate these ideas. probably not good enough as is. though it doesn't seem outo f reach to RL on generating ideas for AI research

I'm curious what you think qualifies as science.

haha touché but I don't think they are trying to understand the underlying theory etc or do hypothesis testing? I think it's more like engineering tbh