Agree, moving the weights inefficiently will end up working the muscles you don't necessarily target in your main workout. It's less efficient, but probably gives a (very slightly) more well-rounded workout. If you're pressed for time, it could make sense to have a basic understanding of how to avoid dilly-dallying during your workout. If you go to a public gym, there will be other factors that affect your total time much more, like having to share equipment, which introduces a lot of uncertainty. Maybe these micro-optimizations are worthwhile if you have a private gym.

From a well-being/philosophical standpoint, maybe it's better to live life relaxed, and not one where you have to micro-manage every minute of your day to squeeze out every inch and penny of efficiency you can. That sounds like a horrible lifestyle, but I guess to each their own :)