> I thought Turing's Test would be a good barometer of AI
Depends on what you consider a "Turing's Test".
Fooling unsuspecting humans is relatively easy, it has been done with relatively simple software and some trickery. LLMs can do that too of course.
A more convincing "Turing's Test" would be:
- You have one interrogator, and two players, one human and one computer
- The interrogator, after chatting with both players has to find which is which
- The interrogator is an expert in the field, he knows everything there is to know when it comes to finding the computer
- The human player is also an expert, he knows how to solve problems that are hard for computers to solve, he also knows what to expect from the interrogator
- The interrogator and human player collaborate to find the computer
- The interrogator and human player are not allowed to have shared information that the computer doesn't have (and ideally, they shouldn't know each other personally), but everything else is fair game
Depends on what you consider a "Turing's Test".
Fooling unsuspecting humans is relatively easy, it has been done with relatively simple software and some trickery. LLMs can do that too of course.
A more convincing "Turing's Test" would be:
- You have one interrogator, and two players, one human and one computer
- The interrogator, after chatting with both players has to find which is which
- The interrogator is an expert in the field, he knows everything there is to know when it comes to finding the computer
- The human player is also an expert, he knows how to solve problems that are hard for computers to solve, he also knows what to expect from the interrogator
- The interrogator and human player collaborate to find the computer
- The interrogator and human player are not allowed to have shared information that the computer doesn't have (and ideally, they shouldn't know each other personally), but everything else is fair game