On July 1, 2019, Google announced the proposal of the Robots Exclusion Protocol as an official standard under Internet Engineering Task Force.[8]
https://en.wikipedia.org/wiki/Robots.txt
reply
On July 1, 2019, Google announced the proposal of the Robots Exclusion Protocol as an official standard under Internet Engineering Task Force.[8]
https://en.wikipedia.org/wiki/Robots.txt