Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Where did you get that date?

On July 1, 2019, Google announced the proposal of the Robots Exclusion Protocol as an official standard under Internet Engineering Task Force.[8]

https://en.wikipedia.org/wiki/Robots.txt






That is not when they started recommending it. It would be nice if you acknowledged the rest of my comment, I even quoted from the [8] reference.



Consider applying for YC's Fall 2025 batch! Applications are open till Aug 4

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: