what actually are the consequences of ignoring robots.txt (apart from DDOS)? hav... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		swyx 1 day ago \| parent \| context \| favorite \| on: Cloudflare Introduces Default Blocking of A.I. Dat... what actually are the consequences of ignoring robots.txt (apart from DDOS)? have any of these cases ended up in court at all?

v5v3 16 hours ago [–]

BBC recently served a cease and desist on perplexity to stop, and delete all existing.

https://www.bbc.co.uk/news/articles/cy7ndgylzzmo

So an ai company can just be naughty till asked to stop, and then exclud that one company that has the financial resources to go legal.

Consider applying for YC's Fall 2025 batch! Applications are open till Aug 4
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact