Cloudflare is enhancing robots.txt, giving website owners more control over how AI systems access their data.