Fix pack for cloudflare.com

Starter drafts for the files that make your site readable to AI agents. Copy or download each one, review it, fill in the blanks, then publish it at the path shown. These are drafts to check, not finished files — AgentVisible never invents endpoints or capabilities your site doesn't have.

Prefer raw JSON? Get the machine-readable pack

01 · robots-additions.txt

robots.txt additions

Download

Lines to add to your existing robots.txt: point agents at your sitemap and set an explicit, intentional policy for AI crawlers.

Merge these lines into https://cloudflare.com/robots.txt

# AgentVisible suggested additions
# Merge with existing policy; do not replace working rules blindly.

Sitemap: https://cloudflare.com/sitemap.xml

# Example AI bot policy placeholders:
# User-agent: GPTBot
# Allow: /
# User-agent: ClaudeBot
# Allow: /

02 · api-catalog.json

API catalog

Download

A machine-readable index of any APIs your site exposes, so agents can find them instead of guessing. Starts empty — add real endpoints as you build them.

Publish at https://cloudflare.com/.well-known/api-catalog

{
  "linkset": [
    {
      "anchor": "https://cloudflare.com/",
      "service-desc": [],
      "service-doc": [
        {
          "href": "https://agentvisible.io/scan?url=cloudflare.com&type=api",
          "type": "text/html"
        }
      ]
    }
  ]
}