Empirical HTTP readiness benchmark across 40 B2B SaaS, Shopify D2C, SEO agency, and multi-location service domains measuring /llms.txt, /agents.md, Shopify /api/ucp/mcp, FAQPage JSON-LD, and silent CDN WAF blocks on GPTBot and PerplexityBot.
What does the study detect? A 404 on /agents.md tells you the file isn’t there. A 200 on the MCP path tells you something answers. Was the crawl checking for a spec-shaped file, or for evidence that anything on the other side of it had been touched? Those are different findings and only one of them says anything about adoption. If 80% is just the endpoint existing, that’s a platform shipping a route.
What does the study detect? A 404 on /agents.md tells you the file isn’t there. A 200 on the MCP path tells you something answers. Was the crawl checking for a spec-shaped file, or for evidence that anything on the other side of it had been touched? Those are different findings and only one of them says anything about adoption. If 80% is just the endpoint existing, that’s a platform shipping a route.