Skip to content

AI and Crawler Discovery

These public machine-readable files help crawlers, agents, and automation discover CartBay documentation and integration metadata:

  • robots.txt for crawler policy and the sitemap reference.
  • llms.txt for the concise LLM-friendly overview of the documentation set. This endpoint is also advertised with a site-wide <link rel="alternate"> tag.
  • llms-full.txt for the expanded plain-text export of the docs corpus. This endpoint is also advertised with a site-wide <link rel="alternate"> tag.
  • Per-page Markdown/MDX source exports under /markdown/ (<base>/markdown/<page-slug>.md), for example markdown/index.md or markdown/others/ai-crawler.md. Each documentation page advertises its own export with a page-specific <link rel="alternate" type="text/markdown"> tag.
  • sitemap-index.xml for the top-level sitemap index.
  • sitemap-0.xml for the generated URL list currently referenced by the sitemap index.
  • .well-known/mcp.json for MCP discovery metadata related to the public documentation site.

Recommended agent entry points (for approved agents):

  • Agent Access explains CartBay’s protected agent REST endpoints, WordPress Abilities, scopes, settings gates, and audit logging.
  • Automation Workflows provides safe read-only and approved-write workflows for AI agents.
  • Safety Rules defines PII, contact, coupon, destructive, and developer-agent guardrails.