User-agent: GPTBot
Disallow: /
User-agent: *
Disallow: /AR103 criticalGPTBot is a training preference. The wildcard restricts compliant crawlers with no matching specific group; it does not establish what every assistant can cite.
BROWSER-LOCAL FILE DIAGNOSTICS
Paste one file for deterministic checks and evidence behind each finding. Selected mirror rules are adapted from our production verifier. Nothing is fetched or uploaded.
The checker inspects one pasted file for crawler-policy hints, content and identity issues, or the selected optional format. It does not fetch links, test live access or establish indexing and citations. Markdown, llms.txt and JSON-LD are optional integrations, not Google AI-search prerequisites.
CHECK THE FILE YOU ACTUALLY SERVE
Paste the complete file, not an excerpt. Curl the URL and paste the response body, so you are checking what a fetcher receives rather than what your CMS shows you.
Shortcut: Ctrl or Command + Enter. Maximum input: 400,000 characters.
Paste a complete file to see the score, the rules that failed, and the evidence line for each one.
The score covers selected checks on this input. Optional-format suggestions and intentional training restrictions do not reduce it. Live access, indexing and citations remain unknown.
THREE MOVES
Check the published response body to catch differences from your CMS preview.
Curl your robots.txt, llms.txt, Markdown mirror, or page URL and copy the response body. A preview inside your CMS is rendered by your CMS, not served to a crawler.
The checker works out which of the four file types you pasted, runs only the rules that apply to it, and prints the line that triggered each finding.
Export the report and inspect the evidence. Confirm the scope and whether a policy is intentional before changing it.
READ THE EVIDENCE, NOT A MAGIC SCORE
The interesting cases are the files that look careful and are not.
User-agent: GPTBot
Disallow: /
User-agent: *
Disallow: /AR103 criticalGPTBot is a training preference. The wildcard restricts compliant crawlers with no matching specific group; it does not establish what every assistant can cite.
User-agent: CCBot
Disallow: /
Sitemap: https://example.com/sitemap.xmlAR104 low, score 100The same shape without the wildcard. Opting out of training is a licensing decision, so it is reported and it does not sink the grade.
- [Fractional CTO](/services/fractional-cto-austria/): leadershipAR204 · portability suggestionRelative links work when the consumer retains the source URL. Absolute URLs help when that context is lost. This portability suggestion does not reduce the score.
WHY WE CAN CLAIM THIS
Selected mirror checks are adapted from our production verifier. The browser tool does not run the full build or compare the file with its live source.
Selected mirror checks are adapted from scripts/verify_machine_markdown.mjs in this site’s repository. Our build verifies deployed-page parity as well; this browser tool checks the pasted file.
Training, search and user-initiated retrieval have different controls. GPTBot and ClaudeBot are training crawlers; search restrictions are assessed separately.
Every finding prints the line that triggered it and the fix. A number you cannot audit is a sales instrument, not a diagnostic.
The checker never requests a URL. Your staging hosts and internal paths stay out of everyone's logs, including ours.
HONEST LIMITS
SUPPORT AND SECURITY
A rule that fires on correct output is a bug and we want to hear about it. Open an issue with the input that triggered it. If you find something with security impact, report it privately instead.
FREE · OPEN SOURCE · NOTHING LEAVES YOUR TAB
Start with a file you publish. Review the evidence, fix the relevant issue and check actual deployed behaviour separately.