Sitemap Freshness Check
A crawlability loop for content sites and directories that publish new pages frequently.
Use loop copies the kickoff prompt. Copy Markdown and Download loop include the complete Markdown page with context, source attribution, anchors, and guardrails. Cursor / Claude Code buttons prepare the shorter kickoff prompt only.
Supported agents
Goal
Ensure sitemap.xml includes canonical public pages and excludes private/admin/API routes.
Feedback gate
curl -sL $SITE_URL/sitemap.xmlStop condition
Sitemap contains important public URLs and excludes private/API/admin pages.
Give the agent these inputs before it starts the loop. This keeps discovery bounded and prevents vague retries.
The loop assumes these commands or integrations are available. Missing tools should be reported as blockers, not ignored.
Two separate pieces: the kickoff prompt starts the loop, while the downloaded Markdown carries the complete reference page.
1. Copy or download
Use the kickoff for a fast agent run. Download the full Markdown when you need source, context, and attribution in one file.
2. Paste into the agent
Start a fresh agent session in the target repo and provide the requested project context if the loop asks for it.
3. Let it self-pace
The agent should act, check evidence, retry only when the gate fails, and stop at the stated exit condition.
The diagram shows the order. This checklist keeps only the action, command, and failure handling needed during a real pass.
1. Fetch sitemap
Download the XML sitemap.
curl -sL $SITE_URL/sitemap.xml2. Compare expected URLs
Check loop, category, agent, and guide URLs.
3. Check exclusions
Ensure admin, settings, API, and arbitrary filtered query pages are not listed.
4. Patch generator
Update sitemap route and re-fetch.
This is the text copied by Use loop. It is intentionally shorter than the Markdown export.
Fetch sitemap.xml, compare it against expected public URLs, check exclusions, patch the generator, and re-fetch until coverage is correct.
Goal: Ensure sitemap.xml includes canonical public pages and excludes private/admin/API routes.
Check command: curl -sL $SITE_URL/sitemap.xml
Exit condition: Sitemap contains important public URLs and excludes private/API/admin pages.
Max iterations: 3
Guardrails:
- Do not weaken, skip, delete, or rewrite the validation command to force success.
- Do not claim completion until the stated exit condition is actually satisfied.
- If blocked, report the blocker, evidence, and next safest action instead of gaming the metric.
- Do not include private, admin, API, or duplicate query URLs in sitemap.Quality
88/100
Safety
95/100
Expected output
Sitemap coverage report listing missing, stale, or wrong URLs.
Related loops
Browse allSEO Metadata Audit Loop
Audit title, description, canonical, Open Graph, headings, and indexability for SEO-critical pages.
Kickoff preview
Audit SEO metadata from server-rendered HTML for the target pages. Verify title, description, canonical, H1, Open Graph, and indexability, then fix and re-check. Goal: Ensure SEO-critical pages have unique, server-rendered metadata and indexable content. Check command: curl -sL $URL | head -80 Exit condition: Each target page has unique title, description, canonical, visible H1, and no accidental noindex. Max iterations: 5 Guardrails: - Do not weaken, skip, delete, or rewrite the validation command to force success. - Do not claim completion until the stated exit condition is actually satisfied. - If blocked, report the blocker, evidence, and next safest action instead of gaming the metric. - Do not rely only on client-rendered metadata for SEO-critical pages. Verify server HTML.
GSC Indexing Debug Loop
Diagnose why a page is not indexed by checking robots, sitemap, canonical, status code, content quality, and internal links.
Kickoff preview
Debug indexing for the target URL: status, robots, canonical, noindex, sitemap, internal links, and content usefulness. Return exact fixes and uncertainty. Goal: Find technical or content reasons a page may not be indexed. Check command: curl -I $URL Exit condition: The page is technically indexable and remaining indexing uncertainty is clearly documented. Max iterations: 4 Guardrails: - Do not weaken, skip, delete, or rewrite the validation command to force success. - Do not claim completion until the stated exit condition is actually satisfied. - If blocked, report the blocker, evidence, and next safest action instead of gaming the metric. - Do not promise indexing. Only verify technical readiness and recommend fixes.
Internal Link Builder Loop
Find orphan or weak pages and add relevant internal links from hubs, related pages, and contextual sections.
Kickoff preview
Find weak or orphan pages, choose relevant source pages, add natural internal links, and verify the rendered pages expose those links. Goal: Improve crawlability and user navigation through relevant internal links. Check command: curl -sL $SITEMAP_URL Exit condition: Priority pages are linked from relevant hub/detail pages with natural anchors. Max iterations: 4 Guardrails: - Do not weaken, skip, delete, or rewrite the validation command to force success. - Do not claim completion until the stated exit condition is actually satisfied. - If blocked, report the blocker, evidence, and next safest action instead of gaming the metric. - Do not add irrelevant keyword-stuffed links. User usefulness comes first.
Ship PR Until Green
Implement a scoped change, open or update a pull request, inspect CI, and continue until all required PR checks pass.
Kickoff preview
Take this branch to a green pull request. Implement the requested change, run local verification, open or update the PR, run `gh pr checks`, inspect failures, fix root causes, and repeat until every required check passes or you hit the iteration cap. Goal: Open or update a pull request and stop only when all required PR checks are green. Check command: gh pr checks Exit condition: All required pull request checks are successful and the PR is ready for review or merge. Max iterations: 10 Guardrails: - Do not weaken, skip, delete, or rewrite the validation command to force success. - Do not claim completion until the stated exit condition is actually satisfied. - If blocked, report the blocker, evidence, and next safest action instead of gaming the metric. - Do not disable required checks, edit loops to skip jobs, or remove tests to make CI green. - Do not merge the PR unless the user explicitly asked for merge authority.