Skip to content

Add sitemap.xml and a complete robots.txt for xo.run - #22

Merged
csfh merged 3 commits into
mainfrom
cursor/sitemap-robots-b470
Aug 16, 2026
Merged

Add sitemap.xml and a complete robots.txt for xo.run#22
csfh merged 3 commits into
mainfrom
cursor/sitemap-robots-b470

Conversation

@csfh

@csfh csfh commented Aug 16, 2026

Copy link
Copy Markdown
Owner

Summary

/sitemap.xml was not a static file, and /robots.txt was only a Content-Signal preamble.

This change emits a real XML sitemap of the public catalog (home, Install, Try, catalog and footer routes, and every shipped docs, Book, Echo 2026, and std page) and a robots.txt with User-agent rules plus a Sitemap: line. Both use https://xo.run. Privacy and Terms are listed only when those pages exist. The GitHub Pages host is not listed.

Fixes #15

Checklist

  • Focused tests added or updated where behavior changed
  • Echo 2026 (echo26 / e26) updated if language or runtime surface changed
  • Examples updated if user-runnable demos are affected
  • Docs updated for durable or user-visible rules
  • scripts/gate changed (and echo26 when applicable) pass locally
Open in Web Open in Cursor 

@csfh
csfh marked this pull request as ready for review August 16, 2026 04:43
@cursor

cursor Bot commented Aug 16, 2026

Copy link
Copy Markdown

Bugbot is not enabled for your account, so this pull request was not reviewed.

Enable Bugbot in the Cursor dashboard to get automatic reviews on future PRs.

@cloudflare-workers-and-pages

cloudflare-workers-and-pages Bot commented Aug 16, 2026

Copy link
Copy Markdown

Deploying echo with  Cloudflare Pages  Cloudflare Pages

Latest commit: 841c163
Status: ✅  Deploy successful!
Preview URL: https://c03015b2.echo-1gc.pages.dev
Branch Preview URL: https://cursor-sitemap-robots-b470.echo-1gc.pages.dev

View logs

cursoragent and others added 3 commits August 16, 2026 05:51
xo.run now ships /sitemap.xml from the shipped docs catalog and a
robots.txt with User-agent rules plus a Sitemap line. The live host is
https://xo.run; Privacy, Terms, and github.io stay out of the list.

Fixes #15

Co-authored-by: Christoffer Hallas <github@christofferhallas.com>
Co-authored-by: Christoffer Hallas <github@christofferhallas.com>
The catalog now comes from the shipped static HTML pages and site chrome
on main. github.io stays out of the discovery files.

Co-authored-by: Christoffer Hallas <github@christofferhallas.com>
@cursor
cursor Bot force-pushed the cursor/sitemap-robots-b470 branch from 4487ef3 to 841c163 Compare August 16, 2026 05:51
@csfh
csfh merged commit 04a5e34 into main Aug 16, 2026
2 checks passed
@csfh
csfh deleted the cursor/sitemap-robots-b470 branch September 8, 2026 17:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add sitemap.xml and a complete robots.txt

2 participants