User-agent: * Allow: / # sitemap-INDEX, not sitemap.xml. @astrojs/sitemap emits an index plus one or # more numbered files, and this line pointed at the hand-written sitemap.xml that # the integration replaced — a robots.txt naming a 404 is worse than one naming # nothing, because it looks configured. Sitemap: https://hiddencontent.ai/sitemap-index.xml