Is there a special sitemap format for AI crawlers?

No — and any tool claiming to make an 'AI sitemap' is inventing a format. GPTBot, OAI-SearchBot, PerplexityBot and ClaudeBot discover URLs through the standard sitemaps.org protocol, usually by reading the Sitemap: line in your robots.txt. A clean standard sitemap.xml is exactly what they need.

Why doesn't the output include priority and changefreq?

Because Google has said for years that it ignores both fields, and other major engines followed. Including them adds bytes and false precision without changing anything. We omit them and say so, instead of generating decoration.

Why is lastmod missing from some (or all) of my URLs?

We only write lastmod when your page actually declares a modification date (article:modified_time). We never fabricate dates: search engines cross-check lastmod against real content changes, and Bing has said untruthful lastmod churn gets a sitemap distrusted entirely. A missing lastmod is better than a fake one.

How many pages can this tool handle?

Up to 200 URLs per crawl, which covers most small business and marketing sites. Larger sites should generate their sitemap from the CMS (WordPress, Shopify and most frameworks do it natively) — a crawler-based tool will always be a snapshot, while your CMS knows the real page list.

Does a sitemap check for noindex pages?

This tool dedupes by canonical URL and excludes non-HTML assets, but it does not read robots meta tags — so if some pages carry noindex, remove them from the XML before uploading. A sitemap should only list pages you want indexed.

Where do I submit the sitemap?

Upload it to your site root, reference it with a Sitemap: line in robots.txt, then submit it in Google Search Console and Bing Webmaster Tools. The robots.txt line matters most — it's how crawlers that don't use webmaster consoles, including AI crawlers, find it.

Free toolsGenerator

XML Sitemap Generator

Crawl your site and download a clean, standards-compliant sitemap.xml — truthful lastmod dates only, no decorative fields, ready for search and AI crawlers alike.

How it works

1
Enter your site URL
We crawl up to 200 pages — reading your existing sitemap first if you have one, otherwise following links — while respecting your robots.txt.
2
We build the XML
URLs are deduplicated by canonical, non-HTML assets are excluded, and lastmod is written only where your pages declare a real modification date.
3
Upload and reference it
Put sitemap.xml at your site root and add a Sitemap: line to your robots.txt so every crawler can find it.
4
Submit it
Register the sitemap in Google Search Console and Bing Webmaster Tools for reporting and faster discovery.

There is no 'AI sitemap' — and that's good news

Let's kill the myth first: no special AI sitemap format exists. AI crawlers — GPTBot, OAI-SearchBot, PerplexityBot, ClaudeBot — discover URLs through the same sitemaps.org protocol Google and Bing have used since 2006, and in practice they find your sitemap the same way: the Sitemap: line in your robots.txt. Tools selling "AI-optimized sitemaps" are selling a rename.

The good news hiding in that: the boring, standard file you already know how to make is exactly what AI search needs. Bing explicitly reaffirmed in 2025 that sitemaps with accurate lastmod dates are how its AI-powered search finds and refreshes content — and Bing's index feeds ChatGPT search. One correct sitemap.xml serves classic SEO and AI visibility at once. That's why this page cross-links our AI robots.txt generator and crawler access checker: the sitemap tells crawlers what exists, robots.txt tells them what they may read, and together they're your discovery layer.

Why we never fabricate lastmod (and skip priority entirely)

Most online sitemap generators stamp every URL with today's date as lastmod. That's worse than useless: search engines compare declared dates against observed content changes, and when the dates keep lying, they stop trusting the whole sitemap — Bing has said as much publicly. So this tool writes lastmod only when your page actually declares a modification date, via article:modified_time. If we didn't see a date, the field is omitted. An absent lastmod costs you nothing; a fake one costs you the file's credibility.

The same rigor removes priority and changefreq: Google has been on record for years that it ignores both, so we don't generate them. What you get is the minimal, valid file — XML declaration, urlset, one <loc> per canonical URL, honest dates where they exist. Duplicates collapse to their canonical, and non-HTML assets are excluded automatically. One limitation worth knowing: the tool doesn't read robots meta tags, so if some crawled pages carry noindex, delete those lines before you upload.

Scale is the other honest boundary. The crawl caps at 200 pages, which fits the sites this tool is for — small business, SaaS marketing, portfolio, docs. If your site is bigger, generate the sitemap from your CMS, which knows your real URL list; a crawl is always an outside-in snapshot.

Discovery is step one — being the answer is the goal

A sitemap gets your pages found; it doesn't decide whether AI assistants recommend you. Once your discovery layer is clean, the real question is what ChatGPT, Perplexity and Gemini actually say when a customer asks about your category. That's what the free AI Visibility Checker shows you — live grounded answers, your mention rate, and who wins instead of you.

Frequently asked questions

Is there a special sitemap format for AI crawlers?: No — and any tool claiming to make an 'AI sitemap' is inventing a format. GPTBot, OAI-SearchBot, PerplexityBot and ClaudeBot discover URLs through the standard sitemaps.org protocol, usually by reading the Sitemap: line in your robots.txt. A clean standard sitemap.xml is exactly what they need.
Why doesn't the output include priority and changefreq?: Because Google has said for years that it ignores both fields, and other major engines followed. Including them adds bytes and false precision without changing anything. We omit them and say so, instead of generating decoration.
Why is lastmod missing from some (or all) of my URLs?: We only write lastmod when your page actually declares a modification date (article:modified_time). We never fabricate dates: search engines cross-check lastmod against real content changes, and Bing has said untruthful lastmod churn gets a sitemap distrusted entirely. A missing lastmod is better than a fake one.
How many pages can this tool handle?: Up to 200 URLs per crawl, which covers most small business and marketing sites. Larger sites should generate their sitemap from the CMS (WordPress, Shopify and most frameworks do it natively) — a crawler-based tool will always be a snapshot, while your CMS knows the real page list.
Does a sitemap check for noindex pages?: This tool dedupes by canonical URL and excludes non-HTML assets, but it does not read robots meta tags — so if some pages carry noindex, remove them from the XML before uploading. A sitemap should only list pages you want indexed.
Where do I submit the sitemap?: Upload it to your site root, reference it with a Sitemap: line in robots.txt, then submit it in Google Search Console and Bing Webmaster Tools. The robots.txt line matters most — it's how crawlers that don't use webmaster consoles, including AI crawlers, find it.

Related free tools

Generator

AI Crawler robots.txt Generator

Build robots.txt rules for GPTBot, ClaudeBot, PerplexityBot and 25+ AI crawlers — allow AI search, block training, or go custom.

Checker

AI Crawler Access Checker

Check which AI bots your robots.txt allows or blocks — ChatGPT, Claude, Perplexity, Gemini and more, with the exact matching rule.

Generator

llms.txt Generator

Generate a well-formed llms.txt from your site's real structure and metadata — no AI-invented descriptions. Crawl, review, download.

Now find out what AI models actually say about your brand

These tools make your site readable to AI. The free AI Visibility Checker probes grounded AI models with live web search and shows the real answers, your score, and who wins instead of you — no login required.

Run the free AI Visibility Checker