Sitemap Sitemaps can be helpful in pointing our crawler to webpages that are not internally linked within your website. When you add a new domain, we look for a sitemap at the root (e.g. www.website.com/sitemap.xml) of the domain and index all the links on the sitemap.
...
Check if the sitemap exists on your website by going to www.yourwebsite.com/sitemap.xml. If a sitemap is already present, skip to 3.
If the sitemap is missing, then ask your website developer or technical team to add a sitemap to your website. For more information on standard XML sitemaps please see:
Sitemap must be named The name of the sitemap must end with "sitemap.xml" in order to be crawled. It can be located under any directory (e.g. www.yourwebsite.com/site/first-sitemap.xml)
Log in to your console and select the relevant collection.
Navigate to Domains section and click on "Diagnose".Enter the Crawler crawl statuses section.
In the textbox underneath the page heading, enter the URL of the sitemap, e.g. www.yourwebsite.com/sitemap.xml as the URL and press "Diagnose".
It will return a message "Page not found in the index." Press "Add to Index"A modal will pop up showing that the URL has not been crawled.Click "Crawl page".
The sitemap will be indexed and it pages will start being added to your collection. It might take a few minutes or a few hours depending on the amount number of pages on your website and load the number of pages waiting in our index queues.
If you click on "See extended debug informationOpen in page debugger", you might see a MIME error on in the Page Debug tool. This error can be ignored, and your sitemap and all the links on your sitemap will be indexed.
...
| Filter by label (Content by label) | ||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|