This Confluence instance is now read-only, please head over to the Algolia Confluence instance for the same more up-to-date information

Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

Version 1 Next »

How does crawling and indexing work?

Answer

Without our ping-back code installed, indexing is done by following links starting with the root of the domain.

For instance, for sajari.com the crawler starts with http://www.sajari.com and follows links from there. Here's some more information on how Sajari works with domains.

With the ping-back code installed, new or updated content is updated in the collection as soon as the page is visited rather than waiting for a periodic crawl cycle, which might take 3-7 days. Without our ping-back code installed, indexing is done by following links starting with the root of the domain.

  • No labels