Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

What level of customization can be applied to how Sajari search.io crawls my site?

Answer

You can setup a variety of rules for crawling your site.

From your Console, you can choose what domains are stored in your collection, and if crawling is active for each domain.

You can also create exclude rules based on URL structure, domain, and a variety of metadata.

Exclude rules will remove all matching records from your collection, and Sajari search.io will not re-crawl any records that match in the future.

...