This Confluence instance is now read-only, please head over to the Algolia Confluence instance for the same more up-to-date information

Skip to end of metadata
Go to start of metadata

You are viewing an old version of this content. View the current version.

Compare with Current View Version History

« Previous Version 4 Next »

Can Sajari index password protected sites?

Answer

Yes! It is possible to index login-protected pages.

You can whitelist our crawler (via user agent) so that we can index your login-protected website pages. You can do this by allowing requests that have “Sajaribot -“ at the start of the user-agent.

Alternatively, you can also whitelist our crawler using IP addresses. However, as the IP addresses change, it will only be a temporary fix. Contact us for a list of current IP addresses or for more information.

  • No labels