Can Sajari index password protected sites?

Answer

Yes! It is possible to index login-protected pages.

You can whitelist our crawler (via user agent) so that we can index your login-protected website pages. You can do this by allowing requests that have “Sajaribot -“ at the start of the user-agent.

Alternatively, you can also whitelist our crawler using IP addresses. However, as the IP addresses change, it will only be a temporary fix. Contact us for a list of current IP addresses or for more information.