Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

You can add data-sj-noindex anywhere in a page and it will not be indexed. Most commonly this will be defined in the header <head> of an HTML page as follows:

  1. Locate the <header> <head> tag of the page you want to prevent from being crawled.

  2. Add the following code within the header <head>:
    <meta name="robots" content="noindex" data-sj-noindex />

  3. Save the changes. The crawler will ignore this page next time it comes across it.

...

Advanced crawler documentation Page Properties

hiddentrue
Related issues