...
You can add data-sj-noindex
anywhere in a page and it will not be indexed. Most commonly this will be defined in the header <head>
of an HTML page as follows:
Locate the
<header>
<head>
tag of the page you want to prevent from being crawled.Add the following code within the header
<head>
:<meta name="robots" content="noindex" data-sj-noindex />
Save the changes. The crawler will ignore this page next time it comes across it.
...
Advanced crawler documentation Page Properties
hidden | true |
---|