...
Additionally you can use crawling rules to programmatically exclude sections or certain pages of your web site. You can also set individual pages to not be indexed from the data sources tab of the admin Console.
Related articles
From our documentation
📄 Advanced crawler documentation
| Filter by label (Content by label) | ||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
Related documentation
Advanced crawler documentation
| Page Properties | ||
|---|---|---|
| ||
|