Noindex

From IndieWeb


noindex is an instruction you can put in a page (meta tag or HTTP header) to designate a specific URL on your domain that you do not want robots to index.

How to

Add this meta tag to the page:

<meta name="robots" content="noindex">

An important note from Google:

Important: For the noindex rule to be effective, the page or resource must not be blocked by a robots.txt file, and it has to be otherwise accessible to the crawler. If the page is blocked by a robots.txt file or the crawler can't access the page, the crawler will never see the noindex rule, and the page can still appear in search results, for example if other pages link to it.

More information: https://www.robotstxt.org/meta.html

See Also