Disallow

From IndieWeb
Jump to: navigation, search


Disallow is an instruction you put in a robots_txt file to designate a specific URL path on your domain that you do not want robots to retrieve or index.