Allow

From IndieWeb
Jump to: navigation, search


Allow is an instruction you put in a robots_txt file to designate a specific URL path on your domain that you do want robots to retrieve, index, and possibly crawl further.