User-agent: * Disallow: /wiki/ Disallow: /Special: Crawl-Delay: 4 User-agent: AhrefsBot Disallow: /