Advanced Search

Robots.txt to hide directory without revealing directory's name

/ Published in: HTML
Save to your folder(s)
Hides directories from robots without revealing the names of the directories. Robot ignores directory names starting with first two characters.

Expand | Embed | Plain Text

Copy this code and paste it in your HTML 
  1. # robots.txt for http://www.apimagazine.com.au/
  2. User-agent: *
  3. Disallow: /as
  4. Disallow: /ca
  5. Disallow: /cg
  6. Disallow: /do
  7. Disallow: /la
  8. Disallow: /ma
  9. Disallow: /op
  10. Disallow: /st
  11. Disallow: /te

Report this snippet


Comments

RSS Icon Subscribe to comments

You need to login to post a comment.