Revision: 12864
Initial Code
Initial URL
Initial Description
Initial Title
Initial Tags
Initial Language
at March 30, 2009 22:13 by hotdiggity
Initial Code
# robots.txt for http://www.apimagazine.com.au/ User-agent: * Disallow: /as Disallow: /ca Disallow: /cg Disallow: /do Disallow: /la Disallow: /ma Disallow: /op Disallow: /st Disallow: /te
Initial URL
Initial Description
Hides directories from robots without revealing the names of the directories. Robot ignores directory names starting with first two characters.
Initial Title
Robots.txt to hide directory without revealing directory's name
Initial Tags
Initial Language
HTML