/ Published in: Apache
Before taking a site "live", I password protect it except the robots.txt for search engines and custom Error pages. You can adapt this to your own use and add other pages in the FilesMatch directive.
URL: http://www.webmasterworld.com/apache/4051548.htm