Wordpress: Robots.txt tricks

/ Published in: Apache
Save to your folder(s)

Sometimes you don't want robots snooping around certain files. Here's one example of a custom configuration.

Copy this code and paste it in your HTML
  1. # Disallow indexing of WordPress scripts
  2. User-agent: *
  3. Disallow: /wp-admin/
  4. Disallow: /wp-includes/
  5. Disallow: /wp-content/plugins/
  6. Disallow: /wp-content/themes/
  7. Disallow: /feed/
  8. Disallow: */feed/

Report this snippet


RSS Icon Subscribe to comments

You need to login to post a comment.