Yoast: Reading about google's bug bounty program; I'm curious whether a patch bounty program for my #WordPress plugins would work... ReTweet Reply

Merging plugins: the meta-robots WordPress plugin

I've merged a couple of plugins into one plugin, creating the meta-robots plugin. This plugin is able to add all meta robots tags you'd possibly wish to add to pages.

Tags:
Category: WordPress
You can skip to the end and leave a response.

8 Responses to “Merging plugins: the meta-robots WordPress plugin

Joost, this is a very effective plugin: nice work!
Is it possible to add a Noindex, Follow option for Archives (Category, Author and Date pages) as well? In my opinion these pages are just some 'predefined' search queries. Without tweaking them, they generate too much duplicate content anyway.
Furthermore I suggest adding the following lines to any WordPress’ robots.txt:
Disallow: /wp-admin/
Disallow: /wp-login.php
Disallow: /wp-register.php
Disallow: /*/feed/

Good idea Gerben, I just added the possibility to noindex the login, register and admin pages, making the first three unnecessary. With the release of WordPress 2.3, the last will be unnecessary as well :)

You'll have to update to version 1.1 :)

Should I actually see a robots.txt file in my blog root folder? I see nothing there.

Also, curious on your thoughts on WordPRess robots.txt files from this post:

http://www.johntp.com/2007/03/29/create-a-robotstxt-file-and-increase-your-search-engine-rankings/

He seems to think much more should be blocked than your plugin allows for.

Hey George: no you shouldn't see a robots.txt, this plugin uses the <meta name="robots" content="noindex"> way of blocking the spiders.

As far as the post you refer to is concerned: I see no reason for blocking wp-content, as all the uploaded files are in there, the plugin allows you to block all the feeds, and in a previous post I explained how to make trackbacks 301 instead of blocking it. And his way of blocking trackback URL's won't work anyway as it should be /*/trackback/ :)

Joost - Thanks for the feedback, and for the plugin. Editing the redirect file now!

My pleasure George :)

Hi Joost,

This is a great plugin - thanks!

Can you tell me the meaning of this tag:

Specifically - what does the content value 'all' refer to?

Many thanks!

Martin.

Hi,

May i suggest you to add support for custom taxonomies template page the same way you did for tags ?

Thank you very much for all your work.

Séb.

Comments closed, if you feel you have something to say:
drop me a line.