Merging plugins: the meta-robots WordPress plugin
I've merged a couple of plugins into one plugin, creating the meta-robots plugin. This plugin is able to add all meta robots tags you'd possibly wish to add to pages.
I've merged a couple of plugins into one plugin, creating the meta-robots plugin. This plugin is able to add all meta robots tags you'd possibly wish to add to pages.
© 2003-2012 Joost de Valk
Yoast.com is a property of Yoast BV.
Theme by W3 EDGE, WordPress Experts
by Gerben Coumou on 22 August, 2007 at 09:16
Joost, this is a very effective plugin: nice work!
Is it possible to add a Noindex, Follow option for Archives (Category, Author and Date pages) as well? In my opinion these pages are just some 'predefined' search queries. Without tweaking them, they generate too much duplicate content anyway.
Furthermore I suggest adding the following lines to any WordPress’ robots.txt:
Disallow: /wp-admin/
Disallow: /wp-login.php
Disallow: /wp-register.php
Disallow: /*/feed/
by Joost de Valk on 22 August, 2007 at 20:37
Good idea Gerben, I just added the possibility to noindex the login, register and admin pages, making the first three unnecessary. With the release of WordPress 2.3, the last will be unnecessary as well :)
You'll have to update to version 1.1 :)
by George on 26 August, 2007 at 12:03
Should I actually see a robots.txt file in my blog root folder? I see nothing there.
Also, curious on your thoughts on WordPRess robots.txt files from this post:
http://www.johntp.com/2007/03/29/create-a-robotstxt-file-and-increase-your-search-engine-rankings/
He seems to think much more should be blocked than your plugin allows for.
by Joost de Valk on 26 August, 2007 at 14:07
Hey George: no you shouldn't see a robots.txt, this plugin uses the <meta name="robots" content="noindex"> way of blocking the spiders.
As far as the post you refer to is concerned: I see no reason for blocking wp-content, as all the uploaded files are in there, the plugin allows you to block all the feeds, and in a previous post I explained how to make trackbacks 301 instead of blocking it. And his way of blocking trackback URL's won't work anyway as it should be /*/trackback/ :)
by George on 26 August, 2007 at 20:37
Joost - Thanks for the feedback, and for the plugin. Editing the redirect file now!
by Joost de Valk on 26 August, 2007 at 22:46
My pleasure George :)
by Martin Malden on 16 March, 2009 at 00:50
Hi Joost,
This is a great plugin - thanks!
Can you tell me the meaning of this tag:
Specifically - what does the content value 'all' refer to?
Many thanks!
Martin.
by Sébastien Méric on 4 September, 2009 at 20:04
Hi,
May i suggest you to add support for custom taxonomies template page the same way you did for tags ?
Thank you very much for all your work.
Séb.