Merging plugins: the meta-robots WordPress plugin

I’ve merged a couple of plugins into one plugin, creating the meta-robots plugin. This plugin is able to add all meta robots tags you’d possibly wish to add to pages.

Tags:


Yoast.com runs on the Genesis Framework

Genesis theme frameworkThe Genesis Framework empowers you to quickly and easily build incredible websites with WordPress. Whether you're a novice or advanced developer, Genesis provides you with the secure and search-engine-optimized foundation that takes WordPress to places you never thought it could go.

Read our Genesis review or get Genesis now!

8 Responses

  1. Gerben CoumouBy Gerben Coumou on 22 August, 2007

    Joost, this is a very effective plugin: nice work!
    Is it possible to add a Noindex, Follow option for Archives (Category, Author and Date pages) as well? In my opinion these pages are just some ‘predefined’ search queries. Without tweaking them, they generate too much duplicate content anyway.
    Furthermore I suggest adding the following lines to any WordPress’ robots.txt:
    Disallow: /wp-admin/
    Disallow: /wp-login.php
    Disallow: /wp-register.php
    Disallow: /*/feed/

  2. Joost de ValkBy Joost de Valk on 22 August, 2007

    Good idea Gerben, I just added the possibility to noindex the login, register and admin pages, making the first three unnecessary. With the release of WordPress 2.3, the last will be unnecessary as well :)

    You’ll have to update to version 1.1 :)

  3. GeorgeBy George on 26 August, 2007

    Should I actually see a robots.txt file in my blog root folder? I see nothing there.

    Also, curious on your thoughts on WordPRess robots.txt files from this post:

    http://www.johntp.com/2007/03/29/create-a-robotstxt-file-and-increase-your-search-engine-rankings/

    He seems to think much more should be blocked than your plugin allows for.

  4. Joost de ValkBy Joost de Valk on 26 August, 2007

    Hey George: no you shouldn’t see a robots.txt, this plugin uses the <meta name=”robots” content=”noindex”> way of blocking the spiders.

    As far as the post you refer to is concerned: I see no reason for blocking wp-content, as all the uploaded files are in there, the plugin allows you to block all the feeds, and in a previous post I explained how to make trackbacks 301 instead of blocking it. And his way of blocking trackback URL’s won’t work anyway as it should be /*/trackback/ :)

  5. GeorgeBy George on 26 August, 2007

    Joost – Thanks for the feedback, and for the plugin. Editing the redirect file now!

  6. Joost de ValkBy Joost de Valk on 26 August, 2007

    My pleasure George :)

  7. Martin MaldenBy Martin Malden on 16 March, 2009

    Hi Joost,

    This is a great plugin – thanks!

    Can you tell me the meaning of this tag:

    Specifically – what does the content value ‘all’ refer to?

    Many thanks!

    Martin.

  8. Sébastien MéricBy Sébastien Méric on 4 September, 2009

    Hi,

    May i suggest you to add support for custom taxonomies template page the same way you did for tags ?

    Thank you very much for all your work.

    Séb.