Update to Robots Meta plugin

I’ve fixed a few bugs in the Robots Meta plugin which might have caused the disabling of certain pages not to work, due to the fact that I was a sloppy in whether certain variables were in scope or not. Also certain stuff was deprecated or it’s functionality has changed within WordPress since the inception of this plugin, so I had to change it.

In the process I’ve also added another option, which takes a bit more explanation: sometimes, people will link to your search results (like to Matt, for instance). I wanted to make this impossible on my sites, without disabling the search function. So know if you search on this site, you’ll get your normal search results. If you search without a referrer from this blog though, you will be 301 redirected to the homepage.

In all, this was a badly needed update, so please upgrade to 2.9.1 ASAP. You can download it here.


Yoast.com runs on the Genesis Framework

Genesis theme frameworkThe Genesis Framework empowers you to quickly and easily build incredible websites with WordPress. Whether you're a novice or advanced developer, Genesis provides you with the secure and search-engine-optimized foundation that takes WordPress to places you never thought it could go.

Read our Genesis review or get Genesis now!

27 Responses

  1. Don MeltonBy Don Melton on 14 January, 2008

    During code inspection of version 2.9.1 of your “robots-meta.php” source file I noticed a typo which would prevent adding meta tags to rss feeds. I haven’t confirmed it by testing yet but I wanted you to know right away. Here’s the bug:

    Line 740 of your “robots-meta.php” contains:

        add_action('commentrss2_head', 'noindex_feed');

    And here’s line 24 of “wp-includes/feed-rss2-comments.php” from WordPress version 2.3.2:

        <?php do_action('commentsrss2_head'); ?>

    I think you’ve misspelled the action name “commentsrss2_head” as “commentrss2_head.” Notice missing “s” between “comment” and “rss2_head” in your version. So I don’t see how the “noindex_feed” function would ever be called.

    My apologies ahead of time if I’m in error about this.

  2. Don MeltonBy Don Melton on 14 January, 2008

    To clarify my last comment, this is only an issue for “comment” feeds. It doesn’t affect feeds to entries.

    My apologies for leaving that single word out the last time. :)

  3. Joost de ValkBy Joost de Valk on 14 January, 2008

    Hehe Don, I think you’re right… I’ll check up on it later today and release 2.9.2 if nesc. Thx!

  4. Joost de ValkBy Joost de Valk on 14 January, 2008

    Yup, you’re right. 2.9.2 released! (Weird that I never noticed that…)

  5. Seotaal BlogBy Seotaal Blog on 15 January, 2008

    After a hard day of work I somethimes even’t cann’t find an missing if statement. So it isnt that weird ;).

  6. gadgetBy gadget on 21 January, 2008

    I’ve installed the excellent Robots plugin but I’m still not clear on what areas to apply the ‘nofollow’ tag to as I want as to be indexed but clearly want to avoid duplication. Does anyone have any best practices?

  7. Joost de ValkBy Joost de Valk on 21 January, 2008

    @gadget: that’s worth a post in itself :)

  8. peterBy peter on 31 January, 2008

    First thanx for this plugin!!
    I Still have two questions:
    1. Is it possible that the 2.9.2 update still shows up as 2.9.1 in the wordpress plugin page?
    2. I cant´t manage to get the categories set to no follow on my homepage. They are still follow. Everything is fine on the single posts sites. Any idea? Thanx in advance!

  9. Nicola BoschettiBy Nicola Boschetti on 9 February, 2008

    Hello Joost,

    thanks for the plugin.

    It works out ok, but there is a problem: i have inserted custom rules in my .htaccess file, when i edit a post putting the “noindex,follow” tag (using your plugin) it reverts the .htaccess file to a previous settings, erasing my customization.

    Is there a way for the plugin to write the .htaccess file while keeping intact my own rules?

    Thanks in advance :)

  10. Joost de ValkBy Joost de Valk on 9 February, 2008

    @Nicola: it’s not supposed to be writing the .htaccess then, really sure the problem is in there?

  11. Nicola BoschettiBy Nicola Boschetti on 9 February, 2008

    Hello Joost, thanks for your reply :-)

    Well, i did some more text, and i must admit that the problems is not your plugin ;-)

    The problem is:
    1) i upload my own .htaccess file
    2) when i go to Manage->Pages and i edit 1 page, just by pressing the “save” button, the .htaccess file it reverts to the default one (the default permalink)

    Sorry for posting this here… btw are you aware of my problem?

  12. Nicola BoschettiBy Nicola Boschetti on 19 February, 2008

    Hello Joost,

    this is Nicola again.

    I analyzed my website with a “page analyzer” on seochat.con website, and it tells me that it should be suggested to put the tag “index,follow” on the homepage… you told us that, in case of missing tag, this is the default option, but what do you think of letting your plugin placing it?

    Thanks, Nicola

  13. Joost de ValkBy Joost de Valk on 19 February, 2008

    Hi Nicola, there really is no need to EVER add index,follow to a page.

  14. Nicola BoschettiBy Nicola Boschetti on 19 February, 2008

    It’s ok Joost,

    i am just wondering why the SeoChat Page Analyzer reports an error on that missing tag…

  15. MikeBy Mike on 6 March, 2008

    Thanks for the great plugin and your effort :)

  16. JackBy Jack on 13 March, 2008

    Hi Joost, i would like to bring this problem with robots meta plugin to your attention… http://wordpress.org/support/topic/160648 even i faced the same problem.

  17. Scott ClarkBy Scott Clark on 18 June, 2008

    I was so hoping to use this but with my WP (latest) install, this plug in

    a) disables WSYIWYG editing on posts – other authors want this…
    b) interrupts normal admin operation in WordPress

    So I’ve had to remove it :-(

  18. Joost de ValkBy Joost de Valk on 18 June, 2008

    @Scott Clark: which other plugins are you using? i’m afraid robots meta is colliding with one…

  19. Scott ClarkBy Scott Clark on 18 June, 2008

    Akismet 2.1.5
    Challenge 1.1 http://lordchaos.dominatus.net/
    Clicky Web Analytics 0.3b
    Mybloglog Widget 2.0
    Subscribe me 3.10 http://www.semiologic.com/
    Wordpress database backup 1.8 http://www.skippy.net/

  20. KevinBy Kevin on 8 September, 2008

    I noticed that after installing your plugin that the ‘Robots Meta’ tab appears when editing a post allowing me to assign follow/nofollow or index/noindex. By default nothing is selected for a post. Do I have to manually select ‘follow/index’ for my new post? Does this apply for editing a post that was there prior to adding Robots Meta (nothing selected)?

    Thanks for the plugin and your help!

  21. DezBy Dez on 26 September, 2008

    I can’t seem to figure out what is probably simple and obvious:

    To verify my site with the various Webmaster Tools, what syntax do I use to have Robots-Meta insert the verification code for me?

    So for example, Google gives you the following to add to your header:

    {meta name=”verify-v1″ content=”LotsNumbersAndLetters” /}

    (I changed < to { so they’ll show in the comment, of course.)

    What part of that do I add to the appropriate field in Robots-Meta for it to work properly. I could swear I’ve tried everything but apparently my capacity to handle basic deductive reasoning must be faltering.

    Can anyone resolve this little mystery for me?


  22. Sergey DmitrievBy Sergey Dmitriev on 13 March, 2009

    How do I uninstall robots meta 1.1?
    I want to upgrade to the new version, but somehow robots meta destroyed the plugins menu in wordpress. If I click on plugins menu, I always land on robots meta plugin configuration page, and I dont have the possibility to save (I get “You cannot edit the Robots Meta options.” error). Any suggestions about how can I clean up this?

  23. JenniferBy Jennifer on 28 May, 2009

    We installed the plugin but then deactivated bc carrots “>”< appeared at the top of our header. Do you know why we would have carrots appear?

  24. DumberBy Dumber on 31 July, 2009

    Sorry – dumb question…

    I noticed that after installing your plugin that the ‘Robots Meta’ tab appears when editing a post allowing me to assign follow/nofollow or index/noindex…..

    Is this the rule I want to apply for the post itself or for all the links out of the post `?

  25. MarkBy Mark on 2 October, 2009

    Also regarding the “Robots Meta” tab that appears while in the editing page. I am wondering if it is possible to make that tab/widget available to only administrators? I am making a wiki style site, and I don’t want to provide too many options for users that will just confuse them when they are editing posts.

  26. AmanBy Aman on 7 October, 2009

    Hi, I have got a big problem. I am using wordpress 2.7 and a few days back I updated the Robots-meta to latest version. After that whatever I have posted is not getting indexed in google. Earlier it used to get indexed in less then 2-3 hours.