Apache


Preventing your site from being indexed, the right way

It keeps amazing me that I keep seeing people use robots.txt files to prevent sites from being indexed and thus showing up in the search engines. You know why it keeps amazing me? Because robots.txt doesn’t actually do the latter, even though it does prevent your site from being indexed. Let’s go through some terms…

Magento performance hosting

The system requirements of Magento are quite extensive, it requires at least PHP 5.2.0 extended with mcrypt, PDO_MySql and simplexml. For the database Magento needs at least MySQL 4.1.20 with InnoDB storage engine. At MagentoCommerce.com you can find a complete list of requirements. But how do you know if your server meets these system requirements?…

Playing with the X-Robots-Tag HTTP header

Ever since the announcement on the Google Blog and more recently Yahoo’s announcement that they’ve enhanced their support for it, I’ve been meaning to play with the X-Robots-Tag header. This HTTP header allows you to do what you’d normally do in a robots meta tag, in an HTTP header, which has some pretty cool appliances.…

How to remove www from your URL with mod_rewrite

I got a hit today for the following search query: how do you get rid of the www in url. As you can see that hits on my article about removing PHPSESSID’s, which isn’t quite what the person was looking for I guess. Here’s the code to 301 redirect the www version of your site…

Convert underscores to dashes with Apache mod_rewrite

Update: (Aug 4 2007) the stuff below is no longer necessary, all major search engines now treat underscores and dashes exactly the same, as word separators! A year or so back, I was using underscores in my URL’s on this site for spaces, and I decided to switch them to dashes, since several people, including…

Trailing double forward slashes in URL’s in the SERPs…

This query gives a result I hadn’t seen before (image), the same page was indexed with both a single trailing forward slash, which is of course normal, and with a double trailing forward slash… This is of course a duplicate content issue, especially when people link to the double slash one by accident. The fix…

Changing your WordPress date permalink structure

I recently changed the permalink structure of this WordPress blog, going from /%year%/%monthnum%/%day%/%postname%/ (WordPress default i think) to the much more elegant and simple /%postname%/. This is very cool ofcourse, both because it’s simpler and SEO wise, but on an existing blog, this leaves you with lots of links that point to the wrong URL.…