Finding crawl issues with Crawl Score

A while ago I got an email from Dan Frost, who found me through DaveN’s blog, if I wanted to participate in the beta of Crawl Score. Crawl Score is an online service to detect crawling issues with your site. It crawls your site, and generates sitemaps for for instance Google and Yahoo! while doing that.

Crawl Score logoI liked the tool back then, and provided some feedback to Dan. Today Dan e-mailed me that Crawl Score was now released in version 1, and immediately ordered a sponsored review from me to show it to you, my readers. I of course happily said yes to that, and started looking at the tool again.

What does it do?
Well, it crawls your site, and creates pretty reports from the data it gathers while doing that. When I started doing this review, I made it crawl this site again, to see what it came up with and be able to make screenshots for you people.

First off, this is the menu that it gives you, which immediately shows you that is has a very slick interface (made it a bit smaller to fit):

Crawl Score menu

The report that is now highlighted, the 200 report, shows all “normally” accessible pages within your site, and looks like this:

Crawl Score 200 report

You can then click on a page title to get a summary for that page, which looks like this:

Crawl Score page summary

As you can see there’s a small bug there, it’s mixing up the keywords and the description, but the information is very complete and useful.

Another nice feature is the reporting of duplicate titles and descriptions, for instance this duplicate title report for my blog:

Crawl Score Duplicate titles report

This is only a small sample of the reports it gives, and I think this can be a very useful tool. It has some bugs, and it will probably improve a lot over the coming months. You should probably check the features page if this interests you.

If you use this service to take care of a few websites, the basic subscription will be good enough, and will only set you back $99.99 for 3 months, which translates into like €67 at the moment.

So, is it worth it?
If you consider how easy this service makes some stuff, I think it’s well worth it! You might say “Google Webmaster Tools can give me this info too”. First of all: not all of it, and secondly: have you found the crawl now button in Google Webmaster Tools yet? No? You won’t. There is none. You can use this tool when you want it, and get the data at the time you need. Of course this tool isn’t finished yet, but I seriously think this could be a good addition to the webmasters’ toolbox.

If you want your product or service to be reviewed like this as well, see the sponsored reviews section of my advertising page!

Tags: ,

Check out our WordPress SEO Premium plugin

6 Responses

  1. Tudor MateescuBy Tudor Mateescu on 5 February, 2008

    nice tool but pretty expensive.

    for finding broken links you could use xenu.

    i’m wonder if there are any other tools like this but free :D

  2. HenriBy Henri on 5 February, 2008

    Nice tool, but indeed expensive. With a combi of other tools you can get the same result.

  3. DanBy Dan on 5 February, 2008

    Hi Tudor

    Thanks for the feedback.

    If you consider the amount of bandwidth and server resource (let alone development costs!) we think it’s extremely cheap.

    I’m not saying Crawl Score is perfect but I think it’s unlikely that anything that taken as long as Crawl Score to develop would be free!

    If you’re suggesting that Google Webmaster Tools is the same but free then I’m afraid we’ll have to disagree :)


  4. Web MonkeyBy Web Monkey on 7 February, 2008

    $19.99 isn’t expensive. I’ve been using the system when it was in Beta and as a web designer and SEO consultant one of my clients associates wanted a site review on Monday.

    I charged them £500 for a report, most of which was pulled from CrawlScore. Thats about £490 profit for 2 hours work.

  5. Joost de ValkBy Joost de Valk on 7 February, 2008

    @Web Monkey: that’s a rip off ;)

  6. WebMonkeyBy WebMonkey on 8 February, 2008

    It’s not that scandalous is it [whistle][cough]? It would have taken a lot longer without apps like these, and I even through in a free site map export into google web master tools, my client was very happy about that.