Crawl directives archives


Ask Yoast: Should I redirect my affiliate links?

6 February 2017 by Joost de Valk - 1 Comment

There are several reasons for cloaking or redirecting affiliate links. For instance, it’s easier to work with affiliate links when you redirect them, plus you can make them look prettier. But do you know how to cloak affiliate links? We explained how the process works in one of our previous posts. This Ask Yoast is …

Read: "Ask Yoast: Should I redirect my affiliate links?"

Ask Yoast: Nofollow layered navigation links?

30 January 2017 by Joost de Valk - 4 Comments

If you have a big eCommerce site with lots of products, layered navigation can help your users to narrow down their search results. Layered or faceted navigation is an advanced way of filtering by providing groups of filters for (many) product attributes. In this filtering process, you might create a lot of URLs though, because the user …

Read: "Ask Yoast: Nofollow layered navigation links?"

How to cloak your affiliate links

24 January 2017 by Joost de Valk - 11 Comments

We regularly consult for sites that monetize, in part, with affiliate links. We usually advise people to redirect affiliate links. In the past, we noticed that there wasn’t a proper script available online that could handle this for us, so we created one to tackle this problem. In this post, I explain how you can get …

Read: "How to cloak your affiliate links"

Playing with the X-Robots-Tag HTTP header

3 January 2017 by Joost de Valk - 2 Comments

Traditionally, you will use a robots.txt file on your server to manage what pages, folders, subdomains or other content search engines will be allowed to crawl. But did you know that there’s also such a thing as the X-Robots-Tag HTTP header? Here, we’ll discuss what the possibilities are and how this might be a better …

Read: "Playing with the X-Robots-Tag HTTP header"





WordPress robots.txt example for great SEO

26 April 2016 by Joost de Valk

The robots.txt file is a very powerful file if you’re working on a site’s SEO. At the same time, it also has to be used with care. It allows you to deny search engines access to certain files and folders, but that’s very often not what you want to do. Over the years, especially Google changed …

Read: "WordPress robots.txt example for great SEO"
noindex a post with meta robots noindex


Browse other categories