Internal search: why and how

Internal search: why and how

April 03rd, 2017 – 12 Comments

Internal search is the search option on your own website. It’s, for instance, the search widget in WordPress and the product search in WooCommerce. Make no mistake: if your website has over twenty pages, your website should most definitely have that internal search option. There are a number of best practices for that search option, and I’d like to go over these, in this post. 

Learn how to structure your site well with our Site structure training! »

Site structure training Info

Internal search for informational websites

It doesn’t matter if your website is the Wikipedia of Golden Retrievers, or you simply have a blog about your three-year-old. If your website is packed with content, you’d really want to add that internal search option. When someone lands on your website from Google, for the most part, they are looking for a specific piece of information about a certain subject. If they can’t find it immediately after clicking that link in Google, there are only a few options to prevent that user from clicking back to Google immediately. You’d rather prevent such a bounce, as it tells Google that the specific subject isn’t something it has to rank your website for. OK, I’m exaggerating, but if this happens again and again, that will be the result.

If your website provides an easy way to find the desired information with just a tiny bit of extra effort, you’re immediately raising the chances of people staying on your website. An internal search option is a great way to accomplish this.

Characteristics of a good internal search option

Try to think about that search option as a user, not as a website owner or developer. What does that search option require to work for you? I think there are a few characteristics that are essential for any visitor:

  • It should be visible. If you want people to use that search option, don’t hide it in your website’s footer. Adding it to either the top of your sidebar, or in your header, would be a much better option.
  • It should be clear that it’s a search option. Very important. Just an input field without a heading, submit button or watermark explaining that it’s a search option won’t suffice.

We emphasized that internal search option even more in our 2015 redesign, by just subtly increasing the magnifier icon:

Internal search, yoast.com

That already made a huge difference. But besides that, we also lifted the internal search option from our sidebar, straight into the right side of the menu. The search option is equally important for us as our shopping cart and all main menu items.

Search result pages for informational websites

The search field is only step one of an internal search option. Step two is the search result page itself. When we do SEO consultancy projects, we check a number of characteristics of a search result page:

  • The search keyword is highlighted in the search result pages
    If you want to decide on what result to click, you’d like to scan the results and quickly click one. Your own search result pages are a means to an end, a tool, not a destination itself. Highlighting the keyword used in search (like Google does), simplifies scanning these results a lot.
  • The search result pages contain text snippets with the keyword
    It’s really hard to pick a result when only a title is shown on an internal search result page. There’s a reason why Google sometimes ignores your suggested meta description and shows a text snippet of your page with the keyword instead. It helps your visitor. That goes for internal search results as well.
  • Search results are ranked by relevancy
    To all you WordPress users out there: WordPress now orders search results by relevance (since 3.7). Make sure to update. That being said, plugins like SearchWP or services like Algolia can still help you improve your internal search function a lot, and make you manage that relevance. In the old days, WordPress results where ordered by date (newest content first), which made absolutely no sense. Serve the most fitting result first.
  • Internal search results are not indexed by Google
    Imagine being a search engine, aiming to serve your visitors the desired information as soon as possible. Google Knowledge Graph inserts the answer right into your search result pages. Do you think that search engines like linking to other search result pages? No. Of course not. In addition to that, Google considers these internal search results lower quality pages than your actual informational pages. So it would make absolutely no sense if your search result pages rank above your category pages on the same subject. Your informational content pages are the pages that matter, these are the pages that should be indexed. Therefore we say:  Noindex,follow your internal search result pages.

Valuable data for optimizing your website

Internal search keywords in Google AnalyticsThere is another major benefit of a good internal search option. It can actually help your keyword research. In Google Analytics, at Behavior › Site Search › Search Terms, you will find all keywords people have used in the internal search option on your website.

Please check your website’s pages for these keywords. Does the right page come up first? A quick check is simply comparing your internal search results to a site search in Google, like:

https://www.google.com/search?q=site:yoast.com+meta+description

That’s a match, and the right page to rank for “meta description” on our website. If another page would have come up first, we should have created a new, cornerstone-like page for that keyword. Use this to your advantage; it’s your visitors telling you what kind of content they expect on your website.

Custom Search Engine

Google offers an option to use their search engine for your website as well. This is called Custom Search Engine (CSE). With CSE, you can easily add an internal search option to your site. This option shows results like Google would show these for site:yoursite.com queries.

There are options to limit this search to specific parts of your website, or even a specific page. A nice option for online shops is to limit the search results using specific schema.org types like Product. If you add a certain type, all its children automatically get included.

You fill out a very simple form and simply get a JavaScript snippet you can add to your template. After creation, you can even add more details. You can include or exclude images, for example. There is also an option to add Adsense ads, but I’d recommend against using this on your online shop – that will simply redirect visitors to other websites, or even worse, make you pay for clicks on your own ads from your own website…

Internal search for online shops

This is one of two posts on internal search. As I mentioned in the introduction of this post, an internal search is obviously important for online shops as well. In the other post, I discuss the search option for online shops and add my thoughts on how to improve that internal search option.

Read more: ‘Internal search for webshops’ »

Your call

Are you leveraging your internal search option? How did you improve your internal search result pages? I’d love to hear your experiences and additional tips in the comments.


12 Responses to Internal search: why and how

  1. Shaikh
    By Shaikh on 6 April, 2017

    Thank You So Much @Michiel, From last 3 month my website Bounce Rate getting increase , I think may be one of this issue i am not using search box for internal search, Now i am going to implement on my website.

  2. Saurav
    By Saurav on 5 April, 2017

    Internal search is something we at our wordpress agency highly recommend. Even for small businesses, we keep it as they have the possibility to grow, right?

    • Michiel Heijmans
      By Michiel Heijmans on 5 April, 2017

      Yes. And learn / get keyword ideas from it. What are your visitors looking for? I recommend a site search for sites that have 20 pages/posts and up.

  3. Jon Pedersen
    By Jon Pedersen on 4 April, 2017

    So why didn’t you mention Google is shutting down Site Search permanently? As of 3 days ago, April 1/17, no more sales, & it will be dead by April 1/18. What other Google solution(s) would you suggest?

    • Michiel Heijmans
      By Michiel Heijmans on 5 April, 2017

      Hi Jon,
      Thanks for your comment :) You are obviously right. I think I just mixed up two products, Google Site Search and CSE, where CSE is what I’m writing about. Just changed that in the article.

  4. Harriet Yoder
    By Harriet Yoder on 4 April, 2017

    Excellent post! I use the SearchWP plugin (paid) with excellent results.

    They offer great support. I wanted to add product images to my search results (as it was when I used Google Custom Search). SearchWP suggested modifying my search results template which we did. It’s a great search solution for WordPress websites.

  5. Victor
    By Victor on 4 April, 2017

    It’s very good technique to retain or to focus the visitor/guest of a website to remain engaged with in the website, I have the internal search in the top of the primary panel & at the menu area for my websites, now I feel I had to focus more on creating more internal pages.

    Thanks for sharing the technique.

  6. Jane
    By Jane on 4 April, 2017

    I think internal search has just begun to be used, it has great opportunities in the future, when the competition for customer retention will become even higher.

    • Erica
      By Erica on 7 April, 2017

      In particular, you can already use internal search results in remarketing.

    • Michiel Heijmans
      By Michiel Heijmans on 5 April, 2017

      Agreed!

  7. krewjordan
    By krewjordan on 4 April, 2017

    Thanks for the wonderful blog internal site search is someone visiting your website and using the search feature on your website to find information

  8. Musica para bodas DJ Asturias
    By Musica para bodas DJ Asturias on 3 April, 2017

    Good information, I have recently implemented my pages with an internal search engine, in order to facilitate users search and navigation within it.
    Thank you


Check out our must read articles about Analytics