How to Do Keyword Research: The Complete Guide

Keyword research is the foundation of every successful SEO strategy. Before you write a single word of content, before you optimise a title tag, before you build a single link, you need to understand what words and phrases your audience actually types into Google. This guide explains how to do keyword research from scratch, using a combination of free keyword research tools and structured thinking, so that every page you publish has a genuine shot at ranking.

Whether you are a blogger, an e-commerce store owner, a local business, or an agency managing dozens of client sites, the keyword research process is fundamentally the same. The specifics change — the tools you reach for, the search volumes that matter to you, the level of competition you face — but the underlying logic does not. Find the searches your audience is making, assess whether you can rank for them, and then create content that satisfies those searches better than the current results do.

This guide covers the complete keyword research process from brainstorming seed keywords all the way through to mapping keywords to pages and avoiding the most common mistakes. Use the table of contents below to jump to any section.

What Is Keyword Research and Why Does It Matter?

Keyword research is the process of discovering, evaluating, and selecting the search queries you want your website to rank for. It answers three questions: what are people searching for, how many people are searching for it, and how difficult is it to rank for?

Without keyword research you are essentially guessing. You might spend months writing content about topics nobody searches for, or you might try to compete for terms where the top results are massive authoritative sites with thousands of backlinks. Both are expensive mistakes. A solid keyword research guide prevents both by giving you data before you commit resources.

The reason keyword research matters so much is that small differences in phrasing represent very different searcher intent. "Running shoes" and "best running shoes for flat feet" are both about running shoes, but the person searching the second phrase is much further through the buying journey. Understanding intent is what separates keyword research from simple topic brainstorming.

Beyond content creation, keyword research shapes:

• Site architecture — which pages you need, how they relate to each other
• Title tag and meta description writing — see our guide to how to write title tags
• Internal linking strategy — which pages deserve the most internal authority
• Content depth and format — how long your content needs to be and what it needs to cover
• Paid search campaigns — the same keyword data informs Google Ads

In short, keyword research is the map. Everything else in SEO is the journey. Start without the map and you will get lost.

Understanding Search Intent: The Most Important Concept in Keyword Research

Search intent — sometimes called user intent or query intent — is the underlying reason behind a search. Google has become extremely good at understanding intent, which means if you target a keyword without matching its intent, you will not rank regardless of how well optimised your page is technically.

There are four main types of search intent:

1. Informational Intent

The searcher wants to learn something. Examples: "how does SEO work", "what is a canonical tag", "how to do keyword research". These searches are typically served by guides, how-to articles, definitions, and explainers. The searcher is not ready to buy — they are researching. This is the intent behind the query you are reading right now.

2. Navigational Intent

The searcher wants to find a specific website or page. Examples: "RankNibbler", "Google Search Console login", "Ahrefs keyword explorer". These searches are almost always won by the brand being searched for. Do not try to rank your competitor analysis guide for someone typing in a competitor's brand name.

3. Commercial Investigation Intent

The searcher is researching before making a purchase decision. Examples: "best keyword research tools", "Ahrefs vs SEMrush", "keyword research tool reviews". These are served by comparison articles, best-of lists, and detailed reviews. Conversions are possible but the searcher still wants to evaluate options.

4. Transactional Intent

The searcher is ready to take action — usually buy, sign up, or download. Examples: "buy running shoes online", "SEMrush free trial", "keyword research tool free". Product pages, landing pages, and free trial sign-ups serve this intent.

Before you target any keyword, search it in Google and look at what is already ranking. That tells you what intent Google has assigned to it. If the top results are all e-commerce product pages and you are trying to rank a blog post, you will struggle regardless of how good your content is. Match the format of what is already ranking.

For a deeper look at how intent fits into broader on-page optimisation, read our guide to what is on-page SEO.

Long-Tail vs Short-Tail Keywords: Choosing Where to Compete

Keywords are often described on a spectrum from short-tail (also called head terms) to long-tail. Understanding this spectrum is essential when you are deciding where to focus your keyword research efforts.

Short-Tail Keywords

Short-tail keywords are typically one or two words: "shoes", "SEO", "keyword research". They have massive search volumes — sometimes hundreds of thousands of searches per month — but they are brutally competitive. The top results for short-tail terms are almost always established sites with enormous domain authority, deep content libraries, and thousands of backlinks. For a new or mid-sized site, trying to rank for "keyword research" against Ahrefs, Moz, and HubSpot is not a good use of your time.

Long-Tail Keywords

Long-tail keywords are three or more words and usually much more specific: "how to do keyword research for a new website", "free keyword research tools for beginners", "find keywords for SEO without paying". They have lower individual search volumes — perhaps 100 to 1,000 searches per month — but they are far less competitive, and crucially, they convert better because the searcher is more specific about what they want.

The math of long-tail keywords works in your favour in another way: there are vastly more long-tail searches than short-tail searches. Estimates vary, but somewhere around 70% of all searches are queries that have never been searched before in quite that combination. The long tail, in aggregate, drives enormous traffic.

The Middle Ground: Mid-Tail Keywords

Mid-tail keywords (two to four words, moderate volume, moderate competition) are often the sweet spot for growing sites. Examples: "keyword research guide", "free keyword research", "SEO keyword tools". These offer enough volume to matter and enough specificity that you can realistically compete.

A sensible keyword research strategy builds a portfolio across the spectrum. Target long-tail terms first to build topical authority and earn early traffic, then progressively go after more competitive mid-tail terms as your site grows.

Step 1: Brainstorm Seed Keywords

Seed keywords are the broad starting-point terms that define the territory you are operating in. They are not necessarily the terms you will target — they are the raw material you expand from.

To brainstorm seed keywords, think about your business or topic from three angles:

Your Products, Services, or Topics

Write down everything you offer or cover. If you are an SEO tool, your seeds might be: keyword research, on-page SEO, backlink analysis, site audit, rank tracking, meta tags. If you are a bakery, they might be: custom cakes, wedding cakes, sourdough bread, gluten-free baking, cake delivery.

Your Audience's Language

Think about how your customers describe their problems, not how you describe your solutions. A customer searching for help with SEO might type "why is my website not on Google" or "how to get more website visitors" rather than "organic search optimisation". Think like the person who does not yet know your terminology.

Your Competitors' Categories

Look at the top navigation and category structure of competing websites. Their site architecture is essentially a public keyword map. If three major competitors all have a section called "keyword tools", that is a seed keyword worth exploring.

Aim for 10 to 30 seed keywords to begin with. Quality matters more than quantity here. These seeds will each generate dozens of keyword ideas in the next step.

Step 2: Free Keyword Research Tools to Expand Your List

Free keyword research is absolutely possible. You do not need to spend money on paid tools to build a solid keyword list. The following free tools give you substantial data and keyword ideas.

Google Autocomplete

Type your seed keyword into Google's search bar but do not press Enter. Google will suggest completions based on what real users search. These suggestions are gold because they come directly from actual search behaviour. Try variations: add letters at the end of your keyword to get different suggestions. Try "keyword research a", "keyword research b", and so on. The AlsoAsked and KeywordTool.io free tiers automate this process.

People Also Ask

When you search a keyword in Google, you often see a "People also ask" box with related questions. Clicking any question expands it and loads more questions. These questions are ideal for FAQ sections, H2 subheadings, and standalone blog posts. They tell you exactly what nuances people care about within your topic. Screenshot and collect these systematically for every seed keyword you research.

Related Searches

Scroll to the bottom of a Google results page and you will find "Related searches" — eight additional keyword ideas related to your query. These often reveal angles you had not considered. Search those related searches too and collect their related searches. This recursive process quickly surfaces dozens of keyword ideas.

Google Search Console

If your site is already live and you have Google Search Console set up (it is free and you should absolutely set it up), go to Performance > Search Results. You will see every query your site has appeared for in the last 16 months, along with impressions, clicks, click-through rate, and average position. This data is invaluable. Look for keywords where you get impressions but few clicks — these are pages where you appear in results but your title or meta description is not compelling enough. Also look for keywords you rank for on page two (positions 11-20) — these are your quickest wins. A targeted update to those pages could push them to page one.

Google Keyword Planner

Google Keyword Planner is free to use with any Google Ads account (you do not need to run ads). Enter a seed keyword and it will return hundreds of related keyword ideas with monthly search volume estimates and competition levels. The volume data is shown in ranges rather than exact numbers unless you are running active campaigns, but even the ranges are useful for prioritisation. The "Discover new keywords" tab lets you enter a competitor's URL and see what keywords Google associates with their site.

Answer the Public

Answer the Public (free tier available) takes a keyword and generates a visual map of questions, prepositions, comparisons, and alphabetical variations. It is particularly useful for finding long-tail keyword ideas framed as questions. Enter "keyword research" and you will see dozens of variants like "how does keyword research work", "when should you do keyword research", "keyword research with Google", and more.

Wikipedia and Reddit

Wikipedia's table of contents for any topic page reveals how experts organise subtopics — useful for understanding what areas to cover in comprehensive content. Reddit is valuable for discovering how your audience actually talks about problems. Search Reddit for your topic and read the threads. The exact phrases people use in posts and comments are natural language that often matches search queries.

RankNibbler Keyword Density Checker

Use the RankNibbler keyword density checker on competitor pages to see exactly which keywords they are optimising for. Enter a competitor's URL and the tool analyses the keyword frequency and prominence of their content. This is a fast way to find the keyword strategy a successful competitor is using.

Step 3: Paid Keyword Research Tools (Overview)

Paid tools unlock data that free tools cannot provide: precise monthly search volumes, keyword difficulty scores, click-through rate estimates, SERP feature analysis, and bulk export capabilities. If you are managing SEO professionally or running a business where organic traffic is a significant revenue driver, a paid tool is worth the investment.

Most paid tools offer free trials or limited free tiers. If you are new to keyword research, start with the free tools covered above, get comfortable with the process, and then evaluate paid tools once you know what additional data you need.

Step 4: Evaluating Keywords — How to Choose What to Target

Generating a long list of keyword ideas is the easy part. The harder and more important step is evaluating that list systematically so you target keywords where you have a realistic chance of ranking and where ranking will actually deliver value.

Search Volume

Search volume is the average number of searches a keyword receives per month. Higher is not always better. A keyword with 1,000 monthly searches in a niche you can dominate is worth far more than one with 50,000 searches where you have no chance of breaking the top 10. Use volume to set expectations, not to rank keywords in order of priority.

Also beware of seasonal fluctuations. "Christmas gift ideas" has enormous December volume and almost nothing in July. Search Console's performance data filtered by date range can reveal seasonality patterns for queries your site already gets traffic from.

Keyword Difficulty

Keyword difficulty (KD) is a metric, available in paid tools, that estimates how hard it is to rank on page one for a given keyword. It is usually expressed as a score from 0 to 100. Scores below 30 are generally achievable for new sites. Scores above 70 require significant domain authority and extensive content investment.

Even without a paid tool, you can assess difficulty manually. Search the keyword and look at the top 10 results. Ask yourself:

• Are these major branded sites (Wikipedia, Reddit, Investopedia, Amazon) or smaller niche sites?
• Are the top-ranking pages thin or comprehensive? If they are thin, there is a content gap you can exploit.
• Are the titles a close match to the keyword, or are they somewhat off-target? If results are tangential, Google may be struggling to find a perfect match — meaning a well-targeted page could rank.

Click-Through Rate (CTR) Potential

Not every search results in a click. SERP features like featured snippets, knowledge panels, People Also Ask boxes, and local packs can absorb clicks that would otherwise go to organic results. A keyword with 5,000 monthly searches but a prominent featured snippet and multiple SERP features may deliver fewer actual clicks than one with 1,000 searches and a clean results page.

Business Relevance

Traffic that does not convert is vanity. Every keyword you target should connect, at least indirectly, to your business goals. An SEO tool targeting "what is a meta description" is sensible — those readers are exactly the audience who might use the tool. An SEO tool targeting "best pizza in London" is not, even if it could somehow rank for it.

Score each keyword on relevance: high (directly matches your offer), medium (related topic, adjacent audience), or low (tangential or unclear connection). Prioritise high-relevance keywords even if their volume is lower.

The Evaluation Matrix

For each keyword on your list, score it across these four dimensions and multiply or weight the scores to get a priority ranking:

Step 5: Assessing Keyword Difficulty Without Paid Tools

Paid tools make keyword difficulty assessment faster and more systematic, but you can do a solid job manually using nothing but Google and a methodical approach.

Analyse the SERP Manually

Search your target keyword and examine the top 10 results. Look for:

• Domain authority signals: Are results dominated by household-name brands with enormous online presence? If so, difficulty is high.
• Page-level signals: Are the individual ranking pages deeply linked-to resources, or are they relatively thin posts from smaller sites? Use the RankNibbler heading extractor to quickly check the content structure of competing pages.
• Content quality: Are the top results genuinely comprehensive and well-structured, or could you clearly produce something better?
• Age of content: Old content from authoritative domains is hard to displace. Newer content from smaller sites suggests the keyword is less entrenched.

Check for Keyword in Title

Search allintitle:"your keyword" in Google. This shows how many pages have optimised their title tag specifically for that phrase. A low number (under a few thousand) suggests relatively low competition at the optimisation level, even if many pages broadly cover the topic.

Use the SEO Compare Tool

Enter your URL alongside a competitor who ranks for your target keyword using the RankNibbler SEO compare tool. See side-by-side how your page scores across title tags, headings, content structure, and more. The gaps you identify become your optimisation roadmap.

Step 6: Competitor Keyword Analysis

One of the fastest ways to build a valuable keyword list is to study what keywords your competitors already rank for. They have done years of work to discover what works in your niche — you can learn from that.

For a full methodology, see our dedicated guide to how to do competitor SEO analysis. The core steps for keyword-focused competitor analysis are:

Identify Your True Search Competitors

Your search competitors are not necessarily your business competitors. Search your main keywords and note which websites consistently appear in the top results. These are your search competitors. A small local bakery might find that its search competitors are recipe blogs, not other local bakeries.

Analyse Their Top Pages

In paid tools, you can see a competitor's top pages ranked by organic traffic. Without a paid tool, look at their site structure and blog categories. Pages that appear prominently in their navigation and internal links are almost certainly their highest-priority keyword targets.

Find Keyword Gaps

A keyword gap is a term your competitor ranks for but you do not. Paid tools have keyword gap analysis features. Without them, manually search your main keyword categories and note which competitor pages appear that you do not have equivalents to. Each gap is a potential content opportunity.

Study Their Content Structure

Use the RankNibbler heading extractor to analyse the H1, H2, and H3 structure of a competitor's high-ranking page. Their heading structure reveals which subtopics they consider important — and often, which keywords they are deliberately targeting with each section heading. Use this as a reference when planning your own content, not as a template to copy.

Step 7: Keyword Grouping and Clustering

Once you have a list of several dozen or several hundred keywords, the next step is to organise them into groups. Keyword clustering is the process of grouping keywords that share the same or very similar search intent — meaning they should be targeted by a single page rather than separate pages.

Why Clustering Matters

Creating separate pages for every variation of the same keyword is a common mistake that leads to keyword cannibalism — multiple pages competing against each other for the same query. Google gets confused about which page to rank, and as a result none of them rank as strongly as one well-consolidated page would.

Instead, identify which keywords can be satisfied by a single piece of content. "How to do keyword research", "keyword research guide", "keyword research tutorial", and "how to find keywords for SEO" all share informational intent and would be served by the same page — this page. They should be grouped together and all targeted by one comprehensive guide.

How to Cluster Keywords

The simplest method is to search each keyword in Google and compare the results. If the top-ranking pages are the same (or very similar) across two different keywords, they belong in the same cluster. If the results are substantially different, they likely represent different intent and should be separate pages.

More advanced methods use SERP similarity tools, which automate this comparison at scale. Most major paid SEO tools now have clustering features built in.

Building a Keyword Map

A keyword map is a document that assigns keyword clusters to specific pages on your site. It gives you a clear view of which page targets which primary keyword, which secondary keywords support it, and whether any gaps exist in your content coverage. A simple spreadsheet works perfectly:

Step 8: Keyword Mapping — Assigning Keywords to Pages

Keyword mapping is the strategic assignment of target keywords to specific pages. It prevents duplication, ensures every keyword cluster has a dedicated home, and reveals where you need to create new content.

Primary Keyword Placement

Your primary keyword should appear in:

• The page title tag (ideally near the beginning)
• The H1 heading
• The first paragraph of content
• The URL slug (keep it concise: /how-to-do-keyword-research not /how-to-do-keyword-research-for-beginners-step-by-step)
• The meta description (this does not affect ranking but does affect click-through rate)
• At least one subheading (H2 or H3)
• Naturally throughout the body content

For practical guidance on getting your title tags right, see our guide on how to write title tags. For broader content optimisation, read our guide on how to write SEO content.

Secondary Keyword Placement

Secondary keywords — related terms and synonyms — should appear naturally throughout the content, in subheadings where they fit logically, and in alt text for any relevant images. Do not force them. If a secondary keyword appears awkward in context, it is better to omit it than to damage readability for the sake of keyword inclusion.

Checking Keyword Density

There is no magic keyword density percentage to aim for. The old advice of "aim for 1-3% density" is outdated and can lead to keyword stuffing if followed rigidly. Instead, focus on natural language and use the keyword density checker as a diagnostic tool rather than a target. If your primary keyword appears 20 times in a 500-word article, that is almost certainly too many. If it appears once in a 3,000-word guide, it may be too few. Let the content flow guide you.

Keyword Research for Different Content Types

The keyword research process is broadly the same regardless of content type, but the emphasis and the specific keywords you target differ significantly depending on what you are creating.

Blog and Editorial Content

Blog keyword research focuses on informational intent. You are looking for questions, how-to queries, explanatory searches, and topics your audience researches. Target keywords that align with the problems your audience faces at various stages of awareness. A good informational keyword has clear question framing ("how to...", "what is...", "why does..."), reasonable search volume, and relatively low competition — characteristics that make it achievable even for newer sites.

Long-form guides (like this one) targeting a primary informational keyword and dozens of secondary long-tail variants tend to perform well. They satisfy the searcher's intent comprehensively, which Google rewards.

Product and Category Pages

E-commerce keyword research focuses on transactional and commercial investigation intent. Category pages should target head terms ("running shoes", "women's trail running shoes"). Product pages target specific product names and model numbers, plus descriptive long-tail variants ("waterproof men's trail running shoes size 12"). The modifiers that matter for product keywords include: price-related terms, feature terms, brand names, and comparison phrases ("vs", "alternative to", "vs alternative").

Local Business Keywords

Local keyword research adds a geographic layer. Instead of just "plumber", you want "plumber in Manchester" or "emergency plumber South London". Google's local algorithm gives significant weight to proximity, so Google My Business optimisation runs alongside keyword targeting for local searches. Research both pure geo-modified keywords ("keyword research consultant London") and near-me variants ("SEO consultant near me") — the latter are growing rapidly as mobile search increases.

Google's People Also Ask and Related Searches features are particularly rich for local keyword research because they surface hyper-local questions that keyword tools often do not capture.

Landing Pages and Lead Generation

Landing pages for lead generation typically target commercial investigation or transactional intent keywords with strong buying signals: "best [tool/service] for [use case]", "[tool/service] pricing", "[tool/service] free trial". These keywords have lower volume than broad informational terms but far higher conversion potential. A landing page converting at 5% from 200 monthly visits may be more valuable than a blog post converting at 0.5% from 5,000 monthly visits.

Common Keyword Research Mistakes to Avoid

Even experienced SEOs make keyword research errors. Here are the most common ones and how to avoid them.

Targeting Keywords That Are Too Competitive

New sites attempting to rank for highly competitive head terms before they have the domain authority to do so is one of the most common and costly mistakes in SEO. You will produce content, wait months, and then find you are stuck on page three or four — not because the content is bad, but because the competition is too strong at your current stage. Start with lower-competition long-tail terms and build authority progressively.

Ignoring Search Intent

Creating a product page for a keyword that has informational intent, or writing a blog post for a keyword that has transactional intent, will result in poor rankings regardless of technical optimisation quality. Always check what Google is already ranking for a keyword before deciding on your content format.

Focusing Solely on High-Volume Keywords

High volume looks impressive in a spreadsheet but means nothing if you cannot rank for it or if it does not convert. A portfolio of 50 lower-volume keywords with achievable difficulty and high relevance will outperform one high-volume target where you rank on page four.

Keyword Stuffing

Forcing keywords into content unnaturally — repeating them in every other sentence, adding them in footers or hidden text, or using exact-match anchor text for every internal link — is both a quality issue and a ranking risk. Google's algorithms are sophisticated enough to detect and penalise it. Write naturally, use synonyms, and let the keyword appear where it fits.

Not Updating Keyword Research Regularly

Search trends change. New competitors enter your space. Google updates its algorithm and different content types rise or fall in rankings. Keyword research is not a one-time exercise. Review your keyword map at least annually, check Search Console quarterly for new query opportunities, and monitor your rankings for existing target keywords monthly.

Cannibalising Your Own Pages

If two pages on your site target the same keyword with the same intent, they will compete with each other in Google's index. This dilutes the authority of both pages. Audit your site for cannibalism using the SEO compare tool to compare competing pages, then consolidate or differentiate them.

Neglecting the Bottom of the Funnel

Most content strategies over-index on top-of-funnel informational content because it generates high traffic numbers. But bottom-of-funnel keywords — the specific, transactional searches made by people ready to act — are often where revenue comes from. Ensure your keyword research covers the full funnel, not just the awareness stage.

Step-by-Step Keyword Research Process: A Practical Workflow

Here is a concrete, repeatable process you can follow for any keyword research project, whether you are starting a new site or expanding an existing content library.

Phase 1: Define Your Scope (30 minutes)

Before you open any tool, define the scope of your keyword research. What site or section are you researching for? What is the business goal (traffic, leads, sales)? Who is the audience? What is your current domain authority (if any)? What content types can you produce? These constraints will guide every decision you make.

Phase 2: Generate Seed Keywords (30 minutes)

Using the brainstorming approach described above, generate 15-30 seed keywords. Write them in a spreadsheet. At this stage, do not filter — just generate.

Phase 3: Expand with Free Tools (1-2 hours)

For each seed keyword, use Google Autocomplete, People Also Ask, Related Searches, and Answer the Public to generate expanded keyword ideas. If you have a Google Ads account, use Keyword Planner to add volume data. Add every keyword to your spreadsheet without filtering yet. You might end up with 200-500 raw keywords.

Phase 4: Filter and Evaluate (1-2 hours)

Go through your list and remove keywords that are clearly irrelevant, duplicates, or obviously unachievable for your site right now. For the remaining keywords, add columns for: estimated search volume, assessed difficulty (low/medium/high), intent type, and business relevance. Score each one.

Phase 5: Cluster Keywords (1 hour)

Group your evaluated keywords by intent and SERP similarity. Each cluster becomes a potential page or content piece. A cluster of 5-15 related keywords with the same intent should map to a single page.

Phase 6: Build Your Keyword Map (30 minutes)

Create your keyword map: a spreadsheet assigning each cluster to a specific URL (existing or planned). Flag gaps where no page currently exists. Flag conflicts where two existing pages target the same cluster.

Phase 7: Prioritise Your Content Roadmap (30 minutes)

Order your content roadmap by a combination of business value, competition level, and strategic fit. Typically, start with: quick wins (pages you have that rank on page 2 for target keywords — update these first), then high-relevance achievable new content, then medium-difficulty consolidation opportunities, and finally high-difficulty head terms to work toward over time.

Phase 8: Implement and Monitor

Publish or update content targeting your prioritised keywords. Track rankings using Search Console (free) or a rank tracker. Review performance after 60-90 days and adjust. SEO is iterative — the first version of your content is rarely the final version.

Frequently Asked Questions About Keyword Research

How do I do keyword research for free?

Free keyword research is very achievable using tools that cost nothing: Google Autocomplete shows real search suggestions, People Also Ask surfaces related questions, Google Search Console reveals which queries your site already ranks for, and Google Keyword Planner (free with any Google Ads account) provides volume estimates. Combined with manual SERP analysis — just searching your target keywords and studying what ranks — these free resources are enough to build a solid keyword strategy without any paid subscription.

How many keywords should I target per page?

Target one primary keyword per page, supported by 3-10 secondary keywords (closely related terms and synonyms). The primary keyword defines the page's main topic and appears in your title tag, H1, and throughout the content. Secondary keywords appear naturally to add depth and capture related search variants. Beyond that, focus on covering the topic thoroughly rather than hitting a specific keyword count.

What is keyword difficulty and how do I know if I can rank?

Keyword difficulty is a score (usually 0-100) that estimates how hard it is to rank on page one for a given keyword. Scores under 30 are generally achievable for newer sites. Without a paid tool, assess difficulty by looking at the top 10 results: if they are large branded sites with extensive content and obvious authority, difficulty is high. If they are smaller niche sites with relatively thin content, difficulty is lower and there is a gap you can exploit.

What is the difference between short-tail and long-tail keywords?

Short-tail keywords are broad one-to-two-word terms ("shoes", "SEO") with high search volume and very high competition. Long-tail keywords are longer, specific phrases ("best running shoes for flat feet under £100") with lower individual search volume but lower competition and higher conversion rates. Most SEO strategies for growing sites focus heavily on long-tail keywords first, then work toward more competitive shorter terms as authority builds.

How often should I do keyword research?

Conduct a full keyword research exercise when launching a new site, launching a new product/service line, or overhauling your content strategy. Beyond that, do a lighter keyword review quarterly — checking Search Console for new queries, monitoring competitor new content, and looking for keyword trends. Rankings and search trends change constantly, so keyword research is an ongoing process rather than a one-time task.

What is search intent and why does it matter?

Search intent is the underlying reason behind a search query. Google classifies intent as informational (wanting to learn), navigational (wanting to find a specific site), commercial investigation (researching before buying), or transactional (ready to act). It matters because Google ranks content that matches the dominant intent for a keyword. If you publish a blog post for a keyword where all top results are product pages, you will not rank — regardless of how well optimised your post is. Always check what Google already ranks for a keyword before deciding on content format.

Can I rank without doing keyword research?

Technically yes, but it is far less efficient. Without keyword research you risk creating content that nobody searches for, using phrasing that does not match how your audience searches, and competing for terms where you have no realistic chance of ranking. Keyword research is not optional if you want SEO results — it is the strategic foundation that makes everything else more effective.

What is keyword cannibalism?

Keyword cannibalism (also called keyword cannibalisation) happens when two or more pages on your site target the same keyword with the same search intent. Google has to choose between them, often ranking both poorly instead of ranking one strongly. Avoid it by mapping keywords carefully so each cluster has a single dedicated page. If you already have cannibalism on your site, consolidate the weaker pages into the stronger one or differentiate them clearly by intent.

Should I target keywords my competitors are targeting?

Yes, often. If your competitors are ranking well for keywords that are relevant to your business, those keywords are clearly worth targeting. Competitor keyword analysis helps you identify proven opportunities rather than guessing what might work. The goal is not to copy competitor content, but to identify the keyword landscape your competitors have validated and then produce better, more comprehensive content for the same searches. Read our guide to competitor SEO analysis for the full methodology.

How do I find keywords that will actually drive traffic to my site?

Focus on four factors: search intent (does your content format match what Google shows), keyword difficulty (are the current results beatable), relevance (will this audience convert or engage), and search volume (is there enough demand to justify the effort). Keywords that score well on all four are your best opportunities. For most sites, this means starting with specific long-tail informational keywords and building toward higher-volume terms over time.

What are LSI keywords and do they matter?

LSI stands for Latent Semantic Indexing — a concept from information retrieval theory that refers to conceptually related terms. In practical SEO, LSI keywords are often described as synonyms and related phrases that help search engines understand what a page is about. While Google does not technically use LSI in the academic sense, it does use sophisticated natural language processing to identify related concepts. Using semantically related terms naturally (not forced) does help your content rank for a broader range of queries and signals topical depth to Google's algorithms.

How do I do keyword research for a new website with no traffic?

For a brand new site, you cannot rely on Search Console data (there is none yet) or on your existing rankings. Instead: start with seed keyword brainstorming, expand with Google Autocomplete and Answer the Public, and prioritise heavily on low-difficulty long-tail keywords where established sites have not produced thorough content. Also look for very specific question-based queries — these are often underserved by large sites that focus on broader topics. Early traffic from long-tail queries builds Search Console data, which then informs your next round of keyword research.

Putting It All Together

Keyword research is not a one-time task you complete at the start of a project and then forget. It is an ongoing process that evolves with your site, your industry, and the search landscape. The most successful SEO strategies treat keyword research as a living document — updated as your site grows, as competitors change their strategies, and as Google's understanding of intent continues to refine.

Start with the free tools. Google Autocomplete, People Also Ask, Search Console, and Keyword Planner give you more than enough to build a solid initial keyword map. Be realistic about difficulty. Target keywords where you have a genuine shot at ranking given your current domain authority, and build toward more competitive terms over time.

Always prioritise search intent over volume. A smaller audience searching for exactly what you offer is more valuable than a large audience whose intent does not match your content. And remember that keyword research is the beginning of the content process, not the end. The insights you gather should directly inform how you write your SEO content, how you structure your headings, and how you write your title tags.

For a broader view of how keyword research fits into the complete on-page SEO picture, read our guide to what is on-page SEO. For terminology you encounter along the way, the RankNibbler SEO glossary has definitions for every major SEO concept.

Last updated: April 2026