You’ve seen the claims:
“So Many New Ranking Factors!”
“Content Quality is Everything!”
“User Engagement is the New King!!”
“Social Media Signals Rock!”
“RankBrain has Taken Over All Ranking!”
Puhleeze, spare me the nonsense! In today’s post, I’m going to share new data on links as a ranking factor. This report will demonstrate the continuing importance that links play in rankings. I plan to share data that shows that all that talk of a decline in the importance of links as a ranking factor is grossly exaggerated.
In fact, links remain amazingly powerful. Let’s dig in!
Recent Googler Comments on Top Ranking Factors
On Mar 23, 2016, I participated in a Hangout with Google Dublin’s Andrey Lippatsev (along with Rand Fishkin and Ammon Johns). Here is an important snippet of the conversation:
Ammon Johns: We heard that RankBrain is the third-most-important signal contributing to results now. Would it be beneficial to us to know what the first two are?
Andrey Lippatsev: Yes. Absolutely. I can tell you what they are. It’s content and links going into your site.
Do tell now?
What the Moz and Searchmetrics Studies Showed
Both Moz and Searchmetrics have run groundbreaking studies on ranking factors, and each includes a look at links. You can see them here:
Moz Correlation Factors
Searchmetrics Ranking Factors
You can see some of the basic data points in the following chart:
Each of the bars above shows the level of correlation between that factor and higher rankings. In both the Moz and Searchmetrics studies, correlation to the number of links was relatively high, but not significantly higher than other factors they examined. If links are so important that a Googler would call them one of the two most important ranking factors, why aren’t these correlations showing higher numbers?
The key to the Moz and Searchmetrics studies is understanding how the evaluations were done. They did the evaluation of each SERP on an individual basis, and then took the mean of all the results (I’ll call this the “Mean of the Individual Correlations” approach). Both these studies also focused solely on commercial search terms.
So while their approaches have validity, because of our experience at Stone Temple Consulting with the power of links in ranking, we decided to take a deeper look into the power of links. We took some new approaches to expose more about their impact. Bottom line? I believe that the Mean of Individual Correlations approach is not providing a complete picture.
Our Study Results
Based on consultations with a couple of experts (Paul Berger and Per Enge), I did a different type of calculation, based on the Quadratic Mean. The reason for doing this is that it leverages the square of the correlation variables (where the correlation value is R, the quadratic mean uses R squared).
It’s actually the R squared value that has some meaning in statistics. For example, if R is 0.8, then R squared is 0.64, and you can say about that 64% of the variability in Y is explained by X. As Paul Berger explained it to me, there is no meaningful sentence involving the correlation variable R, but R squared gives you something meaningful to say about the correlated relationship.
Here is a visual on what this calculation process looks like:
In addition to the different calculation approach, I also used a mix of different query types. We tested commercial head terms, commercial long tail terms, and also informational queries. In fact, 2/3 of our queries were informational in nature. This may be one reason why we showed somewhat different results:
Our total links correlation result was higher than the correlation scores of DA and PA as ranking factors. I asked Rand Fishkin of Moz for a comment on why that may be, and here is what he had to say:
We use a different, broader corpus of keywords to generate PA/DA algorithms, and thus, it makes sense that on different types of keyword queries, they’ll have different levels of correlation. Very interesting to note that raw link counts tend to do better on these particular corpuses. My hope is actually that, one day in the future, Moz will be able to show how various metrics of all kinds correlate to any given set of keywords (wouldn’t it be awesome if you could see the correlations for the thousand keywords you’re rank tracking, for example?!).
Also of note is how high our total link score correlation was in comparison to Moz and Searchmetrics. The score I showed above used a different methodology, but even when we use the exact same methodology they did (the Mean of Individual Correlations approach), we get higher results. You can see the head to head comparison of all our link score calculations using that approach here:
Taking a Moment to Give Thanks: all of our data was pulled from the Moz API, and the good folks on the Moz team were quite supportive of us in all aspects of the entire study.
Aggregate Evaluation of Links as a Ranking Factor
I think that the Mean of the Individual Correlations and Quadratic Mean approaches are both highly valid ones, but one of the limits with them is that a small number of results with a highly negative correlation can drag down the total score in a significant way.
For that reason, I chose to take some other approaches to the analysis as well. The first of those was to measure the links in a more aggregated manner. To do this, we normalized the quantity of links. Then we took the total of all the search results by ranking position. The equations for this look more like this:
The value of this is that it smooths out the impact of the negative correlations in a different way. When you look at the correlations in this manner, here is what you get:
I also took another look at this. In this view, I continued to use the normalized totals of the links, but grouped them in ranking groups of 10. I.e., I summed the normalized link totals for the top 10, did the same for ranking positions 11 to 20, 21 to 30, and so forth. I then calculated the correlations to see how they looked in terms of what it would take to rank in each 10 position block. Those calculations looked more like this:
This gives us a bit more granular approach than simply aggregating all the ranking positions into the SERP positions, but still smooths out some of the limitations of the Mean of Individual Correlations method. Here is what we saw for results here:
I’ve now gone from numbers in the 0.39 range to near-perfect correlations, so what do these numbers tell us? I believe that the aggregated approaches to the calculations tell us that links are far more important than the “mean” based calculations reveal.
Digging Into What’s Going On Here
To help with this analysis, we did some manual analysis of a few hundred results to figure out what percentage or results were likely not as influenced by links. What types of results are these? Here you go:
Local results (not maps results, but results that are locally influenced
Query deserves diversity
In Depth Articles
Our analysis suggested that around 6% of the results came from these types of results. So that’s one factor right there, albeit not one that explains the difference between the “mean” based calculations and the aggregate calculations.
However, the more important issue is understanding the role of content quality. Since Google has called content and links the two most important ranking factors, you can imagine a greatly simplified equation based on simply multiplying a “link score” times the “content score”.
Now in this completely hypothetical discussion, I would argue that the content score probably counts for more than the link score. After all, if the content isn’t relevant, it shouldn’t rank. That just makes sense. In addition, the level of relevance of a piece of content is highly variable.
Here is a major oversimplification of what the impact of this might be:
In the above chart, it’s actually scenario 2 that would rank higher, even though its “Link Score” is significantly lower. Now imagine that the link score runs only from 1 to 100, and the content related scoring factors (relevance and quality) have an exponential decay (were minor variations in quality and relevance have a large impact on the “Content Score”), links will clearly not be able to overcome lower relevance or weaker content.
If your content is not relevant or competitive, links won't help ranking. If it is, links will make the difference.Click To Tweet
Important Note: the above discussion was meant to illustrate the basic point about the significance of content scoring and its impact on ranking algorithms. It’s all my own speculation based on the analysis of the data I’ve seen, and the case studies that I’ll share in the next section).
Cementing the Point With Case Studies
We do a lot of high end content marketing campaigns with our clients, many of which are Fortune 500 companies. Here is a sampling of the results across many of our clients:
The sample results shown here have been repeated hundreds of times by us. However, we don’t find that links can rescue poor quality content, or cause low relevance content to rank. Also, all of our efforts focus on the getting recognition from, or content published on, very high authority sites. Our data isn’t based on high volume, low quality link building.
Summary
The Google algorithm continues to evolve, and we see many things that are impacting overall organic search traffic. Some of the biggest causes are:
More real estate allocated to paid search
More content from other sources, such as image search, YouTube, and the other factors I mentioned above
Some pages that have less than 10 web results
Portions of the web results that are clearly less driven by links, such as local web, query deserves diversity, and in-depth article results
As a result, there are fewer than ten results on the first page of the SERPs which are driven by factors other than links. That doesn’t mean that links aren’t involved at all in rankings for those pages just that they matter less.
But, our study data strongly suggests that links continue to play a major role in rankings. In addition, our case study data makes the whole thing a slam dunk. When you aren’t facing page relevance or quality issues, links can, and do, continue to significantly impact rankings.
Study shows minus relevance or quality issues, links still are very powerful ranking factor.Click To Tweet
Note: even though our data focused on showing the correlation based on the quantity of links, that doesn’t mean that the quality of the links doesn’t matter, as it truly does. AND (see the emphasis here?), don’t even think about buying links.
So what’s the real upshot of all this? Simple:
DO build great content and user experiences. In today’s digital marketing world, that’s just table stakes.
DO proactively market your business and do the types of things that cause people to write about you and link to you.
You MUST do BOTH.