πŸ‘€ How (Not) To Be Tricked By Case Studies


Use Data Or Be Used By Data!

The March 3 issue of Seotistics is here for you!

If you want to learn more about methodology and reasoning, this issue is for you.

We'll go through what you can do to boost your organization's literacy about data...

and why case studies are often limited and tricky.

P.S. New course preorder is out and 30% off my other products until March 4 (Tuesday), go check them out!

Please move this email to your Primary inbox or reply to it. This is to prevent Seotistics goes into spam by accident. Gmail users can read this tutorial to do it.

​Read this in your browser​

πŸ“£πŸ“£ New Course + Discounts + News πŸ“£πŸ“£

You can now preorder my new course at a 30% discount until launch (May 12)!

It gives you all the missing business and marketing skills I mention when talking about Web Analytics...

including the FULL content of the topics in this newsletter.

If you purchased my previous course, go to this lesson here and the last section contains a special promo code for you:


My other products are also 30% off ("Analytics for SEO" course and the ebook) if you use the promo code "FEB25" at checkout (valid until March 4).

Some of you got a special email with an even better promo code...


I will attend the Winter Data Conference in Zell am See on March 7.

P.S. Some of you got a special discount... be sure to check your inboxes πŸ‘€

P.P.S. Don't forget to follow the LinkedIn page for Seotistics.

The Case Of Traffic

One of the first things we see are case studies boasting crazy traffic growth.

A sharp increase in traffic doesn't always mean you made more money.

Consider this case for an Ecommerce:

  • 200% traffic increase - ok what was the baseline?
  • which pages brought more traffic then?

Working on informational content is cool... but you ideally want people to land on your product pages and buy.

Great content helps you convert users in the long term but we know that in most cases extra traffic to average articles brings $0.

There are exceptions, like publishers who may monetize via Display Ads, so extra traffic = more money.

Measuring (& Defining) What Matters

You need to figure out what you want to achieve and have some common sense about it.

In my very early days and when I was still an SEO, I was asked to "10x traffic" in 4 months 🀣

This is also a red flag and an important lesson in qualifying clients and projects properly.

10xing your traffic is NOT a good goal for an app because it doesn't necessarily bring you qualified customers.

Even if you get more customers, you should be worried about their retention.

The same applies to social media... many fellow creators are obsessed with vanity numbers like followers or subscribers.

It doesn't matter if there is no engagement or no one converts.

My most loyal readers know what I am hinting at: you need a good North Star!

For those how missed my previous issues:

OK... So What Should I Do?

Well, my advice is to test stuff yourself instead of reading from other people.

Your websites are vastly different from the goliaths some people work on.

It's unfair to compare an SME to Amazon.

Specialize in some website models (e.g. Ecommerce, SaaS, publishers, etc.) and test on them.

Data-wise, there won't be many differences.

Business decisions are completely different realms.

Observational studies are often sufficient to make good decisions.

Correlation VS Causation

When reading the 99.9% of case studies, you have to consider them as correlative studies, so they hint at associations without proving causality.

This means that you can't generalize their conclusions and you have to take them with a grain of salt.

The difference is explained below:

Causation isn't always the most important thing since most of what we do is testing and breaking things anyway.

Your strategy shouldn't be affected by ranking factors or shiny objects, else it's not a good strategy!

"Correlation does not imply causation."​
​
​Also, causation doesn't imply linear correlation.

Remember, correlation is a type of association, not the only one. It's too long to dig deeper into details, we will leave at it.

P.S. The majority of case studies you read online are observational!

But don't worry, analyzing websites is often enough to add business value and what I teach you in my discounted course:


πŸ”₯πŸ”₯[Analytics For SEO Course - v4] - 30% Off! πŸ”₯πŸ”₯

πŸ’΄ Promo code for 30% off: FEB25. Valid until March 4.

If you want to be guided and start from scratch, this is the course for you!

You will:

βœ… Use GSC and GA4 Data to their fullest potential

βœ… Learn Python/SQL for your needs

βœ… Get a complete blueprint for auditing websites

βœ… Learn how to 10x your productivity

βœ… Learn BigQuery to work on large websites

I teach you what's needed to go from 0 to a professional Data Analyst.

Even if you leave SEO, the foundations are the same for other jobs!


Testing Is Important

There's a key distinction between Analytics and Statistics.

If Analytics helps you create better questions, Statistics often answers them.

The field of testing deeply involved the latter.

In 2025, there is enough content to study the topic but I can't but recommend this resource by Giulia Panozzo.​

You don't necessarily need to test for some roles (like mine) but it's a super important skill to learn.

Even if you don't run tests, I recommend you at least figure out when they are selling you slop.

Incrementality Testing

I know many people are guilty of this and often they are unaware of the issue.

Ever heard someone taking credit for additional MILLIONS in sales due to a specific channel?

In most cases it's bollocks.

That's because a single channel doesn't affect the whole of your sales.

Imagine working on SEO for 6 months and seeing a surge in sales.

Some not-so-honest agencies would tell you SEO is the cause...

in practice, it's more complex than that:

  • seasonality
  • randomness
  • SEO helped you sell due to your strong brand
  • some other marketing channel contributed (or their combined effect)

A strong brand and positioning make your life easier.

The correct way is to measure incremental revenue, i.e. the additional revenue that is generated by a channel beyond the baseline.

The baseline is no marketing activity, a normal condition.

Many of you will be familiar with paying for ads... and as we know many companies overspend and barely track their results properly.

Now guess what, there are cases where ads don't contribute at all, as shown in this nice LinkedIn article.

While this is absolutely out of the scope of Seotistics, this is an important lesson in context.

My friend Charlie is an expert in the topic of MMM and Incrementality.

(The topic is quite complex and incrementality tests are just one topic, though).

Data Literacy

I've talked about this topic quite often and it's everywhere in Seotistics.

Working, analyzing, and arguing with data while having a solid understanding of how the world works.

This is data literacy.

This isn't a simple buzzword because you just saw the effects of a lack of data literacy in practice:

  • finding associations where the correlation is low
  • confusing cause-effect factors
  • confusing GSC with GA4 data or mixing them with 3rd-party tools

These problems are to be found in every corner of the industry, from in-house to freelancing.

Data literacy is strictly related to the analytical maturity of an organization:

Many get the above example wrong and think that you need to go through every single step.

A good part of maturity in our industry would be to alert, perform analysis and optimize as much as possible.

What You Can Do Differently (Now)

A lot of ideas and cool stuff but you need to apply something from this Seotistics issue.

You can:

  • Identify existing problems
  • Finding if you can solve them with data
  • Apply the frameworks I showed you

That's it.

Before embarking on an expensive data project, think about the problems you are solving or the bottom line.

If you can't think of a good motivation, it's better to take a step back.

If that's you:

  • chasing AI tools/new stuff because it's cool
  • studying the most complex topics without having the right foundations
  • actually thinking executives care about your technical knowledge

Then you are set on the wrong path.

In Web Analytics, most stuff doesn't make any sense on its own.

You need more context to actually figure out what's going on.

The majority of case studies and tests gloss over context because it would invalidate them.

Get the context and you can easily figure out if you are reading BS.

πŸ‘₯ Join Our Community

Our Discord community offers a small place where we can talk business and web data.

If you hate all the noise of social media, then this place is for you.

πŸ”₯πŸ”₯ Analytics For SEO Ebook (v8) - 30% Off πŸ”₯πŸ”₯

πŸ’΄ Promo code for 30% off: FEB25. Valid until March 4.

If you want to learn about Analytics for SEO and prefer self-study, this is for you!

It will teach you or your employees to:

πŸ‘‰ Prepare audits that make sense and are actionable πŸ”₯

πŸ‘‰ Avoid common pitfalls that cost you money πŸ’Έ

πŸ‘‰ Create analyses that add value and moneyπŸ’―

πŸ‘‰ Move the needle faster with efficient SEO systems ⏳

This comes with periodical updates to keep the content fresh.

πŸ“š Recommended Reads - Peak Content πŸ—»

The usual peak to read:

My LinkedIn content:

❗️ Feedback and Recommendations

If you have ideas/recommendations for the next issues of Seotistics, you can simply reply to this email.

Marco Giordano
​
Data/Web Analyst

Follow me on πŸ”½πŸ”½πŸ”½:

Bernerstrasse SΓΌd 169, Zurich, Switzerland
​Unsubscribe Β· Preferences​

Seotistics - Web Analytics + Business + Strategy

The Seotistics newsletter is written by Marco Giordano, a Data/Web Analyst with the goal of combining business and web data. Tired of the usual boring Analytics content without any business impact? Seotistics teaches you how to use Analytics, web data and even content in your workflow while helping you with Strategy.

Read more from Seotistics - Web Analytics + Business + Strategy

Use Data Or Be Used By Data! The March 31 issue of Seotistics is here for you! It's undeniable that the Western data job market has changed and is still changing. OK cool but what's your point? Simple, it's necessary to go beyond labels (e.g. SEO, Product, Growth, Analyst) if you work with web data. I've writte a new article covering the other part of today's NL, it's about Descriptive Web Analytics and why it matters. Please move this email to your Primary inbox or reply to it. This is to...

Use Data Or Be Used By Data! The March 18 issue and 100th of Seotistics is here for you! Finally, we are at the #100 issue! Thanks to all for the support and for reading my content with passion. In this issue I will go through our story and what you can expect to see in the future! Please move this email to your Primary inbox or reply to it. This is to prevent Seotistics goes into spam by accident. Gmail users can read this tutorial to do it. Read this in your browser πŸ“£πŸ“£ Important...

Use Data Or Be Used By Data! The March 17 issue of Seotistics is here for you! If you have wondered aimlessly searching for cool automation through the depths of social media... don't worry, I will show you some ideas to get started and what you need to know in 2025. Consider this as a nice introduction to the topic. P.S. I am also working on a lot of new content for you folks, stay tuned πŸ‘€ You will get some freebies and more stuff on what I'll discuss today. Please move this email to your...