Measurement Mistakes & How To Fix Them


Use Data Or Be Used By Data!

The October 12 issue of Seotistics is here for you!

Measurement did change in the last year and I am here to remind you some basic facts.

AI is for sure one of the main culprits but not the only one.

I am also writing a huge article on LLM measurement, stay tuned πŸ‘€

Hectic week, too much to do, including course updates.

Please move this email to your Primary inbox or reply to it. This is to prevent Seotistics goes into spam by accident. Gmail users can read this tutorial to do it.

​Read this in your browser​

πŸ“£πŸ“£ Important Announcements πŸ“£πŸ“£

As for conferences/events, the next ones are:

  • ​SerpConf Rome - 16 October 2026 (this Friday!)
  • ​SEO On Stage (Athens) - 24 October 2026 (SEO-On-Stage-Marco70 for 70% off)
  • MeasureCamp Zurich - 21 November 2026

I've also decided to add a weekly news recap in every issue.

The first few times it will be simplistic but I am curious to experiment more here.

There will be new cool changes to this newsletter and plenty of content updates πŸ‘€

News

From October 5 to October 12:

Experimental section, will develop it once I have more time πŸ’€

If you ask me, the GA4 User Groups news is huge for programmatic work.

Anthropic also released some interesting stuff!

Bot Traffic & Issues

One of the main reasons why Web data is unreliable is often bot traffic.

GA4 requires quite some filtering work to be considered reliable, and what I usually do.

Instead of filtering from inside GA4, I recommend you actually do it from your data warehouse (or prevent bot traffic with a CDN).

I have a list of patterns I usually look for:

  • engaged_sessions at 0 across thousands of sessions, with engagement time under a few seconds
  • traffic landing on / only, with a single event per session
  • geographic clustering that makes no sense for the business (mine tends to arrive from China and Singapore)
  • device and browser fields that come back empty or absurd, including the odd 0x0 screen
  • one session per user and then nothing because bots don't come back
  • user agents that look like headless Chrome, python-requests or Go-http-client

GSC as a data source is ALSO affected by bot traffic, as we noticed from Google fixing and reducing impressions over time.

This can't be fixed unfortunately... and why I tell you to consider web data as directional.

Direct Traffic Nightmare

This is a big classic and something I also have to fix on my website πŸ’€

Direct traffic is mistakenly defined as that bucket where all the people who visit directly land.

Imagine bookmarks or people reaching you via the search bar.

In practice, it's often related to technical issues you could prevent, like:

  • Links in email clients (especially desktop apps like Outlook), PDFs, and Word or Office documents
  • Messaging apps such as WhatsApp, Slack, Telegram, Signal, and SMS, which often strip referrers
  • Mobile apps that open links in in-app browsers without passing a referrer
  • QR codes
  • Social platforms that suppress or mask referrers in some contexts
  • HTTPS to HTTP transitions, which drop the referrer (and redirects)

The mindset shift is to stop treating Direct as one channel.

You can split it by landing page, device, new vs returning and consent status.

It can't by definition reach 0 but... you can at least control it.

Inside it, you may also have AI traffic!

OK.... But AI?

LLMs have been quite tough to classify because we relied mostly on:

  • page referrers
  • sources

The issue being in most cases that referrers are stripped (as just said) and we don't have much data from other tools.

AI traffic for now should be a simple indication/sample to evaluate potential conversions.

Don't change your entire strategy for it, monitor what happens and make sure to report on that.

This is mostly for stakeholders. Marketing-wise, I don't even see the potential of this fixation.

Attributing Results to AI

You may have heard (or not) about incrementality as a way to measure the real impact of a given channel/source on revenue.

This is NOT easy at all because it requires companies to have a proper setup and system to track it all.

In the proper conditions, you could:

  • apply very specific changes to a page and measure what happens compared to a page without them
  • compare between specific regions/areas
  • compare with user groups

This is close to impossible in reality and most tests we read are Sci-Fi.

The big limit of Organic is that you can't switch it off (unlike Paid).

Well, technically you (partially) could by noindexing your website πŸ’€

In reality this is super hard to replicate and you can't even have holdouts with "GEO".

You can't instruct an LLM to ignore a brand as a test...

Where you can focus today (not many did so far) is your CRM.

It's super beneficial to understand the basics of tools like Salesforce and HubSpot.

Say you work for a B2B company... you use AI and SEO to bring you leads.

Then, you ideally move from leads to actual business opportunities.

Even though a CRM doesn't solve the issue of measuring AI Search, you can measure variations.​
​
By analyzing your sales pipeline you learn more than what GA4 tells you

πŸ‘₯ Join Our Community

Our Discord community offers a small place where we can talk business and web data.

If you hate all the noise of social media, then this place is for you.

I will start posting more there as we have a forum channel now.

This is the best way to stay updated in real time on Seotistics:

πŸ”Ž Analytics For SEO Ebook - Course / Ebook

You will:

βœ… Use GSC and GA4 Data to their fullest potential

βœ… Learn Python/SQL for your needs

βœ… Get a complete blueprint for auditing websites

βœ… Learn how to 10x your productivity

βœ… Learn BigQuery to work on large websites

I teach you what's needed to go from 0 to a professional Data Analyst.

Even if you leave SEO, the foundations are the same for other jobs!

Also in ebook:

Think Like A Web Analyst

This course teaches you to:

βœ… frame Analytics problems

βœ… understand which metrics matter

βœ… managing Web Analytics projects successfully

πŸ“š Recommended Reads - Peak Content πŸ—»

Read these peaks:

As usual, my most recent LinkedIn content is here.

❗️ Feedback and Recommendations

If you have ideas/recommendations for the next issues of Seotistics, you can simply reply to this email.

Marco Giordano
​
Data/Web Analyst

Follow me on πŸ”½πŸ”½πŸ”½:

Bernerstrasse SΓΌd 167, Zurich, Switzerland
​Unsubscribe Β· Preferences​

Seotistics - Web Analytics + Business + Strategy

The Seotistics newsletter is written by Marco Giordano, a Data/Web Analyst with the goal of combining business and web data. Tired of the usual boring Analytics content without any business impact? Seotistics teaches you how to use Analytics, web data and even content in your workflow while helping you with Strategy.

Read more from Seotistics - Web Analytics + Business + Strategy

Use Data Or Be Used By Data! The October 5 issue of Seotistics is here for you! The last time we saw some nice workflows you can use in real time for your small website. Well, I show you what else you can do and the latest news in the Web Analytics world :3 Nowadays you can have a better Analytics stack than your competitors just with common sense. There are big changes coming ahead and 2027 will be THE year. P.S. Go check my previous issues if needed, this is a sequel. Please move this email...

Use Data Or Be Used By Data! The September 28 issue of Seotistics is here for you! As said in the previous issue, small websites can win against big players. Now we have access to better tools like agents and I am here to show exactly how. Needless to say, you need real skills and AI alone is pointless. Please move this email to your Primary inbox or reply to it. This is to prevent Seotistics goes into spam by accident. Gmail users can read this tutorial to do it. Read this in your browser πŸ“£πŸ“£...

Use Data Or Be Used By Data! The September 21 issue of Seotistics is here for you! I already discussed this topic in the past because it's one of the most crucial topics in Inbound Marketing. Easy to talk about huge websites... but what about small ones? There are key differences in terms of Analytics stack and strategy, for sure! Please move this email to your Primary inbox or reply to it. This is to prevent Seotistics goes into spam by accident. Gmail users can read this tutorial to do it....