How to Measure Traffic from ChatGPT and Other LLMs

How to Measure Traffic from ChatGPT and Other LLMs

Kinro Team

Kinro Team

Friday, Nov 8, 2024

Traffic coming from large language models (LLMs) like ChatGPT or Gemini is mostly invisible in standard analytics tools. It is often misclassified as Direct or generic Referral traffic. To detect it, teams must configure a custom GA4 segment using regular expressions (Regex). This setup is essential to measure human clicks coming from AI systems - but it still only reveals part of the picture. Pair this with ChatGPT analytics to see how your brand is surfaced across prompts.

To truly understand AI-driven visibility, brands must go beyond traffic and track AI agents themselves, not just users.

The Uncomfortable Truth About Your Analytics

Your analytics are hiding something important. If you rely on GA4 out of the box, you are almost certainly missing traffic generated by LLMs. Visitors coming from ChatGPT, Gemini, Perplexity, or Copilot often land on your site without a clear referrer. As a result, they quietly blend into Direct traffic. This skews acquisition reports and makes AI-driven performance look smaller than it really is. For teams investing in AI visibility, this blind spot is no longer acceptable.

Why LLM Traffic Is Invisible in GA4

The Direct vs Referral confusion

Most analytics setups assume traffic comes from websites. LLMs break this assumption. Many AI tools do not pass a standard referrer, use mobile apps or embedded webviews, and generate clean links without tracking parameters. From GA4's perspective, these visits look anonymous. They end up classified as Direct traffic or generic Referral traffic. Without manual intervention, this growing source remains a black box.

Clicks vs visibility: only the tip of the iceberg

It is important to separate two realities:

  • Clicked traffic: a user clicks a link from an AI answer and lands on your site.
  • Invisible visibility: your brand is cited or recommended by the AI, but no link is clicked.

The second category is far larger and more strategic. AI systems increasingly act as decision-makers and influencers. They shape user choices even when no click happens. Clicked traffic is still the only measurable starting point. It signals that AI visibility is translating into user action. This article focuses on that measurable layer.

Which LLMs Can Actually Send Traffic?

You do not need to track every experimental AI tool. Focus on platforms that already generate meaningful volume:

  • ChatGPT (OpenAI)
  • Gemini (Google)
  • Perplexity
  • Copilot (Microsoft)
  • Le Chat (Mistral)

These systems are embedded in daily workflows and can drive qualified traffic to your site.

Method 1: UTM Parameters (Simple, but Fragile)

The simplest approach is to tag your links. If you control the URL being shared, add parameters like:

utm_source=chatgpt
utm_medium=llm_referral

This works for experiments, controlled prompts, and specific campaigns. However, it only works if the AI reproduces the exact tagged URL. Models often regenerate clean links, and the tracking disappears. UTMs are useful, but unreliable at scale.

Method 2: Regex-Based GA4 Segments (The Reliable Approach)

To consistently capture LLM traffic, create a custom GA4 segment.

Step-by-step overview

  1. Go to GA4 -> Explore
  2. Create a new blank exploration
  3. Add a Session segment
  4. Set the condition:
    • Dimension: Session source
    • Operator: matches regex
    • Value: a Regex pattern that captures known LLM referrers

This groups sessions originating from AI tools, even when referrer data is inconsistent. It requires more setup, but it delivers a durable, scalable view of LLM-driven clicks. Pair this with competitive intelligence to understand where you win or lose visibility by query.

Which method should you use?

| Method | Reliability | Setup | Best use case | | --- | --- | --- | --- | | UTM parameters | Low | Easy | Quick tests with controlled links | | Regex segment in GA4 | High | Medium | Long-term, holistic LLM traffic tracking |

For most teams, Regex-based segmentation is the right baseline.

How to Analyze LLM Traffic Once Tracked

Tracking is the first step. Interpretation matters more.

Key dimensions to use

  • Session source / medium
  • Page path

These show which AI tools send traffic and which pages are most cited and clicked.

Key metrics to monitor

  • Engaged sessions
  • Engagement rate
  • Average session duration
  • New users
  • Conversions or key events

Compare these metrics with your organic SEO traffic. High engagement usually means the AI recommendation matched user intent. Low engagement may signal off-context citations.

The Limit of GA4: It Only Shows Humans

GA4 only shows human clicks. It tells you nothing about how often AI agents mention your brand, why one competitor is cited instead of you, which prompts or intents trigger visibility, or what happens before the click. This is where most AI-driven value is decided.

How Kinro Completes the Picture

Kinro goes beyond traffic. In addition to measuring human visits from LLMs (via GA4-compatible signals), Kinro directly tracks AI agents themselves - including ChatGPT, Gemini, and other reasoning systems. See how we instrument this in agent tracking, and learn how Google is changing the rules with Gemini 3 in Gemini 3: Google's AI revolution is changing visibility.

Inside a single dashboard, teams can see:

  • Which AI agents reference their brand
  • In what contexts and queries
  • Which competitors are preferred
  • Why traffic or conversions follow (or do not)

This connects agent behavior with human behavior. You no longer just see who came. You understand who sent them and why.

To explore this:

  • AI traffic visibility -> https://kinro.ai/chatgpt-analytics
  • Agent-level monitoring -> https://kinro.ai/agent-tracking

Final Thought

Measuring LLM traffic in GA4 is necessary but not sufficient. Clicks are the outcome; AI reasoning happens upstream. If you want to understand AI-driven acquisition, you must track both human traffic and AI agents as first-class actors. That is the shift from analytics to AI visibility intelligence.

How to Measure Traffic from ChatGPT and Other LLMs