Original Research Last updated: May 2026

We Tested 50 UK Websites Across 6 AI Platforms

50 UK SME websites tested across ChatGPT, Claude, Gemini, Perplexity, AI Overviews, and Copilot. Data reveals systemic visibility failures.

OM
Oliver Mackman
AI Search Analyst

We tested 50 UK SME websites across all six major AI platforms. ChatGPT, Claude, Gemini, Perplexity, AI Overviews, and Copilot. The results show widespread failure. 87% of sites have two or more conflicting signals that confuse AI. 53% have no clear H1 tag. 44% lack Organisation schema. 23% block AI crawlers. Only 4% have Person schema for team members. Law firms scored worst, with zero firms meeting basic AI visibility needs.

Methodology

Between January and March 2026, we audited 50 UK SME websites across ten industries. We tested each site against a standard checklist on all six major AI search platforms:

  • ChatGPT (78% market share, 2.5 billion daily prompts)
  • Claude (doubled market share in Q1 2026)
  • Gemini (integrated with Google Search)
  • Perplexity (best crawl-to-referral ratio)
  • AI Overviews (shown on 48% of Google queries)
  • Copilot (shares Bing index with ChatGPT)

For each site, we checked:

  • H1 tag clarity and entity consistency
  • Schema markup presence and completeness (Organisation, Person, FAQ, Speakable)
  • robots.txt configuration (whether AI crawlers are allowed or blocked)
  • Content structure (headings, lists, tables, FAQ formatting)
  • Entity consistency across platforms (website, Google Business Profile, LinkedIn, schema)
  • AI citation presence (does the brand appear when relevant questions are asked?)

Industries covered: legal, accounting, financial services, healthcare, property, marketing agencies, IT services, recruitment, architecture, and consulting.

Key findings

FindingPercentageImpact
No clear H1 tag53%AI platforms cannot identify what the page is about. Without a clear H1, the primary entity signal is missing.
No Organisation schema44%AI engines cannot verify the business entity. No structured way to confirm the company name, address, industry, or founder.
Actively blocking AI crawlers23%robots.txt blocking GPTBot, ClaudeBot, or other AI crawlers - making the site invisible to those platforms entirely.
2+ conflicting entity signals87%Business name, description, or category differs between website, schema, Google Business Profile, and LinkedIn. AI platforms see inconsistency and reduce confidence.
FAQ content without FAQ schema52%FAQ sections exist on the page but aren't marked up with FAQPage schema. AI engines can't reliably extract the Q&A structure.
Person schema for team members4%Almost no sites connect their people to their content with Person schema. AI platforms have no way to verify author credentials.
Speakable schema2%Only one site in the sample implemented Speakable markup, which signals to AI platforms which content is suitable for voice responses.
sameAs links in schema11%Few sites use sameAs to connect their website to LinkedIn, Twitter, Companies House, or other authoritative profiles.

The entity confusion problem

87% of sites we tested send two or more conflicting signals about their own identity. The website says one thing. Google Business Profile says another. LinkedIn says a third. Schema markup (if it exists) may say something else. AI platforms cross-check all of these sources. When they find clashes, they trust the entity less and are less likely to cite it.

Common inconsistencies we found:

  • Business name variations. "Smith & Partners LLP" on the website. "Smith and Partners" on Google Business Profile. "Smith Partners LLP" in schema. AI sees three different entities.
  • Category mismatches. Website says "digital marketing agency." GBP says "advertising agency." LinkedIn says "marketing consultancy." Which is it?
  • Address format differences. Full postcode on the website. Partial postcode in schema. Different floor number on GBP.
  • Founder/director descriptions. "CEO" on LinkedIn. "Managing Director" on the website. "Founder" in schema. Three different titles for one person.

These look like minor details. To AI platforms, they are basic identity failures.

The H1 clarity gap

53% of sites in our sample had no clear, descriptive H1 tag on their homepage. Instead, we found:

  • Vague slogans: "Your success starts here"
  • Brand names only: "Smith & Partners"
  • No H1 at all (the heading was styled as an H1 visually but coded as a div or span)
  • Multiple H1s competing on the same page

The H1 is the strongest on-page signal for what a page covers. When it is vague, missing, or duplicated, AI platforms guess. Guessing means lower confidence and fewer citations.

The fix is simple. Make your homepage H1 a clear, entity-rich statement. "Award-Winning Accounting Firm in Leeds" beats "Welcome to Smith & Partners" every time. See our H1 clarity gap statistics for the full data.

The schema gap

Schema markup gives AI platforms machine-readable signals to verify and understand your business. The gaps we found are large:

Schema typeSites with itWhy it matters for AI
Organisation56%Basic entity verification - confirms who you are
LocalBusiness38%Location-specific entity for local AI queries
FAQPage22%Structured Q&A that AI engines extract directly
Person4%Author/expert credentials that build trust
Speakable2%Signals content suitable for voice/AI responses
sameAs (in Organisation)11%Cross-platform entity linking for verification

The biggest gap is Person schema at 4%. AI platforms weigh content by author authority. Your team page may list experts with credentials. But without Person schema linking those experts to their content, AI engines cannot verify expertise. See our guide on schema markup for AI search for more detail.

The crawler blocking problem

23% of sites in our sample block one or more AI crawlers via robots.txt. Most blocks are unintentional. They come from CMS defaults, security plugins, or old settings carried over from previous builds.

Common blocks we found:

  • GPTBot blocked - Stops ChatGPT from reading your content
  • ClaudeBot blocked - Stops Claude from reading your content
  • Blanket User-agent: * blocks - Often blocks all bots including AI crawlers
  • Too-strict allow rules - Lets bots in but blocks key directories

Block GPTBot and you remove yourself from ChatGPT, which holds 78% of the AI search market. See our guide on structuring your website for AI crawlers.

What the best-performing sites had in common

The top-performing sites shared six traits. A clear, entity-rich H1 tag. Organisation schema with sameAs links to LinkedIn, Companies House, and directories. FAQ schema on relevant pages. All AI crawlers allowed in robots.txt. Consistent entity descriptions across every platform. Named people with credentials linked to content via Person schema.

These six elements appeared consistently across the sites that were cited by two or more AI platforms:

  1. Clear H1. Not a slogan - a statement that includes the entity name, location, and service. "Manchester-Based Commercial Law Firm" not "Excellence in Law."
  2. Organisation schema with sameAs. Complete Organisation markup including name, address, founding date, and sameAs links to LinkedIn, Google Business Profile, Companies House, and industry associations.
  3. FAQ schema. Structured FAQ markup on service pages and about pages. Not just FAQ content - properly marked up FAQ content that AI engines can extract programmatically.
  4. AI crawlers allowed. Explicit allowances for GPTBot, ClaudeBot, PerplexityBot, and other AI-specific user agents in robots.txt.
  5. Consistent entity descriptions. The same business name, category, and description across every platform - website, schema, GBP, LinkedIn, directory listings.
  6. Named people with credentials. Team members with Person schema, credentials listed alongside content, and sameAs links connecting profiles to published work.

Sector breakdown

SectorSites testedAverage issuesWorst problem
Law firms86.4Zero firms met basic AI requirements. Highest rate of crawler blocking (37%).
Accounting64.8Entity inconsistency - different firm names across platforms.
Financial services54.2Overly restrictive robots.txt (compliance-driven).
Healthcare54.0No Person schema despite having named practitioners.
Property53.6Vague H1 tags - property company homepages rarely state what they do.
Marketing agencies53.2Ironic: agencies claiming AI expertise had poor AI readiness.
IT services53.0Better schema adoption but still missing FAQ and Person types.
Recruitment43.8Heavy reliance on job listing platforms - thin on-site content.
Architecture44.1Image-heavy sites with minimal text content for AI to process.
Consulting33.4Generic positioning - AI engines can't differentiate from competitors.

Law firms: the worst performers

Law firms scored worst of any sector. Not one firm in our sample met basic AI visibility needs. The problems are structural:

  • Conservative websites with vague positioning ("Excellence in legal services")
  • Compliance-driven robots.txt that blocks AI crawlers along with everything else
  • No schema beyond basic breadcrumbs
  • Partner bios without Person schema or sameAs links
  • Entity clashes between SRA registration, Companies House, website, and Google Business Profile

Legal queries are among the most common questions asked to AI platforms. "Do I need a solicitor for...?" generates millions of prompts. Firms that fix these issues have a strong first-mover advantage. See our AI SEO for law firms guide for sector tips.

Download the summary

A downloadable PDF summary of this research will be available soon. It will include the full method, sector breakdowns, and a self-assessment checklist. Check back or request a free AI visibility audit to get a personal assessment of your website.

What to do next

If you recognise your own website in these findings, the fixes are well-documented:

OM

Oliver Mackman

AI Search Analyst, SEOCompare

Oliver leads SEOCompare's editorial and comparison research. With over a decade in digital marketing, he oversees agency evaluation, tool testing, and AI search data analysis.

Last reviewed: 7 April 2026

Need help with AI search visibility?

Get a free AI visibility audit to see how your business appears across ChatGPT, Gemini, Perplexity, and AI Overviews.

Request your free audit