For websites, stores, web apps and mobile apps (Android and iPhone)

UX testing with AI agents

AI agents use your website or app like your customers and show you where they get stuck: every problem ranked, a video of each session and a fix prompt for your coding agent.

3 AI agent sessions on your site, the 3 worst problems and a video.

  • Desktop & mobile
  • Video of each session
  • Fix prompt for your coding agent
Animation: AI agents with different profiles browse Northwind Bikes, a fictional bike rental, and the problems they found appear, the worst first. Example: Northwind Bikes (fictional) · AI agents

Every site gets its own visitors. A few examples:

  • First-time buyer delivery costs
  • Procurement comparing plans
  • Member wants to cancel
  • Developer API docs
  • No context what is this?
  • Customer tracking an order

Works for

How it works

From your URL to what to fix

  1. Enter your URL, we create your user profiles

    A company website, an online store, a membership site, a web app behind a login, or a mobile app, Android or iPhone (you upload it instead of a URL). We work out what you sell and who it is for, and create profiles of your typical users, each with a different goal.

    Illustrative example: Northwind Bikes

    Made-up example: northwindbikes.com, a fictional bike rental, is typed into the URL box and Test is pressed.

    • Website
    • Online store (detected type)
    • Membership
    • Web app
    • Android app
    • iPhone app

    The Northwind Bikes home page is scanned.

    • Sells: city bikes, e-bikes and tandems to rent
    • For: tourists, commuters and families
    • Visitors want: price per day, availability, pickup point

    User profiles

    • Ana · AI agent Tourist planning a weekend Goal: How much for two days?
    • Leo · AI agent Daily commuter Goal: A monthly e-bike
    • Sara · AI agent Parent with two kids Goal: Kids’ bikes and helmets
  2. They use it for real, on video

    AI agents play each user profile in a real browser on desktop and mobile, or in your Android or iPhone app on a phone. We record every click, what they think and where they get stuck.

    Example session · Northwind Bikes (fictional)

    Three AI agents, each playing one user profile, enter northwindbikes.com one after another in a recorded browser. The bike cards only say “See details”, with no price; prices are on a Rates page linked in the footer.

    • Every session is recorded on video
    • What each agent thinks, step by step
    • Where they get stuck, marked for the report

    What each agent thinks while browsing:

    • Tourist planning a weekend: “Nice bikes. But how much for two days?”
    • Daily commuter: “Still no price on any bike. Do I have to call?”
    • Parent with two kids: “Is the helmet included? I can’t tell.”
  3. You get what to fix

    Every problem it finds, ranked by impact with the 3 worst first, each with video evidence, plus a fix prompt ready to paste (complete, with before/after mockups, on the Full study, Pro and Agency). Fix, re-test, repeat.

    Example report · Northwind Bikes (fictional)

    The 3 worst first · full list in the report

    1. High Prices are only on the Rates page, linked in the footer 14 of 24 sessions · Video
    2. Medium On mobile, the Book button sits below the fold 7 of 24 sessions · Video
    3. Low Nobody knows if the helmet is included 5 of 24 sessions · Video

    Before: the city bike card only says “See details”, with no price. After: it shows “from €12/day” and a Book button.

    Before/after mockup (illustration)
    fix-prompt.md
    # Fix 1: prices are only on the Rates page
    Evidence: 14 of 24 sessions (video 01:22)
    Change: show “from €12/day” on every bike card
    Check: re-test the price task with the same user profiles

    Fix, re-test, repeat

    See real results

See the full method Watch recorded sessions

Real cases

Real findings from real websites and apps

We have run UX Surgery on a range of real websites and apps, from service websites to web apps behind a login and an Android app. A few of the problems the AI agents found, anonymised:

Found in real studies Real finding

  1. With “Rent” selected, the price filter still used sale prices.Real-estate agency website
  2. A visit showed as “Done” while several of its forms still said “Fill in”.Clinical-trial back office · web app behind a login
  3. The offer was clear, but who applies the fixes was not.uxsurgery.com, our own site

See the real cases

AI agents, not real people: their findings are hypotheses backed by evidence, not opinions of real customers.

From real studies

The problems we find most often

The three most serious patterns from our studies of real products, run with AI agents: the ones that send people on a detour come first.

  1. Buttons and links that lead nowhere, or somewhere else

    Severity: Major detour

    Seen in 45% of studies

  2. What they need is there, but buried

    Severity: Major detour

    Seen in 36% of studies

  3. Costs and conditions left unanswered

    Severity: Friction

    Seen in 55% of studies

See all 8 patterns with anonymised examples

Why not just ask a chatbot?

A chatbot reads a screenshot. Our agents use your site: they click, wait, run into pop-ups and errors, and every step is on video.

See the side-by-side comparison

Pricing

Start free. Pay once or monthly.

First UX test

$0 free

See what the method finds on your own site or app before you pay anything.

  • Your website or Android app (APK)
  • 3 sessions
  • The 3 worst problems
  • One session video
  • Full report unlocks with a Quick or Full study

ExamplePaste northwind.example and see what first-time visitors think it is, and the first problems they hit.

Get my free first UX test: First UX test

Quick study

$29 one-time

One website, one price. No subscription.

  • One website, 12 sessions
  • Every problem ranked, with all the videos and screenshots
  • Fix prompt for the 3 worst problems, for your coding agent: you apply the fixes, we never touch your site
  • 90 days of access

Example3 profiles × 2 tasks × 2 formats (desktop + mobile) = 12 sessions on one site.

Start with a free first UX test: Quick study

Full study

$79 one-time

Fix, then check the fix worked with the same profiles and tasks.

  • One website, 36 sessions
  • Everything in Quick study
  • Complete fix prompt, with every problem
  • Before/after mockups of the 3 worst problems
  • One re-test included: a second round of 36 sessions after your fixes
  • Before/after comparison in the history
  • Script to validate with real people
  • 90 days of access

Example6 profiles × 3 tasks × 2 formats = 36 sessions in May; you ship the fixes, and the June re-test shows which problems are gone.

Start with a free first UX test: Full study

Pro

$99 per month

For teams shipping every week.

  • 150 credits a month
  • 5 projects
  • Web apps with login
  • Android apps (iPhone apps: Agency)
  • Complete fix prompt
  • Before/after mockups of the 3 worst problems
  • Follow-up re-tests

Example2 web rounds of 36 sessions (72 credits) + 1 app round with login of 24 sessions (48) + 1 Android round of 12 sessions (24) = 144 of 150.

Choose Pro: Pro

Example A Full study: 6 profiles × 3 tasks × 2 formats = 36 sessions

See all plans and the credits calculator

Questions

Are the AI agents real people?

No. They are software that uses your site or app with a goal, a pace and simulated abilities. They are good at finding the obvious problems quickly. Treat their findings as hypotheses backed by video, and confirm the important ones with real people.

Will the test change anything on my site?

On public sites the users only read and navigate. They do not submit forms that create orders, accounts or messages, and they never submit payments. If you allow it on your own site, they can sign up and confirm emails using UX Surgery test inboxes (only a test address and a first name are sent). Testing inside a web app requires a verified domain and test accounts you provide. A mobile app runs only from the build you upload.

Does it work for mobile apps?

Yes. Upload your app and AI agents install it on a phone and use it like your customers, signed in with test accounts if needed. You get the same videos, findings and fix prompt as for a website. Android apps (you upload the APK) from the Pro plan, and in the free first UX test too; iPhone apps on real devices (beta, Agency plan: you upload the .ipa).

Which coding agents does the fix prompt work with?

Any of them. It is plain Markdown: Claude Code, Codex, Cursor, or a developer reading it as a ticket.

Can I test a site that is not mine?

Its public pages, yes: the agents browse like an anonymous visitor and only read, without signing up, filling in forms or buying: on third-party sites we don’t submit forms. Areas behind a login, web apps with test accounts and mobile apps need the owner’s authorization. If you publish results about someone else’s site, present them as AI-generated synthetic observations.

Are the Quick and Full studies subscriptions?

No. One site, one price, 90 days of access to the report. Nothing renews.

See where people get lost on your site.

Paste your URL. In a few minutes you get the 3 worst problems and one session video.

3 AI agent sessions on your site, the 3 worst problems and a video.