Skip to content
artificia11y Amplifying everyone

Research

This page points to the primary sources behind the rest of the site. It is a starting set rather than a complete bibliography, and each item is something you can cite or learn from directly. Where a source shaped a specific page, that page links to it as well.

Synthetic users are AI personas meant to stand in for real testers. They matter for accessibility because disabled people are the users a model trained on web data represents least well, so a simulated panel tends to miss them and the real testers it would replace are often the ones a product most needs. These sources cover both the pitch and the evidence against it.

  • Lu and colleagues at Amazon and Northeastern, an LLM agent-based usability testing framework for web design. Builds a system that generates thousands of simulated users to walk through a website, with one module driving the agents and another connecting them to a real browser. The authors frame it as a way to pilot and refine a study design before running it with real people rather than as a replacement, and their evaluation with five UX researchers welcomed the idea while raising concerns about leaning on simulated users.
  • Researchers at UXtweak and the Slovak University of Technology, a systematic review of synthetic participants generated by large language models. A review of 182 studies that sorts the failures of LLM-generated participants into four kinds, cognitive misalignments, distortions, misleading believability, and overfitting or contamination. It concludes that synthetic participants cannot replace human ones, and that prompt techniques like few-shot examples or chain-of-thought reasoning give only marginal improvement because the underlying problems stay the same.
  • Microsoft Research, OmniParser v2, turning a screenshot into structured elements an agent can act on. This is the perception layer an agent needs before it can use a real interface, and it is near the current state of the art for finding clickable regions on screen. On a benchmark of high-resolution screens with small icons it still reaches only 39.6 percent average accuracy paired with GPT-4o, which caps how reliable any AI that drives a real interface can be today.
  • The Microsoft accessibility LLM evaluation report measures how often generated markup is accessible, from 12 percent unguided to 86 percent with a dedicated skill.
  • Karl Groves on remediation and AI audits quantifies where AI assistance breaks down.
  • The Deque accessibility coverage report is the usual source for the automation ceiling, the share of issues automated tools can find.
  • The WebAIM Million annual analysis of the top one million home pages, whose 2026 edition found accessibility errors rising for the first time in six years, attributed in part to automated and AI-assisted coding.
  • David Mello on what axe and Lighthouse miss is a practitioner account of the gap between a clean automated run and real conformance, and which missed checks a behavioral test can still cover. His walkthrough of testing AI chatbots and agents covers non-deterministic output, guardrails, bias, and the accessibility checks a chat interface needs in both its open and closed states.
  • Adrian Roselli on Google’s Modern Web Guidance tested Google’s AI coding guidance against the accordion prompt from its own homepage and found the result was not WCAG conformant, ignored the ARIA Authoring Practices Guide accordion pattern, and broke in Firefox. The takeaway is that a deterministic, vetted pattern library beats trusting generated code.
Audience: Accessibility Specialist

These are useful when WCAG runs out. For the parts of AI behavior with no success criterion, such as communicating uncertainty, you can anchor findings in the peer-reviewed work and the standards drafts here rather than in WCAG alone. The industry evaluations are also handy for setting expectations with a team, since a figure like 12 percent of unguided output passing checks lands harder than a general warning.

Audience: Self-advocate

The first-person and community sources here are worth reading directly, because they describe what these tools are actually like to use rather than how they are meant to work. The autoethnographic study and the community blogs in particular center disabled people’s own accounts, which is the kind of evidence that tends to be missing from vendor material.

  • The Foundations section for how these sources fit together.
  • The Case studies page for the same evidence as concrete situations.