Responsible AI
Accessibility and Inclusive AI Design
Integrate accessibility and inclusive design into requirements, data, interfaces, evaluation, operations, and recourse.
By the end you can
- Explain why accessible AI provides equivalent, usable, testable routes across diverse needs, technologies, and environments
- Distinguish Accommodation after launch, Accessible-by-design system, and Single-channel optimization
- Identify evidence that connects perceivable to recoverable
- Design a review that moves from identify access contexts to monitor burden
Example
0.35 against 0.19: five commercial recognizers, the same matched audio
Recognition failure in a booking assistant is not a scenario to be imagined. It has been measured, on the systems a clinic would actually buy. Koenecke and colleagues ran five commercial recognizers over the same audio: Amazon, Apple, Google, IBM and Microsoft. The audio was 19.8 hours of matched interviews, 42 white speakers and 73 black speakers, recorded across five US sites. The result appeared in PNAS in 2020: "all five ASR systems exhibited substantial racial disparities, with an average word error rate (WER) of 0.35 for black speakers compared with 0.19 for white speakers". Black men were worst affected, at 0.41 against 0.30 for black women.
Now put that recognition layer under a voice assistant that schedules patient appointments. Speech impairments, noisy homes, regional accents, people who need extra time to answer, and a phone line with long waits as the fallback. The benchmark result stops being a benchmark result. It decides who gets an appointment and who gets the queue.
- Input barrier: Speech is treated as the default channel and the most trusted one. Off the shelf, that channel is expensive for anyone whose speech the model was not fitted to. Green and colleagues had 432 people with self-reported disordered speech each record at least 300 short phrases. Models trained on typical speech reached a median word error rate of 31% on them.
- Model disparity: Recognition quality varies with impairment, accent, microphone and environment — 0.35 against 0.19 in that study, and every one of the five vendors showed it. This is not one bad supplier to be swapped out.
- Interface pressure: Short timeouts disadvantage people who need more time to respond, and they compound the first two bullets. A recognizer that mishears is met by an interface that will not wait for the correction.
- Fallback inequality: The alternative channel imposes delay, cost and stigma. EN 301 549 clause 6.4 requires such a route to exist at all. It does not ask what using it costs the person who must.
- Measurement gap: Average task completion hides exclusion by access need and context. Averages hide it even inside a named group, as the split between 0.41 for black men and 0.30 for black women shows.
Comparison
Accommodation after launch, Accessible-by-design system, or Single-channel optimization?
Accommodation after launch handles users one at a time. Accessible-by-design builds the second route into the product. Single-channel optimization quietly picks a winner — and the disordered-speech work shows what the winner's margin is made of.
Speaker-independent models transcribed those 432 speakers at a median WER of 31%. Personalized models reached 4.6% on the same speakers. They also beat expert human transcribers, by a median accuracy gain of 9% and a maximum of 80%. The abstract states it plainly: "The accuracies of personalized models were high (median WER: 4.6%) and better than those of speaker-independent models (median WER: 31%)."
The distance between those two medians is not a limit of the technology. It is a record of whose speech the shipped model was fitted to. Accessible-by-design is a build decision. So is single-channel optimization.
Accommodation after launch
Adds exceptions for individual users.
- Necessary when needs arise
- Often slow and burdensome
- Can stigmatize or expose disability
- Does not repair systemic barriers
Accessible-by-design system
Builds equivalent routes and testable requirements early.
- Reduces dependence on disclosure
- Improves usability for broader populations
- Requires diverse testing and procurement criteria
- Can still need individual accommodation
Single-channel optimization
Maximizes performance for the dominant interaction.
- May simplify engineering
- Creates exclusion and fragile fallback
- Average metrics can look excellent
- Risk rises in essential services
The mechanism behind accessibility and inclusive design
Accessibility asks one question about the people who use a system: can they perceive it, understand it, operate it and recover from it? The people include those with diverse sensory, physical, cognitive, linguistic and technological needs. Inclusive design treats that variation as a core requirement rather than an edge case. Responsible design offers equivalent routes, supports assistive technologies, avoids unnecessary time pressure, preserves user control, and evaluates real tasks with diverse participants.
Accessibility covers the model, the interface, the content, the support process and the remedy. Those layers are not equally governed. WCAG 2.2 and EN 301 549 write testable requirements for the interface and the content. The layer where the recognizers returned 0.35 against 0.19 has no comparable success criterion to fail against. So a team that treats conformance as the whole of accessibility can pass its audit and still lose the patients whose speech the recognizer mishears.
Recovery is the verb that gets dropped: a system someone can perceive, understand and operate but not back out of has still failed them.
Visual
Recoverable is where conversational interfaces fail
Perceivable, operable, understandable, robust, recoverable. Five properties, and the fifth is where conversational interfaces most often fail. It is also the only one on this map that is already a written requirement rather than a design preference.
That requirement has a number. WCAG 2.2 carries it at Success Criterion 3.3.4, Error Prevention (Legal, Financial, Data), Level AA. It covers pages that cause legal commitments or financial transactions, that modify or delete user-controllable data, or that submit test responses. For those, one of three things must be true. Submissions are reversible — "Reversible: Submissions are reversible". Or entered data is checked, with an opportunity to correct it. Or a mechanism exists for reviewing, confirming and correcting the information before final submission.
Europe makes the same criterion normative. Clause 9.3.3.4 of EN 301 549 says: "Where ICT is a web page, it shall satisfy WCAG 2.1 Success Criterion 3.3.4 Error Prevention (Legal, Financial, Data)." A patient who has booked the wrong slot, cannot reverse it, cannot have the entry checked, and is offered no confirmation step is not meeting a design regret. That is a standards failure with a clause number on it.
- 1
Perceivable
Information and status can be sensed through appropriate modalities.
- 2
Operable
Controls work with keyboard, switch, voice, touch, and assistive tools.
- 3
Understandable
Language, feedback, and consequences are clear and predictable.
- 4
Robust
Interfaces interoperate across devices, browsers, and assistive technologies.
- 5
Recoverable
Users can correct errors, switch channels, obtain help, and preserve progress.
Key idea
Another route is not equivalent service
A technically available fallback is not equivalent. Not if it adds delay, cost, loss of privacy, or lower service quality. Accessibility should compare outcomes and burden, not merely whether another button exists.
The standard makers drew the first half of that line and stopped there. EN 301 549 is the harmonised European standard for ICT accessibility, and the European Commission made it the cited reference standard in 2021. Its clause 6.4 is titled "Alternatives to voice-based services". It reads: "Where ICT provides real-time voice-based communication and also provides voice mail, auto-attendant, or interactive voice response facilities, the ICT shall offer users a means to access the information and carry out the tasks provided by the ICT without the use of hearing or speech." Annex C.6.4 turns that into an explicit pass/fail inspection. A reviewer gets something to mark rather than an argument to have.
What the clause settles is existence. The voice assistant's fallback was a phone line with long waits. That is a means. It is another route to the appointment in the same sense that a queue is another appointment.
No design anticipates every access need either. Organizations need ongoing feedback, accommodation, support and procurement processes that can respond without forcing users to prove the same harm again and again.
Ask who is made to prove the harm: if the same users must re-argue for an accommodation each time, the fallback has become their permanent service.
Example
Walk the task without audio, without vision, without a mouse
Complete the task yourself under each constraint before reading anyone else's accessibility report about it. The clauses below exist so that what you find has somewhere to be filed. They do not substitute for finding it.
- Barrier walk-through: Complete the task without audio, without vision, with keyboard only, and under slow connectivity.
- Equivalent-service test: Compare time, privacy, error recovery and outcome across the primary and the fallback channel. That is the burden question clause 6.4 leaves open once the second route exists.
- Procurement clause: Require accessibility evidence, remediation timelines and compatibility after updates. Name the instrument: EN 301 549 clause 6.4, with the Annex C.6.4 pass/fail inspection. The standard's own Scope says its requirements are written "in a form that is suitable for use in public procurement within Europe".
- User feedback: Create an accessible channel that reaches product owners rather than only support staff.
Steps
How to test accessibility and inclusive design before release
Equivalent outcome is the standard, not equivalent effort. Identify the access contexts, define the outcomes each route must deliver, build multimodal control, test with participants, then monitor burden. The later steps are the ones that test whether the fallback costs a user more time, more privacy or more repetition.
Step 4 is the step teams describe as an activity and never size. Here is what it costs and yields at full scale. In 2025 a challenge at Interspeech ran on speech gathered by the Speech Accessibility Project at the University of Illinois Urbana-Champaign: "the 2025 Interspeech Speech Accessibility Project (SAP) Challenge was launched, utilizing over 400 hours of SAP data collected and transcribed from more than 500 individuals with diverse speech disabilities". The top team reached a word error rate of 8.11%, with a semantic score of 88.44%.
The project itself had recordings from about 2,000 participants by the end of September 2025. It is funded by Amazon, Apple, Google, Meta and Microsoft — the same industry whose shipped systems produced the disparity in the case above. Testing with disabled participants at that scale is a dataset and a leaderboard, not a demonstration. A team that cannot reach it should at least know what number it is not measuring against.
1. Identify access contexts
Map disabilities, languages, devices, environments, and temporary constraints.
2. Define equivalent outcomes
Specify what users must accomplish across interaction routes.
3. Build multimodal control
Support alternatives, adjustable timing, confirmation, and correction.
4. Test with participants
Evaluate end-to-end tasks using assistive technologies and real environments.
5. Monitor burden
Track completion, fallback, delay, abandonment, complaints, and accommodation.
When evidence about accessibility and inclusive design supports restriction or redesign
Accessibility that survives one release and breaks at the next was never a property of the system, only of that build. The same thing happens to deadlines. At sector scale that is a matter of public record.
On 24 April 2024 the US Department of Justice published its ADA Title II rule on web and mobile accessibility, effective 24 June 2024. It adopted WCAG 2.1 Level AA as the technical standard for state and local government web content and mobile apps. Compliance was due on 24 April 2026 and 26 April 2027. Then, on 20 April 2026, the Department published an interim final rule that pushed both dates back a year: "On April 20, 2026, the Federal Register published the Department's Interim Final Rule (IFR) extending the compliance date for State and local government entities with a total population of 50,000 or more to April 26, 2027." The later date moved to 26 April 2028. A requirement that can be moved a year is not a schedule a team can plan a rebuild around.
Set the completion, fallback and abandonment numbers that force the team to redesign, restrict, remedy or retire the system. Your own thresholds, rechecked after each release — because the external date may not be where you left it.
Case
WCAG 2.2: nine success criteria more than 2.1
Two external standards give this argument the numbers it otherwise lacks. WCAG 2.2 became a W3C Recommendation on 12 December 2024. It adds nine new success criteria to WCAG 2.1: 2.4.11, 2.4.12, 2.4.13, 2.5.7, 2.5.8, 3.2.6, 3.3.7, 3.3.8 and 3.3.9, each marked "new in WCAG 2.2". The conformance scheme is left intact: "three levels of conformance are defined: A (lowest), AA, and AAA (highest)".
The count of nine is not only the standards body's own bookkeeping. The U.S. Access Board is a federal agency, not the body that wrote the guidelines. It recorded the same figure when the standard appeared in 2023: "WCAG 2.2 adds nine new Success Criteria to WCAG 2.1". WCAG carries regulatory weight in the United States as well. The Department of Justice's Title II rule adopted WCAG 2.1 Level AA as the technical standard for state and local government web content and mobile apps.
Case
The European Accessibility Act, applying since 28 June 2025
In the European Union the reference instrument is the European Accessibility Act, Directive (EU) 2019/882, adopted on 17 April 2019. It covers computers and operating systems, ATMs, ticketing and check-in machines, smartphones, telephony services and related equipment, e-books, consumer banking and e-commerce.
The commencement date is not folklore repeated between advisers. Ireland's transposing instrument, S.I. No. 636/2023, was signed in December 2023. It states at Regulation 1(2): "These Regulations shall come into operation on 28 June 2025." It applies the requirements to products placed on the market and services provided to consumers on or after that date, with transitional cover for pre-existing service contracts until 28 June 2030.
Both instruments give a reviewer something to fail a build against. Neither reaches the model behaviour this lesson is about. Nothing in that enumerated scope, and nothing in the nine added success criteria, asks why the word error rate was 0.35 for one group of speakers and 0.19 for another. That gap is worth writing down.
Key takeaways
- Accessibility covers the model, the interface, the content, the support workflow and the remedy — and only some of those layers have a clause number. WCAG 2.2 and EN 301 549 govern the page; the recognizer that returned 0.35 against 0.19 is unaddressed by either.
- Inclusive design treats human variation as a core requirement rather than an edge case, and the cost of not doing so is measurable: for 432 speakers with disordered speech, a median WER of 31% from speaker-independent models against 4.6% from personalized ones.
- Compare fallbacks on outcome, delay, cost, privacy and dignity. EN 301 549 clause 6.4 requires only that a route without hearing or speech exist, so the burden comparison is the reviewer's to run.
- Average task performance can conceal complete exclusion of smaller groups. Even the matched-audio study's own averages hid a further split: 0.41 for black men against 0.30 for black women.
- Test with assistive technologies in real operating environments. The 2025 Interspeech Speech Accessibility Project Challenge shows the scale that makes such testing conclusive — over 400 hours from more than 500 individuals, with a best result of 8.11% WER.
- Ongoing accommodation stays necessary even when accessibility is designed in, because recovery routes must be maintained per release — WCAG Success Criterion 3.3.4 asks for reversible, checked or confirmed submissions at Level AA — and because external deadlines move, as 24 April 2026 moved to 26 April 2027.