Skip to content
Practice & implementation

Accessibility Testing: Methods and Approaches

Website accessibility testing: automated and manual testing methods, keyboard and screen reader testing and the professional WCAG audit at a glance.

13 min read TestingTestmethodenManuelle PrüfungScreenreaderWCAG-Audit

In short and in plain language

This post is about accessibility tests. Accessible means that everyone can use the site. This includes people with disabilities.

Test tools find many errors, but not all of them. Only a person can judge if an image text is good.

So experts also test by hand. They use just the keyboard. They check what the site passes on to screen readers. Tests with disabled users help too.

At the end you get a plan. It shows what to fix first. We can help you with this.

Accessibility testing is the decisive step on the path to BFSG compliance. But the testing landscape is complex: automated testing tools cannot check all accessibility aspects automatically; human judgment remains necessary (W3C/WAI). What the tools miss is left to manual testing by trained testers. Only the combination of automated scans, manual expert testing, screen reader tests and ideally user testing with affected users delivers a reliable picture of a website's accessibility.

Key takeaways

  • Automated tools cannot check every aspect of accessibility (W3C/WAI); in a test by the UK Government Digital Service, 29 percent (GDS, 2017) of the barriers built into a test page went undetected by all ten tools. Whether alt text is meaningful, tab order sensible or focus management sound needs human judgment.
  • A score of 100 only proves that no machine-detectable problems were found. Running the same engine in the CI/CD pipeline on every commit catches new machine-detectable errors before they go live.
  • The keyboard test needs no tooling - Tab, Shift+Tab, Enter, Space, Escape and arrow keys. It covers success criteria 2.1.1, 2.1.2, 2.4.3, 2.4.7 and 2.4.11.
  • Testing with at least two screen readers exposes what scans miss: alt text that exists but says nothing, ARIA attributes set to wrong values, and live regions that never announce dynamic content.
  • Contrast must reach 4.5:1 for normal text and 3:1 for large text; low text contrast was found on 81 percent (WebAIM Million Report, 2024) of the home pages of the top one million websites. Text must scale to 200 percent, and a cognitive walkthrough checks the main user journeys.
  • User testing with at least five people using different assistive setups surfaces real barriers. A WCAG audit reviews representative pages from home page to checkout and ends with an action plan ranked by severity plus a re-audit.

Why Automated Tests Are Not Enough

Automated testing tools analyze the DOM of a web page and test against a rule base. They can detect whether images have alt text, whether form fields have labels, whether color contrasts meet the threshold and whether heading hierarchy is correct. What they cannot test: whether alt text correctly describes image content, whether focus order is logical, whether dynamic content is accessible to screen readers and whether the page is cognitively understandable.

In a test by the UK Government Digital Service with 143 deliberately built-in barriers, 29 percent (GDS, 2017) went undetected by all ten automated tools tested. Many problems concern aspects requiring human judgment: Is link text meaningful? Is tab order sensible? Does focus management work for modals? Is dynamic content correctly announced? Only a manual tester can answer these questions.

Automated tests are nonetheless indispensable as a first testing layer and for continuous monitoring. They quickly identify obvious problems: missing alt text, contrast violations, missing labels and ARIA errors. These low-hanging fruits should be fixed before the more intensive manual testing begins. In CI/CD pipelines, automated tests prevent new, automatically detectable barriers from entering the code.

Automated Testing Tools: What They Cover

Automated testing tools come as browser extensions, as modules built into the browser developer tools, and as command-line tools for the pipeline. What they have in common is that they test the current page against a WCAG rule base. Results are typically grouped by severity (critical, serious, moderate, minor) and contain descriptions of the problem, the affected element and a solution hint. To turn these findings into a sound assessment, we consolidate them in our WCAG audit.

Many of these test engines are available as open-source libraries and can be integrated into automated test pipelines. Combined with testing frameworks, the checks can be run on every build or pull request. This helps keep new, automatically detectable accessibility problems out of production code. For existing projects, we recommend a baseline scan documenting the current state, followed by gradual error reduction.

Some tools extend the pure automated scan with guided manual tests that lead the tester through criteria that cannot be automated. Such guided tests combine automated detection with manual confirmation, covering a larger portion of WCAG criteria than a purely automated run – yet do not replace a full expert review.

Putting the Accessibility Score in Perspective

Many browser developer tools and online checkers output accessibility as a score from 0 to 100, often alongside performance, SEO and best practices. This value is based on a weighted evaluation of automatically found problems. A score of 100 does not mean the site is accessible, only that no automatically detectable problems were found.

Such scores often use the same open-source test engines as the specialized tools but supplement with their own checks. Results are less detailed than a dedicated review but offer a quick overview and are particularly useful for developers who want to check accessibility as part of their regular development workflow.

Understanding the limitations is important: an accessibility score of 100 merely means the tool's automated checks found no errors. The site may still have severe barriers detectable only manually. We recommend treating the score as a hygiene factor: a low value points to problems, but a high value does not prove accessibility.

CI/CD Integration: Automated Tests in the Development Pipeline

Automated accessibility tests deliver the greatest value when integrated into the CI/CD pipeline. With every code commit, an automated test engine checks the rendered pages for automatically detectable WCAG violations. Such violations are caught before they reach the production environment. The testing tools fit into build processes and block deployments when critical accessibility errors are found.

The setup effort is usually manageable – often, configuring an automated test engine as a test step in the existing pipeline suffices. Professional setup helps configure the tests correctly so that they deliver meaningful results.

Manual Keyboard Testing

The manual keyboard test is one of the most important individual accessibility tests. It requires no tools, just the keyboard: navigate through the page with Tab and Shift+Tab, activate elements with Enter and Space, close modals with Escape and navigate within widgets with arrow keys. Systematically check: Is every interactive element reachable? Is the order logical? Is focus always visible? Are there keyboard traps?

The keyboard test covers multiple WCAG criteria simultaneously: 2.1.1 (Keyboard), 2.1.2 (No Keyboard Trap), 2.4.3 (Focus Order), 2.4.7 (Focus Visible) and 2.4.11 (Focus Not Obscured). These criteria can be checked automatically only to a very limited extent, as they concern the page's behavior during interaction. The effort for a full keyboard test depends on the number and complexity of the page types.

Automated Scan

Automated checks against a WCAG rule base. Usable as a browser extension and in the CI/CD pipeline.

Accessibility Score

Score 0-100 in the browser developer tools. Quick overview. Not sufficient as the only test.

Visual Overlay

Display of problems directly on the page. Markers show errors, warnings and structural features.

Keyboard Test

Manual with Tab, Enter, Space, Escape and arrow keys. Covers 2.1.1, 2.1.2, 2.4.3, 2.4.7 and 2.4.11.

Screen Reader Test

With screen readers on Windows and macOS. Tests landmarks, headings, ARIA, forms and dynamic content.

User Testing

Tests with affected users. Reveals problems other methods often miss. Cognitive barriers.

Screen Reader Testing: The User Perspective

Screen reader tests simulate website usage by blind and visually impaired people. The tester navigates through the page with a screen reader on Windows or macOS and checks whether all content is accessible. Are landmarks correctly recognized? Are headings hierarchically correct? Do all images have alt text? Are forms correctly labeled? Are dynamic contents announced via live regions?

Screen reader testing uncovers problems that neither automated tools nor keyboard tests detect: meaningless alt text that is present but does not describe image content, ARIA attributes that are set but have incorrect values, live regions that do not function, and semantic structures confusing for screen readers.

We recommend testing with at least two different screen readers, as each interprets ARIA attributes and HTML semantics slightly differently. A sensible combination is a screen reader widely used on Windows plus the screen reader built into macOS. For mobile use, additional tests with the screen readers built into iOS and Android are advisable.

Testing Cognitive Accessibility

Testing cognitive accessibility is the most difficult area to standardize. WCAG 2.2 contains several criteria addressing cognitive accessibility: 3.3.7 (Redundant Entry), 3.2.6 (Consistent Help), 3.3.8 (Accessible Authentication) and the basic understandability criteria of Guideline 3.1. Testing requires evaluating whether texts are understandably formulated, whether error messages are helpful and whether page structure is predictable.

A structured cognitive walkthrough helps systematically check these criteria: the tester goes through the website's main usage paths and evaluates at each step whether the instruction is clear, whether the user can recognize what action is needed, whether feedback is understandable and timely and whether the user can orient themselves. This method identifies barriers relevant to all users, especially people with cognitive disabilities.

Color Contrast and Typography Testing: Measuring Visual Accessibility

Color contrasts are among the most common accessibility problems: low-contrast text was found on 81 percent (WebAIM Million Report, 2024) of the home pages of the top one million websites. Testing is comparatively simple: the WCAG contrast minimum is 4.5:1 for normal text and 3:1 for large text (from 18pt or 14pt bold). Automated contrast testing tools calculate the contrast ratio for any color combination and immediately show whether the requirement is met.

Beyond the pure contrast ratio, specialized tools test readability under different vision conditions: simulations for color blindness (protanopia, deuteranopia, tritanopia), reduced visual acuity and cataracts show how content appears to affected users. These simulations reveal problems invisible in pure contrast measurement – for example, two colors with sufficient contrast that become indistinguishable with red-green deficiency. A professional accessibility audit combines automated contrast testing with visual simulations for a more accurate picture.

Typography testing complements color testing: beyond contrast, font size, line height and character spacing significantly affect readability. WCAG 2.2 requires that users can enlarge text to 200 percent without content being clipped or functionality suffering. Responsive designs working exclusively with viewport units often fail this requirement because font size is tied to screen width rather than user settings.

User Testing with Affected Users

User testing with people with disabilities is one of the most informative forms of accessibility testing. No automated tool and no expert test can replace the real user experience. Users with various disabilities use their assistive technologies in individual ways and encounter barriers that testers cannot foresee.

For meaningful user testing, we recommend involving at least five users with different disability types: screen reader users (blind users), users with visual impairments (zoom, high contrast), keyboard users (motor impairments), users with cognitive disabilities and users with hearing impairments. Tests are conducted as moderated usability tests where users complete typical tasks on the website.

Insights from user tests feed directly into the action plan and receive high priority, as they document real usage barriers. User testing should not be conducted once but repeated regularly, especially after major redesigns or feature updates. How teams can run their own screen reader tests as a complement and document the findings is covered in our training programs.

Planning a Professional WCAG Audit

A professional WCAG audit combines automated and manual testing methods into a comprehensive review. The typical process begins with selecting representative pages: homepage, category page, product detail page, checkout process, contact form, login area and at least one content page. This sample covers the most important page types and interaction patterns.

Each selected page is tested against all relevant WCAG 2.2 AA criteria. Automated scans identify obvious problems. Manual tests check keyboard navigation, the screen reader output and cognitive understandability. Results are summarized in a prioritized action plan: critical problems (block access), serious problems (significant impairment), moderate problems (annoying but workaround exists) and minor problems (improvement potential).

The action plan contains for each problem a description, the affected page and element, the violated WCAG criterion, the priority and a specific solution suggestion. Based on the plan, implementation can proceed systematically and progress can be tracked. A re-audit after implementation validates corrections and identifies any new problems.

Audit documentation is as important as execution: a professional WCAG audit report not only lists found issues but prioritizes them by severity, affected user group and remediation effort. Critical barriers that completely block access (e.g., inoperable forms, missing alternative texts for central content) rank highest. Medium issues impair user experience but do not prevent access. Low priorities are optimization opportunities that improve accessibility but do not violate mandatory requirements. This prioritization enables a phased accessibility implementation with the greatest benefit first.

This article is based on data from: W3C/WAI (accessibility testing methods), GOV.UK Accessibility Blog of the Government Digital Service (tool test, 2017), WebAIM Million Report (2024), W3C WCAG 2.2 Recommendation (2023), W3C/WAI Easy Checks (2024), WebAIM Screen Reader User Survey (2024).

Related Articles

Practice & implementation

Accessible Customer Portals: Auditing the Login Area

Automated scans stop at the sign-in form. How a WCAG audit covers the protected area: scope, test accounts, session timeouts and screen reader testing.

13 min read
Practice & implementation

Screen Reader Optimization: Making Your Website Readable

Screen reader optimisation for websites: ARIA landmarks, roles, live regions, semantic HTML and screen reader testing on Windows, macOS and mobile devices.

14 min read
Practice & implementation

Accessible Product Pages: Variants, Gallery, Add to Cart

A flaw in the product template appears on every item page. How to make variant choice, gallery, price line and add-to-cart feedback accessible.

15 min read