Accessibility Tools Presentation

Analysis Method

What to Look At?

• Based on WCAG 2.0
• Looking at Success Criteria that can be found by automated tools
• Examine Bad Examples of Accessibility
• Objective Features of Each Tool

Which Rules to Check?

• For which Success Criteria does each Tool have at least one test?
• Which tools uniquely check for which Success Criteria?
• What percentage of Success Criteria are checked by each tool?

Summarized Information in an Automated Tools Data Page

Examples of Bad Accessibility

Some examples found...

• WCAG Failure Techniques
• "Bad Examples" in Accessibility Developer Tool documentation

...but they're unrendered.

Created a11yNot site to render Bad Examples and track which tools catch which Bad Examples.

Problems with Analysis Method

• Mapping of checks to Success Criteria may be innacurate/incomplete
• Many WCAG Failure Techniques can only be found by manual check
• Bad Examples might not have been implemented correctly
• Bad Examples might not actually be bad; haven't all been manually verified
• Bad Examples are not comprehensive for all checks for each tool
• Documentation of which tools find which issues might not be accurate