research area Accessibility, research area Human-Computer Interaction
content type paperpublished September 2024

Automated Code Fix Suggestions for Accessibility Issues in Mobile Apps

AuthorsForough Mehralian, Titus Barik, Jeff Nichols, Amanda Swearngin

View publication

Accessibility is crucial for inclusive app usability, yet developers often struggle to identify and fix app accessibility issues due to a lack of awareness, expertise, and inadequate tools. Current accessibility testing tools can identify accessibility issues but may not always provide guidance on how to address them. We introduce FixAlly, an automated tool designed to suggest source code fixes for accessibility issues detected by automated accessibility scanners. FixAlly employs a multi-agent LLM architecture to generate fix strategies, localize issues within the source code, and propose code modification suggestions to fix the accessibility issue. Our empirical study demonstrates FixAlly’s capability in suggesting fixes that resolve issues found by accessibility scanners—with an effectiveness of 77% in generating plausible fix suggestions—and our survey of 12 iOS developers finds they would be willing to accept 69.4% of evaluated fix suggestions.

Related readings and updates.

Towards Automated Accessibility Report Generation for Mobile Apps

Many apps have basic accessibility issues, like missing labels or low contrast. Automated tools can help app developers catch basic issues, but can be laborious to run or require writing dedicated tests. In this work, we developed a system to generate accessibility reports from mobile apps through a collaborative process with accessibility stakeholders at Apple. Our method combines varied data collection methods (e.g., app crawling, manual…
See paper details

AXNav: Replaying Accessibility Tests from Natural Language

Despite increasing awareness of the need to support accessibility in mobile apps, many still lack support for key accessibility features. Developers and quality assurance testers often rely on manual testing to test accessibility features throughout the product lifecyle. However, manual testing can be tedious, often has an overwhelming scope, and test passes can be difficult to time amongst other development milestones. Recently, Large Language…
See paper details