Automated evaluation of accessibility issues of webpage content: tool and evaluation

Abstract In recent years, there has been a growing field of research focused on comprehending complexity in relation to web platform accessibility. It has shown that it is quite difficult to accurately assess and identify web accessibility concerns while taking multifaceted factors into account. It is imperative to prioritize multi-dimensional characteristics as they facilitate the integration of many aspects into the assessment process, which is a critical component in enhancing the accessibility evaluation process. Although many existing solutions with varying degrees of computational success have been proposed by scholars, they are confined to (1) following a certain set of rules of a specific guideline; (2) limited evaluation properties; (3) disregard for user criteria; and (4) complex functional properties or architectural design. To address these problems, we present in this work a straightforward yet precise model that assesses webpage accessibility by taking into account common features of the structural and visual elements of webpages that are part of the HTML Document Object Model (DOM) structure. In order to predict a webpage’s accessibility status, we implemented three distinct algorithms to analyze web features/objects considering both semantic and non-semantic aspects. We performed experimental work to validate 20 university webpages in Hungary through our developed tool. The computed result of the developed tool was assessed by comparing the result with a user study where we performed user testing that included 40 users’ 80 reviews on the same 20 university webpages in Hungary. Additionally, we compared our developed tool with other scientific models (that already exist) and existing ten open-source commercial automated testing tools considering several functional characteristics or properties. This two-phase assessment result shows that the developed tool has several advanced properties and the potential to predict the accessibility issues of the tested webpages.