This study aims to develop and validate an instrument to evaluate the comprehensive usability of artificial intelligence (AI) integrated educational platforms, extending the traditional notion of usability to include not only technical and pedagogical aspects but also accessibility, inclusivity and the use of AI as a support tool in complex thinking development.
A Likert-type questionnaire was developed and evaluated through expert judgment using the Delphi method. The panel comprised 11 professionals, all holding doctoral degrees and working in higher education institutions or ministries of education across seven countries (Mexico, Colombia, Spain, the UK, Greece, Jordan and Ukraine). Their roles span research, academic leadership, IT and pedagogical innovation, with expertise in usability, user experience, virtual environments and educational technologies.
The validation results indicate that the instrument demonstrates adequate levels of clarity, coherence and relevance. The findings suggest that the SmartUsability tool provides a structured approach for assessing the usability of educational platforms by integrating technological and pedagogical dimensions. In addition, the results emphasize the relevance of AI-related functionalities and the importance of inclusive and accessible design to address diverse learning needs.
This paper offers a validated instrument for assessing the usability of AI-enhanced educational platforms, contributing to the analysis of user experience from a technological, pedagogical and inclusivity-oriented perspective. The instrument provides a structured basis for future empirical validation and application in diverse educational contexts.
