Generative AI for Culturally Responsive Assessment in Science: A Conceptual Framework

This study presents the core tenets that constitute culturally responsive science assessments (CRSciA) for K-12 education and aligned them with the capabilities of generative AI (GenAI). The tenets were identified based on their dominance in the literature, including Indigenous Language, Race and Ethnicity, Religious Beliefs, Family and Community, and Indigenous Knowledge. These tenets were instrumental in developing the GenAI-CRSciA framework and the subsequent prompts to generate CRSciAs aligned with the Next Generation Science Standards (NGSS) while comparing it with standard prompt strategies. The results showed that the GenAI-CRSciA approach outperformed standard prompting strategies in terms of generating CRSciAs, proving its effectiveness in addressing the ongoing challenges in science assessments. Even though the GenAI-CRSciA framework presented assessments that cover a range of the cultural backgrounds, it presents potential challenges such as compromising curricula core competencies and overgeneralization of students’ backgrounds; overlooking subcultural variations within a country or region, for example differences between urban and rural students, or between different ethnic or linguistic groups within the same nation, which can lead to bias and less effective CRSciA outputs. To address this, we recommend that teachers provide comprehensive and specific background information about their students when using the GenAI-CRSciA prompting, ensuring that the generated content is truly reflective of the students’ unique cultural contexts. In larger class settings, teachers could implement comprehensive local data indexing, where detailed student background information is uploaded and retrievable for use in crafting more personalized CRSciAs. We recommend educators make conscious efforts to validate the generated assessments with input from human experts, including community or family, educators, and even students who are knowledgeable about the cultural nuances. We also suggest continuous professional development would be necessary to enhance teachers’ understanding of the cultural tenets.