AI Academy: Building Generative AI Literacy in Higher Ed Instructors DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Applied computing Computer-assisted instruct
Si Chen, Xiuxiu Tang, Alison Cheng, Nitesh Chawla, G. Alex Ambrose, Ronald Metoyer · 2025
Read AI Academy: Building Generative AI Literacy in Higher Ed Instructors DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Applied computing Computer-assisted instruct by Si Chen, Xiuxiu Tang, Alison Cheng, Nitesh Chawla, G. Alex Ambrose, Ronald Metoyer (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-11999.txt.
Introduction
University instructors, not students, sit at the center of a 2025 study by Si Chen and five co-authors on generative AI literacy. Their program, the AI Academy, mixed hands-on exploration of AI tools with pedagogical reflection and peer learning for faculty.
Twenty-five instructors took part, tracked through surveys before and after, learning logs, and facilitator interviews. The group made clear gains in AI literacy, and the study frames them as designers of responsible classroom practice rather than passive adopters. What shapes that growth, the authors find, is a web of tools, campus policies, colleagues' habits, and institutional support. The write-up offers a program model others can copy, a survey instrument built together with participants, and design lessons for training that keeps pace with fast-changing tools.
Catalog record
| CREATOR | Si Chen, Xiuxiu Tang, Alison Cheng, Nitesh Chawla, G. Alex Ambrose, Ronald Metoyer |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 65 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-11999
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
AI Academy: Building Generative AI Literacy in Higher Ed Instructors DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Applied computing Computer-assisted instruction CCS: Social and professional topics Computing literacy Si Chen, Xiuxiu Tang, Alison Cheng, Nitesh Chawla, G. Alex Ambrose, Ronald Metoyer Abstract . Generative AI is reshaping higher education, yet research has focused largely on students, while instructors remain understudied despite their central role in mediating adoption and modeling responsible use. We present the AI Academy , a faculty development program that combined AI exploration with pedagogical reflection and peer learning. Rather than a course evaluated for outcomes, the Academy provided a setting to study how instructors build AI literacies in relation to tools, policies, peer practices, and institutional supports. We studied 25 instructors through pre/post surveys, learning logs, and facilitator interviews. Findings show AI literacy gains alongside new insights. We position instructors as designers of responsible AI practices and contribute a replicable program model, a co-constructed survey instrument, and design insights for professional development that adapts to evolving tools and fosters ethical discussion. 1. Introduction Generative AI is rapidly reshaping higher education, raising urgent questions not only about how students use tools such as ChatGPT and Gemini, but also about how instructors themselves adapt to them. While existing research emphasizes student practices in writing, coding, or problem solving ( Kasneci et al. 2023 ; Zheng et al. 2023 ) , instructors remain understudied despite their central role in mediating adoption, setting classroom norms, and modeling responsible use ( Henderson et al. 2017 ; Holstein et al. 2019b ) . This gap matters because instructors’ approaches will determine not only how AI is integrated into curricula but also how future professionals learn to engage responsibly with these systems, aligning with emerging scholarship that situates AI adoption within the broader transformation of academic professions ( Paris et al. 2025 ) . Commercial platforms have begun releasing educator resources ( Microsoft 2023 ; OpenAI 2023 ) , but these are typically product-oriented rather than pedagogy-driven. They emphasize learning how to operate tools rather than grappling with the broader challenges instructors face in balancing ethics, assessment, workload, and credibility. We take a different perspective by foregrounding instructors not only as learners within sociotechnical systems but also as designers of responsible AI practice. We ask what it means to teach the teachers AI: to design professional development that goes beyond technical tutorials and instead builds literacy while also surfacing tensions around fairness, institutional policy, and professional identity. To explore this, we designed and deployed the AI Academy , a faculty development program that integrated technology exploration with pedagogical reflection and peer learning. We studied its first cohort of 25 instructors through pre and post surveys, participant learning logs, and facilitator interviews. This mixed-methods approach captures both measurable shifts in literacy and the sociotechnical dynamics that shaped the Academy’s effectiveness. We address the following research questions: RQ1. How effective was the AI Academy in supporting instructors’ self-assessed development of generative AI literacies? RQ2. What design and contextual factors influenced the Academy’s effectiveness? The AI Academy is not simply a training course to be evaluated for outcomes, but a case for understanding how instructors build generative AI literacies in relation to tools, policies, peer practices, and institutional supports. Our focus goes beyond measuring whether participants completed tutorials or improved skills with specific tools. Instead, we examine how design choices such as participatory co-construction of assessment instruments, collaborative reflection, and workflow redesign enable instructors to act as designers of their own responsible AI practices. Our contributions are threefold. First, we present the AI Academy program model as a replicable approach to advancing instructor literacy. Second, we introduce a co-constructed survey instrument that both assesses and evolves with participants’ practices. Third, we provide design implications for AI tools that support faculty development through adaptive feedback, failure-aware exercises, scenario-based training, and personalized learning pathways. Together, these contributions position instructors as designers of responsible AI practice and contribute to the design of professional development platforms and ecosystems, such as those that provide adaptive assessment, safe spaces for ethical discussion, and opportunities for collaborative reflection and workflow redesign. 2. Related Works 2.1. Teachers and Generative AI in Education Much early work on generative AI in education has focused on student use cases, from writing assistance to coding support and problem solving ( Kasneci et al. 2023 ; Zheng 2023 ) . These studies emphasize both opportunities (e.g., efficiency gains, rapid ideation, just-in-time feedback) and risks (e.g., overreliance, shallow learning, academic integrity concerns). In contrast, instructors—who mediate adoption and shape classroom practice—have received comparatively less systematic study. Unlike students, instructors must adapt pedagogical strategies, assessment practices, and professional roles to incorporate AI into teaching. Research in HCI and the learning sciences demonstrates the potential of teacher-facing systems to enhance awareness, reflection, and instructional decision-making. For example, learning analytics dashboards improve real-time teacher awareness and promote data-informed reflection ( Holstein et al. 2019a ; Holstein et al. 2018 ; Karumbaiah et al. 2023 ; Alfredo et al. 2025 ) . Professional development platforms and communities of practice highlight how digital systems can support ongoing growth and peer feedback ( Long and Magerko 2020 ; Alzoubi and Baran 2024 ) . In parallel, work on pedagogical agents and conversational support tools shows how systems scaffold not only student learning but also teacher adaptation, though these typically focus on K–12 or adaptive settings ( Apoki and Adekola 2022 ; Papoutsi and Rangoussi 2020 ; Peng et al. 2019 ) . Importantly, these efforts largely predate generative AI and therefore do not address the distinct integration burden instructors face when adopting open-ended, general-purpose tools in higher education. Our study responds to this gap by situating instructors as learners within the AI Academy , an institutional program that surfaces obstacles, enabling conditions, and adoption patterns in generative AI for higher education. 2.2. Generative AI Literacy Frameworks The concept of AI literacy builds on traditions of computational and digital literacy, emphasizing competencies such as understanding AI principles, critically evaluating outputs, and using AI responsibly ( Long and Magerko 2020 ; Ng et al. 2021 ; Robertson et al. 2025 ) . These frameworks are increasingly applied in K–12 curricula and public initiatives, yet remain underexplored for higher education instructors ( Tagare et al. 2025 ) . Instructors face qualitatively different demands: aligning AI use with disciplinary epistemologies, balancing efficiency with integrity, and adapting teaching for new generations of learners. Insights from child–AI interaction research further highlight AI literacy as a practice cultivated through design and reflection ( Lin et al. 2020 ; Newman et al. 2024 ; Su and Zhong 2022 ) . For example, when children design AI agents, they develop agency and richer mental models of AI. Extending these findings to instructors underscores the importance of situated and reflexive literacy development, rather than static knowledge transmission. Generative AI literacy extends AI literacy by emphasizing the skills and dispositions needed to engage critically with systems that generate content. It includes prompt design, evaluation of outputs, and awareness of ethical, legal, and professional issues such as bias, authorship, and intellectual property.