Could ChatGPT get an engineering degree? Evaluating higher education vulnerability to AI assistants

Beatriz Borges, Negar Foroutan, Deniz Bayazit, Anna Sotnikova, Syrielle Montariol, Tanya Nazaretzky, Mohammadreza Banaei, Alireza Sakhaeirad, Philippe Servant, Seyed Parsa Neshaei, Jibril Frej, Angelika Romanou, Gail Weiss, Sepideh Mamooler, Zeming Chen, Simin Fan, Silin Gao, Mete Ismayilzada, Debji · 2024

Read Could ChatGPT get an engineering degree? Evaluating higher education vulnerability to AI assistants by Beatriz Borges, Negar Foroutan, Deniz Bayazit, Anna Sotnikova, Syrielle Montariol, Tanya Nazaretzky, Mohammadreza Banaei, Alireza Sakhaeirad, Philippe Servant, Seyed Parsa Neshaei, Jibril Frej, Angelika Romanou, Gail Weiss, Sepideh Mamooler, Zeming Chen, Simin Fan, Silin Gao, Mete Ismayilzada, Debji (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/pmc-11626143.txt.

Description

Beatriz Borges and a large team of co-authors present a 2024 study asking whether AI chatbots could pass an engineering degree. Students now use assistants like ChatGPT widely, which raises hard questions for exams and learning goals. The authors frame the issue as vulnerability: how much of a degree could such tools complete unaided?

They gathered text exam questions from 50 courses at a Swiss technical university, EPFL. Two assistants, GPT-3.5 and GPT-4, answered under eight prompting strategies. Graders then judged whether the answers would pass. The study measures the scale of the risk across science and engineering courses. Its results give universities hard numbers for rethinking take-home assessment in the AI era.

Catalog record

CREATORBeatriz Borges, Negar Foroutan, Deniz Bayazit, Anna Sotnikova, Syrielle Montariol, Tanya Nazaretzky, Mohammadreza Banaei, Alireza Sakhaeirad, Philippe Servant, Seyed Parsa Neshaei, Jibril Frej, Angelika Romanou, Gail Weiss, Sepideh Mamooler, Zeming Chen, Simin Fan, Silin Gao, Mete Ismayilzada, Debji
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE42 KB
VERSION1.0
LICENSECC BY 4.0
RIGHTSCC BY
SOURCEEurope PMC

Source: https://europepmc.org/articles/PMC11626143

Browse the full library · About the Tower of Babel