Enhancing Public Speaking Skills in Engineering Students Through AI

Amol Harsh 1 , Brainerd Prince 2 , Siddharth Siddharth 1 , Deepan Raj Prabakar Muthirayan 1 , Kabir S Bhalla 1 , Esraaj Sarkar Gupta 1 , Siddharth Sahu 1 · 2025

Read Enhancing Public Speaking Skills in Engineering Students Through AI by Amol Harsh 1 , Brainerd Prince 2 , Siddharth Siddharth 1 , Deepan Raj Prabakar Muthirayan 1 , Kabir S Bhalla 1 , Esraaj Sarkar Gupta 1 , Siddharth Sahu 1 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-04995.txt.

Introduction

Amol Harsh and co-authors build an AI tool to coach engineering students in public speaking. Schools offer talks and short courses, but they cannot give each student long, personal feedback on both speech and body signs.

Their system joins speech study, computer vision, and mood sensing in one model. It scores pitch, loudness, pace, and tone, plus face signs, gestures, and stance. The aim is steady, tailored feedback at scale, so students can drill a key job skill that lectures alone rarely build in a safe, repeat setting on campus.

Catalog record

CREATORAmol Harsh 1 , Brainerd Prince 2 , Siddharth Siddharth 1 , Deepan Raj Prabakar Muthirayan 1 , Kabir S Bhalla 1 , Esraaj Sarkar Gupta 1 , Siddharth Sahu 1
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-04995

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Enhancing Public Speaking Skills in Engineering Students Through AI Amol Harsh 1 , Brainerd Prince 2 , Siddharth Siddharth 1 , Deepan Raj Prabakar Muthirayan 1 , Kabir S Bhalla 1 , Esraaj Sarkar Gupta 1 , Siddharth Sahu 1 Abstract This research-to-practice full paper was inspired by the persistent challenge in effective communication among engineering students. Public speaking is a necessary skill for future engineers as they have to communicate technical knowledge with diverse stakeholders. While universities offer courses or workshops, they are unable to offer sustained and personalized training to students. Providing comprehensive feedback on both verbal and non-verbal aspects of public speaking is time-intensive, making consistent and individualized assessment impractical. This study integrates research on verbal and non-verbal cues in public speaking to develop an AI-driven assessment model for engineering students. Our approach combines speech analysis, computer vision, and sentiment detection into a multi-modal AI system that provides assessment and feedback. The model evaluates (1) verbal communication (pitch, loudness, pacing, intonation), (2) non- verbal communication (facial expressions, gestures, posture), and (3) expressive coherence, a novel integration ensuring alignment between speech and body language. Unlike previous systems that assess these aspects separately, our model fuses multiple modalities to deliver personalized, scalable feedback. Preliminary testing demonstrated that our AI-generated feedback was moderately aligned with expert evaluations. Among the state-of-the-art AI models evaluated—all of which were Large Language Models (LLMs), including Gemini and OpenAI models—Gemini Pro emerged as the best-performing, showing the strongest agreement with human annotators. By eliminating reliance on human evaluators, this AI-driven public speaking trainer enables repeated practice, helping students naturally align their speech with body language and emotion—crucial for impactful and professional communication. I Introduction Effective communication is an essential skill for engineers, critical for bridging the gap between technical innovation and societal impact. Engineering professionals regularly interact with diverse stakeholders, many of whom lack technical expertise. Consequently, the ability to clearly and effectively convey complex ideas is not only beneficial but imperative for successful project implementation, stakeholder engagement, and career advancement. Effective communication facilitates collaboration, innovation dissemination, and informed decision-making, directly contributing to organizational and societal progress [ 16 ] . Despite its importance, current engineering curricula at universities frequently underrepresent comprehensive communication training, limiting exposure mostly to isolated workshops or occasional project presentations. This restricted approach is insufficient to cultivate the nuanced and sustained development required for adept public speaking [ 21 ] . Moreover, effective communication encompasses both verbal and non-verbal aspects—ranging from vocal modulation and clarity to gestures and facial expressions [ 22 ] . Traditional methods of communication training often fail to integrate these dimensions effectively, leaving a gap in students’ ability to master and harmonize their verbal and non-verbal communication skills. Another significant limitation arises from the reliance on human evaluators for providing individualized feedback on public speaking skills. Human evaluation, while effective, is inherently resource-intensive and subject to variability. The scalability of personalized feedback becomes problematic, especially in large classes typical of engineering institutions. Students thus face inconsistent or infrequent feedback, which impedes their ability to systematically improve their public speaking capabilities [ 10 ] . To address these challenges, this paper proposes a novel multi-modal Large Language Model (LLM)-based evaluator designed specifically for assessing and enhancing public speaking skills among engineering students. This advanced AI-driven approach seamlessly integrates speech analysis, computer vision, and sentiment detection to assess verbal parameters such as pitch, pacing, and intonation, alongside non-verbal elements including facial expressions, posture, and gestures. Finally, a novel contribution of this research is the introduction of a new concept, expressive coherence , an innovative measure ensuring alignment between verbal articulation and corresponding non-verbal cues, thereby offering a holistic assessment of communication effectiveness. Our literature review has revealed that this aspect of public speaking has not been explicitly captured in public speaking assessments. The broader implications of this research extend significantly beyond educational contexts: 1. Transforming Scalable Communication Training Across Disciplines. Although designed for engineering students, this multi-modal AI framework can extend to broader educational and professional contexts. By automating feedback, it reduces reliance on one-on-one coaching and scales personalized training to larger cohorts, potentially reshaping how institutions teach and assess oral communication. 2. Pioneering a More Holistic Metric for Human-AI Interaction. The concept of “expressive coherence” unites verbal and non-verbal cues, emphasizing their synergistic role in effective speaking. This metric paves the way for AI-driven evaluations that capture how speech, gestures, and emotional signals align—offering applications in remote collaboration, mental health assessments, and other human–AI interaction fields. Through this innovative multi-modal assessment, our research aims to transform public speaking training, enhancing both academic and professional communication standards. II Literature Survey Fig. 1: Overview of the AI-powered public speaking evaluation pipeline. Listing 1: An example snippet of rich multi-modal data combining text, vocal, and non-verbal features. ⬇ 1 [70.0 - 80.0 "secs" ]: { 2 "transcript" : "Now, ␣ we ␣ try ␣ to ␣ evaluate ␣ the ␣ trade ␣ off ␣ inaccuracy ␣ and ␣ energy ␣ consumption ␣ if ␣ we ␣ were ␣ to ␣ use ␣ these ␣ SLMs ␣ in ␣ scale ␣ instead ␣ of ␣ LLMs." , 3 "posture" : [ "Upright" ], 4 "pose" : [ "Open ␣ Pose ␣ (Arms ␣ Uncrossed)" ], 5 "pitch" : [ "Normal" , "High" , "Low" , "Normal" , "Low" , "Normal" , "Normal" , "Normal" , "Low" , "Low" ], 6 "loudness" : [ "Normal" , "High" , "Normal" , "Normal" , "High" , "Normal" , "Normal" , "Low" , "High" , "Low" ], 7 "speech_rate" : "144.00 ␣ words ␣ per ␣ minute" , 8 "intonation_pattern" : [ "Normal" , "High" , "Normal" , "High" , "High" , "High" , "High" , "Normal" , "Normal" , "Low" ], 9 "face_expression" : [ "neutral" ], 10 "horizontal_gesture" : [ "high ␣ unilateral ␣ gesture" , "medium ␣ wide ␣ unified ␣ gesture ␣ towards ␣ the ␣ left" , "high ␣ wide ␣ unified ␣ gesture ␣ towards ␣ the ␣ right" 11 ], 12 "vertical_gesture" : [ "high ␣ area ␣ unified ␣ falling ␣ gesture" , "normal ␣ area ␣ unified ␣ falling ␣ gesture" , "normal ␣ unilateral ␣ down ␣ or ␣ up ␣ gesture" , "normal ␣ unilateral ␣ down ␣ or ␣ up ␣ gesture" , "high ␣ area ␣ unified ␣ rising ␣ gesture" 13 ], 14 "hand_configuration" : [ "Left ␣ hand: ␣ open, ␣ Right ␣ hand: ␣ open" , "Hands ␣ on ␣ top ␣ of ␣ each ␣ other: ␣ No" 15 ] 16 } Fig. 2: An example snippet of rich multi-modal data combining text, vocal, and non-verbal features. Engineers’ career success and educational outcomes are closely linked to communication skills, especially oral communication and public speaking. These abilities are seen as critical for employability, interdisciplinary collaboration, and career advancement. Studies highlight their value across alumni surveys, workplace interviews, and employer assessments, often ranking them as highly as technical competencies. Engineering education is thus increasingly urged to integrate structured public speaking training [ 16 , 14 , 6 , 22 , 5 ] . Despite its importance, teaching and assessing public speaking in engineering programs face significant challenges. Traditional academic settings

Read the complete text