A Generative Security Application Engineering Curriculum
Wu-chang Feng David Baker-Robinson [email protected] [email protected] Portland State University Department of Computer Science · 2025
Read A Generative Security Application Engineering Curriculum by Wu-chang Feng David Baker-Robinson [email protected] [email protected] Portland State University Department of Computer Science (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-10900.txt.
Introduction
Wu-chang Feng and David Baker-Robinson describe a new course that teaches students to use generative AI for security work, published in 2025. Tools based on large language models are now doing many security tasks that people once did by hand. That shift changes what new workers in the field will face on the job.
The course shows students how to apply these tools to real security problems. It shifts class time toward the parts of the work that suit humans best. The rest is taught as work to hand to, and check with, the new tools. The authors argue this aligns training with how the field is changing, and will keep doing so as the tools evolve.
Catalog record
| CREATOR | Wu-chang Feng David Baker-Robinson [email protected] [email protected] Portland State University Department of Computer Science |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 30 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-10900
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Generative Security Application Engineering Curriculum Wu-chang Feng David Baker-Robinson [email protected] [email protected] Portland State University Department of Computer Science Abstract Generative AI and large language models (LLMs) are transforming security by automating many tasks being performed manually. With such automation changing the practice of security as we know it, it is imperative that we prepare future students for the technology landscape they will ultimately face. Towards this end, we describe an initial curriculum and course that attempts to show students how to apply generative AI in order to solve problems in security. By refocusing security education and training on aspects uniquely suited for humans and showing students how to leverage automation for the rest, we believe we can better align security education practices with generative AI as it evolves. 1 Introduction Generative AI and large language models (LLMs) are upending many disciplines including cybersecurity [ 32 ] . Specifically, they have been applied to aid incident response [ 31 ] , vulnerability discovery, exploitation, code generation [ 14 ] , reverse-engineering [ 17 ] , penetration testing [ 19 ] , and deception [ 39 ] . With this level of innovation changing the practice of security as we know it, it is essential that security educators adapt in order to prepare future students for the field. Towards this end, this paper describes an initial approach and curriculum for introducing students to the use of generative AI and LLMs in tackling a range of cybersecurity topics. The curriculum covers the fundamental building blocks for building LLM applications, how to secure them, and how to apply them towards solving problems in cybersecurity such as code summarization, code analysis, vulnerability discovery, exploitation, command generation, configuration generation, code generation, threat intelligence, and social engineering. 2 Approach Figure 1 shows a general overview of the content of the course organized into four different topic areas. The course begins by focusing on the use of large language models, since they are at the core of most generative security applications. Because the capabilities of models vary greatly based on the tasks they are trained for and the data they are trained on, and because new models emerge on a regular basis, students start by testing a number of available models in order to investigate their characteristics. Models by themselves have limited utility until they are able to interact with external resources. To support this, LLM frameworks have been created to enable developers to rapidly prototype LLM-enabled applications [ 24 , 29 ] . In the next part of the course, students experiment with building simple LLM applications using a variety of abstractions provided by the LangChain framework. One of the more challenging problems in developing LLM applications is to secure them against adversarial attack. In the third part of the course, students examine fundamental security issues that the applications they’ve developed are vulnerable to [ 38 ] . By compromising a set of vulnerable LLM applications, students develop a deeper awareness for LLM security. Finally, the last part of the course takes students on a tour of security-related tasks and topics that LLMs can (and sometimes can not yet) be applied towards. As current models have been known to give plausibly incorrect results and to respond to requests unpredictably, the exercises in this part consist of tasks with known “ground-truth” results in order for students to develop a better understanding of whether or not one can depend upon such models for automating security tasks. Figure 1: Course overview 3 Curriculum 3.1 Models The model being used is the heart of any LLM application. There are many to choose from, many different ways to interact with them, and many different tasks they can be applied towards. The curriculum begins with a short crash course on how models work including the probabilistic and non-deterministic underpinnings of LLMs, along with the ideas behind instruction-tuned models and the mixture of experts approach that enables more purpose-built responses from them. Common parameters that can be used to control a model’s behavior are also introduced such as model temperature, context window size, streaming, and safety. Finally, a range of open and closed source models are introduced. Students utilize the Ollama [ 34 ] framework to experiment with open-source models and to get an understanding of the costs associated with running models on virtual machines in the cloud. They also set up access to closed source models and examine their costs to get a sense for when such models make sense to use and when they are not cost-effective. After setting up model access, students practice using them. Specifically, the course covers the structure of prompts (e.g. instruction, input data, context, output indicator) [ 8 ] , prompt language (e.g. specificity, precision, clarity), prompt strategies (e.g. zero-shot, one-shot, few-shot prompting, chain-of-thought prompting) [ 45 ] , and a common set of model tasks and task benchmarks (e.g. text and code generation, text and code summarization, information extraction, question and answering, classification, and reasoning). Basic programmatic access to models using Python is shown along with model laboratory code that allows students to test a single prompt across multiple models at the same time for comparison purposes. 3.2 Framework Models, by themselves, have limited utility until they are able to interact with external resources. To enable this interaction, frameworks such as LangChain [ 24 ] and Llama Index [ 29 ] have been designed to support high-velocity development of LLM applications. The course’s exercises utilize LangChain due to its active developer base and plethora of integrations. 3.2.1 RAG application After teaching the basics of how to interact with language models using LangChain, students learn about in-context learning and how retrieval-augmented generation (RAG) can be employed to minimize language model hallucinations [ 21 ] . LangChain has many useful abstractions for each part of the extract, transform, and load (ETL) data pipeline, which students use in building an end-to-end RAG application. Specifically, the exercise includes: Figure 2: Vulnerable SQL agent • Prompt templates that instruct the model to take input from the user and respond to it using information retrieved via external sources. • Document loaders that retrieve and extract data from the local file system (PDF, CSV, DOCX), web sites (via URLs) and web services (Wikipedia, Arxiv). • Document transformers that can parse and process the loaded data to convert it to a more compact format such as HTML parsing via BeautifulSoup. • Chunkers that can split large documents into smaller pieces to allow the application to only include the most relevant parts of documents into the context in order to improve accuracy and reduce model usage costs [ 44 ] . • Embedding models that can support similarity searches by representing semantic content in documents as a large, multi-dimensional vector [ 18 ] . • Vector databases and indexes that can store documents and support similarity searches across them such as ChromaDB [ 5 ] . • Chains that can concisely compose the above components in a single, unidirectional pipeline to construct the final end-to-end RAG application. 3.2.2 Agents In the prior application, the developer hand-crafts a static plan and execution pipeline to implement an LLM-powered application. One of the promises of generative AI