Fine Grained Insider Risk Detection

Birkett Huber, Casper Neo, Keiran Sampson, Alex Kantchelian, Brett Ksobiech, Yanis Pavlidis · 2024

Read Fine Grained Insider Risk Detection by Birkett Huber, Casper Neo, Keiran Sampson, Alex Kantchelian, Brett Ksobiech, Yanis Pavlidis (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2411-02645.txt.

Description

Abstract We present a method to detect departures from business-justified workflows among support agents. Our goal is to assist auditors in identifying agent actions that cannot be explained by the activity within their surrounding context, where normal activity patterns are established from historical data. We apply our method to help audit millions of actions of over three thousand support agents.

Catalog record

CREATORBirkett Huber, Casper Neo, Keiran Sampson, Alex Kantchelian, Brett Ksobiech, Yanis Pavlidis
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE13 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2411-02645

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Fine Grained Insider Risk Detection Birkett Huber, Casper Neo, Keiran Sampson, Alex Kantchelian, Brett Ksobiech, Yanis Pavlidis Abstract We present a method to detect departures from business-justified workflows among support agents. Our goal is to assist auditors in identifying agent actions that cannot be explained by the activity within their surrounding context, where normal activity patterns are established from historical data. We apply our method to help audit millions of actions of over three thousand support agents. We collect logs from the tools used by support agents and construct a bipartite graph of Actions and Entities representing all the actions of the agents, as well as background information about entities. From this graph, we sample subgraphs rooted on security-significant actions taken by the agents. Each subgraph captures the relevant context of the root action in terms of other actions, entities and their relationships. We then prioritize the rooted-subgraphs for auditor review using feed-forward and graph neural networks, as well as nearest neighbors techniques. To alleviate the issue of scarce labeling data, we use contrastive learning and domain-specific data augmentations. Expert auditors label the top ranked subgraphs as “worth auditing” or “not worth auditing” based on the company’s business policies. This system finds subgraphs that are worth auditing with high enough precision to be used in production. I Introduction The U.S. Cybersecurity & Infrastructure Security Agency (CISA) defines insider threat [ 1 ] as “the threat that an insider will use their authorized access, wittingly or unwittingly, to do harm.” Insider risk comes with potentially large financial impacts to companies, costing on average $16.2M per incident [ 2 ] . This system focuses on insider threats from support agents. Support agents handle arbitrary support request tickets. They must manage tickets appropriately in a ticket management system and resolve the tickets, potentially by using their data access tools to read or modify sensitive data. Tickets require human interpretation and may be routed between agents. Their ability to route tickets and access sensitive data make them significant potential insider threats. Previous work on insider risk detection, including those on file access [ 3 ] , database access [ 4 ] , and general data access logs [ 5 ] , try to predict future (user, resource) access pairs from historical pairs. Such systems are sub-optimal for detecting insider risk amongst support agents: Which ‘resource’ an agent should access depends on which tickets they should be working on; which, in turn, depends on variables extrinsic to the system; and cannot be known ahead of time. We call such systems ‘coarse grained’ for neglecting within-workflow access justifications. In contrast, we present a fine grained approach that detects insider risk by finding departures from expected workflows. Whether an action is justified is determined by other actions taken shortly before the access itself. We use the term workflow to encompass all activity related to the execution of a job function, performed by a computer or human, particularly those that are logged by the tools used in the job function. Specifying workflows in detail as hard-coded rules is difficult and toilsome because a company’s services and internal tooling change over time, inevitably changing how support agents should do their jobs, as well as the logs describing how they did do their jobs. To avoid enumerating workflows, we use machine learning and learn them from the data. II Methodology The logs produced by the support agents’ tools are too low level to be individually audited for legitimacy. In the course of their work, security analysts connect agents’ activities across disparate systems by correlating low-level activity logs using timestamps or entity identifiers. Inspired by their process, we contextualize logs by parsing them into a graph. We extract subgraphs, rooted on potentially sensitive actions, then prioritize them for review. Security analysts then audit these subgraphs in order of priority. II-A Graph Construction We build a bipartite graph and name its partitions Actions and Entities . Entities are identifiers that persist over time, including support agent usernames, account ids, and ticket ids. Actions are temporally localized aggregations of logs with a categorical type. A support agent commenting on a ticket is modeled as an action, with type ‘TicketManagement.Reply’. That action is connected to the agent’s entity and a ticket entity. Edges connect actions and entities, and are annotated with a categorical relationship . We store our graph on disk as a large set of action records. Each Action record has a unique id , a string type , start time, end time, and a set of references . A reference has three string fields, entity type , entity id , and relationship . Note that entities are replicated everywhere they are referenced. We select actions that have types indicating potentially sensitive activity (for example, ‘DataTool.Query’) and consider them single-node rooted subgraphs. We expand those subgraphs using a breadth first traversal of the main graph. For each of T\in\mathbb{N} traversal steps, for each entity that was not previously traversed, and for each action type; we add to the subgraph the M\in\mathbb{N} actions who’s start times are closest to the root action’s start time, who that reference that entity, are of that type, and were not previously added. M and T control the size of our subgraphs. Action types vary in temporal density, and selecting the M closest actions by type stops the graph from being cluttered by noisy action types. As we traverse further in graph distance, entities and actions become less relevant to the root action. In this work, we take T=2 (no Entity type is allowed to be traversed more than two steps from the root) and M=10 . We also disable traversal through certain entity types after the first traversal. See Figure 1 for an example rooted-subgraph. II-B Ranking Techniques Given sufficient labeled data, e.g. thousands of true positive examples, we would directly train a classifier to identify what’s worth auditing. However, due to high security analyst costs, gathering sufficient data is infeasible in our domain. We present two ranking methods that require fewer labels. II-B 1 Nearest Neighbor (NN) Our first ranking technique is to rank subgraphs by their distance to a small set of interesting rooted-subgraphs, I . In our evaluation, |I|=2 . Let F be a function that maps rooted subgraphs, N , to the unit sphere in \mathbb{R}^{n} . We define our distance function over graphs to be d_{F}(x,y)=\|F(x)-F(y)\|_{2} . Using this distance, we audit the k closest subgraphs to I from N\setminus I . II-B 2 Synthetic Mutation Rank (SMR) Our second ranking method exploits domain knowledge to find rooted subgraphs that should be interesting. We create mutations that make a natural subgraph, n\in N , look more like un-expected (interesting) behavior. We train a feed forward binary classifier to distinguish the embeddings of natural and mutated subgraphs. Using this classifier, the top k most seemingly-mutated natural subgraphs are selected for auditing. II-C Generating Embeddings This section discusses our selection of F . We experiment with both hand-crafted features and learned ones. II-C 1 Handcrafted Embeddings As a simple starting point, we count the actions sharing either a user, an agent, or both with the central action, along with the earliest and latest start times

Read the complete text