Towards Leveraging News Media to Support Impact Assessment of AI Technologies

Mowafak Allaham, Kimon Kieslich, Nicholas Diakopoulos · 2024

Read Towards Leveraging News Media to Support Impact Assessment of AI Technologies by Mowafak Allaham, Kimon Kieslich, Nicholas Diakopoulos (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2411-02536.txt.

Description

A 2024 arXiv research paper by Mowafak Allaham, Kimon Kieslich, Nicholas Diakopoulos. Expert-driven frameworks for impact assessments (IAs) may inadvertently overlook the effects of AI technologies on the public’s social behavior, policy, and the cultural and geographical contexts shaping the perception of AI and the impacts around its use. This research explores the potentials of fine-tuning LLMs on negative impacts of AI reported in a diverse sample of articles from 266 news domains spanning 30 countries around the world to incorporate more diversity into IAs.

Catalog record

CREATORMowafak Allaham, Kimon Kieslich, Nicholas Diakopoulos
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE43 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2411-02536

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Towards Leveraging News Media to Support Impact Assessment of AI Technologies Mowafak Allaham, Kimon Kieslich, Nicholas Diakopoulos Abstract Expert-driven frameworks for impact assessments (IAs) may inadvertently overlook the effects of AI technologies on the public’s social behavior, policy, and the cultural and geographical contexts shaping the perception of AI and the impacts around its use. This research explores the potentials of fine-tuning LLMs on negative impacts of AI reported in a diverse sample of articles from 266 news domains spanning 30 countries around the world to incorporate more diversity into IAs. Our findings highlight (1) the potential of fine-tuned open-source LLMs in supporting IA of AI technologies by generating high-quality negative impacts across four qualitative dimensions: coherence, structure, relevance, and plausibility, and (2) the efficacy of small open-source LLM (Mistral-7B) fine-tuned on impacts from news media in capturing a wider range of categories of impacts that GPT-4 had gaps in covering. 1 Utilizing news media for impact assessment Anticipating and evaluating the negative impacts of emerging AI technologies on individuals and society requires a deep understanding and familiarity with the contextual use, functional capabilities, and affordances of these technologies [ 20 , 14 , 15 ] . Researchers have proposed a variety of impact assessment (IA) frameworks. However, the inadvertent expert biases that are introduced by these approaches such as the demographically skewed backgrounds [ 1 ] , homogeneous experiences of experts [ 5 ] , or selection bias with respect to what impacts to focus on [ 8 ] , have an influence on the foresight and evaluation process of AI technologies [ 1 ] . Furthermore, identifying potential impacts of emerging AI technologies, let a lone across cultures, is both challenging and resource-intensive [ 10 ] . As a response, LLMs have recently been explored as a scalable alternative and ideation tools to support IAs [ 18 , 3 ] , though they also suffer from concerns about the nature and extent of the biases that may be captured by their training data and so reflected in the generated text [ 16 , 22 ] . This research explores the potentials of incorporating more diversity into IAs, while focusing on issues that are relevant to the public, by leveraging news media coverage of AI. Specifically, we do this by fine-tuning LLMs on impacts covered in the news media to support AI developers, researchers, and other stakeholders to generate and envision potential negative impacts of emerging AI technologies before deployment. Our choice to source impacts from news media is to draw on the diverse range of negative impacts of AI that have already been reported. Media reporting plays a crucial role in shaping public opinion on emerging technologies and acts as an agenda setter by reporting on topics and issues that are deemed as relevant - thus, the media has a substantial influence on what impacts are discussed in the public sphere and which impacts are deemed important (and which aren’t) [ 17 , 2 , 21 ] . Additionally, one of the core journalistic quality criteria is to make multiple stakeholder views visible and, thus, foster diversity of opinions. Accordingly, by understanding the negative impacts of AI reported in a broad and diverse sample of news, impact assessors may have access to a broader understanding of the societal concerns about AI including groups that are usually unaccounted for by expert-driven assessments. This, in turn, is also likely to influence the evaluation of AI technologies by citizens, who are key stakeholders in public policy that shape the current and future development and regulation of AI [ 17 , 13 , 12 ] . Consequently, news media can serve as a proxy for AI designers and developers to gauge the consequences of AI technologies, and, as we develop in the method described here, can also help those same designers and developers understand the potential impacts of new technologies prior to deployment. Accordingly, it is not the aim of our approach to produce an exhaustive list of negative impacts for an AI technology, but to demonstrate the capabilities of LLMs, once aligned with impacts covered in news media, in (1) generating high-quality negative impacts across four dimensions of coherence, structure, relevance, and plausibility based on the functional description of an AI technology, and (2) illustrate the bias in LLMs in an IA task by comparing the differences in the distribution of impact types between fine-tuned and non-fine-tuned LLMs, compared to those present in our sample data from news media. 2 Methodology Our dataset consists of 91,930 articles in English retrieved and scraped from Google News using a curated set of 40 AI-relevant keywords (as listed in A.1 ) that were published by 266 news domains between January 1, 2020 and June 1st 2023 spanning 30 countries around the world (see A.2 ). We used prompts P1 and P2 in Table S1 to prompt GPT-3.5-turbo to summarize two parallel pieces of information from each news article in our dataset: a description of the AI systems reported on, and a set of negative impacts described that are associated with these systems. The resulting information was curated in a dataset that includes 37,689 pairs of descriptions and negative impacts of AI technologies from 17,590 articles. To compare the distribution of impacts across models, we categorized the impacts in the full dataset by applying BERTopic [ 9 ] , a topic modeling technique that leverages transformers to create easily interpretable topics. The resulting set of ten topics was then manually labeled based on the keywords and three representative examples for each topic. Finally, we mapped the manually labeled topics back to the the negative impact descriptions in our sample. For fine-tuning, we randomly split the curated dataset into training (N=32,035), validation (N=5,140), and testing datasets (N=514). The training and validation datasets were used for fine-tuning and the testing dataset was used to evaluate the fine-tuned models in an impact generation task. We decided to keep the training sample large in order to not introduce additional biases in the selection of impacts used for finetuning and to preserve the diversity of impacts in the sample. To assess the proficiency of models for generating negative impacts, we prompted GPT-4 and Mistral-7B-Instruct [ 11 ] using zero-shot prompting to generate negative impacts based on the descriptions of AI technologies in the test dataset. We formulated the corresponding prompts for each model for this task as shown in P3 and P4, in Table S1 , respectively. Furthermore, we fine-tuned two completion models OpenAI GPT-3 and Mistral 7B, using QLoRA [ 6 ] , on the training dataset to further gauge the quality and range of categories of negative impacts generated using LLMs once aligned with the news media. Finally, similar to prior evaluation studies of generated text applied in other anticipatory approaches [ 7 , 23 ] , we qualitatively evaluated the generated impacts across the four dimensions of coherence, granularity, relevance, and plausibility per the qualitative rubric in Table S4 to help evaluating and articulating the efficacy of the generated impacts by LLMs for IA. 3 Results & Conclusion A total of 10 categories emerged from the negative impacts described in our sample relating to: Societal Impacts, Economic

Read the complete text