Nano-ESG: Extracting Corporate Sustainability Information from News Articles

Fabian Billert, Stefan Conrad · 2024

Read Nano-ESG: Extracting Corporate Sustainability Information from News Articles by Fabian Billert, Stefan Conrad (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-15093.txt.

Introduction

Fabian Billert and Stefan Conrad build, in 2024, a set of news data for judging how well firms act on sustainability. Investors trust scores from firms that rate firms. Those scores are hard to follow, and no one else can redo them the same way. News, by contrast, can show how firms act, in a view that does not rest on those scores.

The team drew on more than eight hundred forty thousand news stories on large firms in Germany. The stories span close to two years of news. First, language processing picked out the stories on the topic. Then large language models wrote a short brief for each one and pulled out its tone and theme on the topic. Checks by hand showed the replies from the model were right. The team put out both sets, the raw set and the worked set, for all to reuse.

Catalog record

CREATORFabian Billert, Stefan Conrad
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE29 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-15093

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Nano-ESG: Extracting Corporate Sustainability Information from News Articles Fabian Billert, Stefan Conrad Abstract Determining the sustainability impact of companies is a highly complex subject which has garnered more and more attention over the past few years. Today, investors largely rely on sustainability-ratings from established rating-providers in order to analyze how responsibly a company acts. However, those ratings have recently been criticized for being hard to understand and nearly impossible to reproduce. An independent way to find out about the sustainability practices of companies lies in the rich landscape of news article data. In this paper, we explore a different approach to identify key opportunities and challenges of companies in the sustainability domain. We present a novel dataset of more than 840,000 840,000 news articles which were gathered for major German companies between January 2023 and September 2024. By applying a mixture of Natural Language Processing techniques, we first identify relevant articles, before summarizing them and extracting their sustainability-related sentiment and aspect using Large Language Models (LLMs). Furthermore, we conduct an evaluation of the obtained data and determine that the LLM-produced answers are accurate. We release both datasets at https://github.com/Bailefan/Nano-ESG . 1 Introduction With the growing fear of climate change related issues in the recent past, sustainability has become an important topic not only for the general public, but also in the corporate world [ 30 ] , where it is coined as “ESG”, standing for Environmental, Social and Governance topics. Those involved in the corporate world, both on the investor and on the company side, desire clarity about how sustainable a company is [ 14 , 31 ] . Third party rating agencies offer products which aim to represent the sustainability of a company in a single value, an “ESG-score”. While convenient for investors, recent criticism has pointed out several problems with this approach. For one, different rating agencies can arrive at a variety of scores for the same company, which confuses users and raises concerns about the derived scores [ 1 ] . In addition, the various complex steps involved in determining a single value for a company make it hard for the end user to truly understand why a company has a certain ESG-rating [ 6 ] . With the recent advancements in the field of Natural Language Processing (NLP) and the rise of Large Language Models (LLMs), analyzing vast amounts of data has become more feasible [ 19 , 18 , 24 , 25 ] . One textual data source which offers important insights for corporate sustainability practices are news articles. They provide a real-time, unfiltered source of information that reflects public perception and current events related to corporate sustainability practices. Unlike formal reports or company disclosures, which may be delayed or subject to selective reporting, news coverage can capture immediate reactions to a company’s actions, controversies, or initiatives [ 21 , 8 ] . Leveraging NLP techniques in order to extract the ESG-information available in this public data source can enable different stakeholders to track corporate sustainability more transparently, without relying solely on ratings that may obscure the complexity of ESG performance [ 17 ] . Furthermore, it is possible to trace a sentiment back to a concrete source and thus evaluate each ESG event on its own if desired. Finally, this approach also enables continuous monitoring, capturing shifts in perception that would otherwise go unnoticed between formal ESG score updates. To further research in this direction, we analyze a large number of online news articles in order to extract information relevant to a company’s ESG practices in this work. By leveraging multiple modern Machine Learning (ML) models to filter out as much noise as possible, we can process a small amount of news articles with a powerful, but expensive LLM to create a rich dataset we call Nano-ESG - named for the level of detail each company can be investigated with. This dataset currently contains companies in the German DAX 40 financial index, as well as a few companies that recently dropped out of it. After determining if a news article is relevant for a given company in the context of sustainability, we summarize it and determine the sentiment as well as which ESG-aspect (meaning Environmental, Social or Governance) it belongs to. To maximize the quality of the final responses, we use GPT-4o 1 1 1 https://openai.com/index/hello-gpt-4o/ . Nano-ESG contains news articles from both German and English media sources from January 2023 until September 2024. By further leveraging LLMs, the dataset contains summaries in both German and English. While we cannot release the original news articles themselves for copyright reasons, we release the URLs of each news article along with the concerned company, the discussed summaries, the determined ESG-sentiment and the ESG-aspect. As the publication date of each article is also included, this is, as far as we know, the first open source dataset which contains a time-series of ESG-sentiments and ESG-aspects of companies, which can enable practitioners to analyze the interplay of ESG-events with external factors. In order to be able to judge the reliability of our dataset and the quality of the final responses, we conduct a rigorous evaluation of a subset of the generated data in section 5 . We further carry out a detailed analysis of the dataset in section 6 and present a use case for identifying ESG-topics. Finally, we analyze unsatisfactory responses, examine why they were generated and present our findings in section 7 . 2 Related Work Large Language Models for Data Annotation In the last few years the capabilities of both closed and open source LLMs have skyrocketed, with novel LLMs being capable of complex reasoning tasks [ 24 , 25 , 18 , 23 ] . As a result, LLMs have become popular as tools to process textual data and extract desired properties in an automatic way [ 22 ] . [ 7 ] study different approaches in which a GPT-3-based model, text-davinci-003 , is used to annotate various datasets. The authors come to the conclusion that GPT-3, although still lacking behind human annotators, shows potential in performance while being significantly cheaper. [ 16 ] investigates the performance of the improved GPT-4 in annotating low-resource languages and finds impressing results of the LLM, breaking even or outperforming human annotators in many cases. [ 12 ] compares GPT-4 with an elaborate Amazon Mechanical Turk (MTurk) setup to annotate a subset of the CODA-19 dataset [ 13 ] and finds that GPT-4 achieves a higher performance. [ 26 ] comes to a similar conclusion when analyzing annotations of political twitter messages from [ 27 ] between GPT-4, MTurk workers and Experts. Datasets for ESG-Research Datasets in the ESG domain are scarce, but have been gaining interest recently. The FinNLP series of workshops 2 2 2 https://aclanthology.org/venues/finnlp/ has published multiple ESG-centric and organized shared tasks for researchers. They have focused on identifying ESG-aspects [ 2 ] , ESG-sentiments [ 3 ] and ESG impact duration [ 4 ] . Another noteworthy dataset was created by [ 9 ] . Here, the authors gathered more than 450000 headlines from the twitter account of The Guardian 3 3 3 https://www.theguardian.com/ , checked the tags for ESG-relation and mapped relevant headlines to

Read the complete text