An evaluation of LLMs for political bias in Western media: Israel-Hamas and Ukraine-Russia wars Journal: .
Rohitash Chandra, Haoyan Chen, Yaqing Zhang, Jiacheng Chen, Yuting Wu · 2026
Read An evaluation of LLMs for political bias in Western media: Israel-Hamas and Ukraine-Russia wars Journal: . by Rohitash Chandra, Haoyan Chen, Yaqing Zhang, Jiacheng Chen, Yuting Wu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-06132.txt.
Introduction
Do language models see political bias in Western media the same way? Rohitash Chandra and 4 co-authors test that in a 2026 study. Bias in newspapers shapes public opinion and elections, so automated detection matters. The study compares coverage of the Israel-Hamas and Russia-Ukraine wars.
Three models, BERT, Gemini, and DeepSeek, judged left-wing, right-wing, and neutral opinions in the Guardian and the BBC. After the wars broke out, coverage shifted leftward by these measures, but each model gave different results. DeepSeek leaned consistently left in its judgments, while the others stayed nearer the center. The Guardian shifted more on the Israel-Hamas conflict, suggesting event-driven reporting patterns.
Catalog record
| CREATOR | Rohitash Chandra, Haoyan Chen, Yaqing Zhang, Jiacheng Chen, Yuting Wu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 67 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-06132
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
An evaluation of LLMs for political bias in Western media: Israel-Hamas and Ukraine-Russia wars Journal: . Rohitash Chandra, Haoyan Chen, Yaqing Zhang, Jiacheng Chen, Yuting Wu Abstract Political bias in media plays a critical role in shaping public opinion, voter behaviour, and broader democratic discourse. Subjective opinions and political bias can be found in media sources, such as newspapers, depending on their funding mechanisms and alliances with political parties. Automating the detection of political biases in media content can limit biases in elections. The impact of large language models (LLMs) in politics and media studies is becoming prominent. In this study, we utilise LLMs to compare the left-wing, right-wing, and neutral political opinions expressed in the Guardian and BBC. We review newspaper reporting that includes significant events such as the Russia-Ukraine war and the Hamas-Israel conflict. We analyse the proportion for each opinion to find the bias under different LLMs, including BERT, Gemini, and DeepSeek. Our results show that after the outbreak of the wars, the political bias of Western media shifts towards the left-wing and each LLM gives a different result. DeepSeek consistently showed a stable Left-leaning tendency, while BERT and Gemini remained closer to the Centre. The BBC and The Guardian showed distinct reporting behaviours across the two conflicts. In the Russia-Ukraine war, both outlets maintained relatively stable positions; however, in the Israel-Hamas conflict, we identified larger political bias shifts, particularly in Guardian coverage, suggesting a more event-driven pattern of reporting bias. These variations suggest that LLMs are shaped not only by their training data and architecture, but also by underlying worldviews with associated political biases. 1 Introduction Mass media, including social media, served as a medium for the dissemination of knowledge that has been used as a medium for political gain and manipulation [ 21 ] . Media immensely contributes to changing citizens’ political preferences; for example, more partisan media has contributed to political polarisation and led Americans to support more partisan policies and candidates [ 59 ] . The media’s ability to shape public opinion highlights its critical role in shaping political landscapes. For instance, Zinn [ 71 ] presented a study on mainstream historical narratives, describing the experiences of marginalised groups in American history and emphasising the political nature of historical writing. Thus, text written by individuals inherently carries their own subjectivity and societal experience [ 25 ] . Therefore, regardless of how objective one claims their discourse to be, their upbringing and online environment can subtly influence their perception and judgment. Consequently, the political bias of Western media exists with right, left and centre-leaning political discourse [ 51 , 35 ] . Social media platforms enable people to express their opinions freely, but that also comes at a cost, as employees have paid repercussions by losing their jobs for expressing themselves. Statements from users and influencers on social media platforms such as Twitter and Facebook often have political biases, particularly on topics related to elections, free speech, and the role of democracy [ 37 ] , and the political bias extends to news media (newspapers and television). Traditional methods of detecting political bias in news media involve human identification [ 33 ] , where trained human experts can analyse news articles and identify instances of bias, such as biased political statements that can influence election outcomes. Although this is a time-consuming and labour-intensive approach, it can provide a nuanced and accurate assessment of political bias in news media [ 32 ] . Despite the potential benefits of these methods, there are limitations in detecting political bias in news media. For instance, Caliskan [ 6 ] argued that certain forms of bias may be more subtle and complex to detect through human identification. Additionally, if humans hold politically biased beliefs influenced by their growing environment, it may impact the direction of content analysis [ 22 ] . This influence is evident earlier in the information retrieved by search engines. The algorithmic ranking of search tools can also influence human judgment, as individuals generally tend to accept the viewpoints encountered first and click on the first-ranked link, perceiving it as correct and reliable [ 55 ] . This can lead to preconceived notions and cognitive biases in subsequent information encountered. For example, Epstein [ 23 ] derived that biased search rankings can change the voting preferences of undecided voters by more than 20%. Therefore,there is scope of NLP and machine learning to know whether the content of news media exhibits political bias and provide potential guidance to readers. Besides, whether a specific journal exhibits changes in political bias over time in the long run, like a comparison between the pre-pandemic era and the post-pandemic era, is also considered. Natural language processing (NLP) [ 52 ] is a subfield of artificial intelligence that focuses on the study of human language using computational tools and machine learning models. NLP enables computers can understand, create, and even respond to human language [ 15 ] , which has gained widespread attention through technologies such as Large Language Models (LLMs) [ 69 ] . LLMs have emerged as cutting-edge artificial intelligence systems that can process and generate text with coherent communication and generalise to multiple tasks [ 54 ] . Applications of NLP include machine translation, text summarisation, chatbots, sentiment and semantic analysis, interactive user interfaces, multilingual information retrieval, and speech recognition [ 11 ] . ChatGPT [ 60 ] , Gemini and DeepSeek [ 48 ] are implementations of LLMs that are at the forefront of NLP that enabling users to create highly sophisticated and versatile applications in various tasks and domains, including text generation, translation, and data analysis. Studying potential political bias using deep learning and NLP methods is essential because the information individuals encounter can affect their judgment to a certain extent [ 6 ] . Political bias is commonly categorised as liberal (left wing), conservative (right wing), and neutral [ 27 ] ; however, the existence of political bias among individuals varies across different countries. The left-wing political bias means the group or person holds liberal ideas and hopes to be progressive. The right-wing political bias means the group or person hold the conservative view. For instance, in the United States, traditional classifications include the Republican Party and the Democratic Party [ 45 ] , while in Australia, the Australian Labour Party represents workers’ interests. As a result, political bias in different news media outlets can be highly complex. It can be helpful to classify different political parties as left-wing or right-wing. Scholars have conducted extensive research in this area, and several machine learning approaches have been developed to detect political bias in textual content effectively. David et al. [ 16 ] attempted to predict the political party affiliation of Israeli Facebook users by machine learning models. Malouf and Mullen [ 50 ] used a Naïve Bayes text classifier to predict the political party affiliation of political discussion board users. Kang et al. [ 42 ] used a document classification technique (doc2vec) to train data from Facebook posts to assess political bias in a newspaper in South Korea quantitatively. Chandra et al. [ 8 ] used the BERT language model for Twitter sentiment analysis for the 2020