The Philosophic Turn for AI Agents: Replacing centralized digital rhetoric with decentralized truth-seeking Penultimate Draft
Philipp Koralus · 2025
Read The Philosophic Turn for AI Agents: Replacing centralized digital rhetoric with decentralized truth-seeking Penultimate Draft by Philipp Koralus (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-18601.txt.
Introduction
Philipp Koralus wrote a philosophy paper in 2025 on how AI agents should be designed to protect human agency. People will lean on AI agents for more of life's hard choices. That raises a dilemma: users may drown in complexity and lose agency, or accept outside control of their choices and lose autonomy. Koralus argues that AI-scale nudging makes the second risk worse.
The paper proposes a philosophic turn in design. Agents should support scattered truth-seeking and open inquiry, in the spirit of Socratic dialogue. Such systems would help users keep control of their judgments and learn as they go. The paper ends by listing traits that autonomy-preserving agents need.
Catalog record
| CREATOR | Philipp Koralus |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 71 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-18601
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
The Philosophic Turn for AI Agents: Replacing centralized digital rhetoric with decentralized truth-seeking Penultimate Draft Philipp Koralus Abstract In the face of rapidly advancing AI technology, individuals will increasingly rely on AI agents to navigate life’s growing complexities, raising critical concerns about maintaining both human agency and autonomy. This paper addresses a fundamental dilemma posed by AI decision-support systems: the risk of either becoming overwhelmed by complex decisions, thus losing agency, or having autonomy compromised by externally controlled choice architectures reminiscent of “nudging” practices. While the “nudge” framework, based on the use of choice-framing to guide individuals toward presumed beneficial outcomes, initially appeared to preserve liberty, at AI-driven scale, it threatens to erode autonomy. To counteract this risk, the paper proposes a philosophic turn in AI design. AI should be constructed to facilitate decentralized truth-seeking and open-ended inquiry, mirroring the Socratic method of philosophical dialogue. By promoting individual and collective adaptive learning, such AI systems would empower users to maintain control over their judgments, augmenting their agency without undermining autonomy. The paper concludes by outlining essential features for autonomy-preserving AI systems, sketching a path toward AI systems that enhance human judgment rather than undermine it. 1 Introduction Modernity has greatly expanded opportunities for individuals. It has also vastly increased the burden of questions that individuals need to take on board for opportunities to be realized. With increasing capabilities of AI and their impact on how we live and work, this trend stands to dramatically accelerate. It will increasingly be the case that effectively operating in the modern world will require the assistance of AI agents that help us make choices and help us identify what choices and questions we should consider. Against this background, we face an apparent dilemma that mirrors the ancient image of Scylla and Charybdis. On the one side lies the risk of losing agency: as the complexities of modern life keep compounding and objectively available choices and the stakes involved in negotiating them keep increasing, individuals with their limited cognitive capacities are threatened with becoming ineffective. If we are confronted with the availability of systems that can make us dramatically better at choosing the means to our ends, not using them may ultimately make us lose faith in our agency altogether, particularly if we are routinely in competition with others who happily adapt such systems. But this is not the only peril. On the other side lies the risk of losing autonomy. As our choices become routinely conditioned by automated choice framing and recommender systems, the operative priorities that determine where we end up are less and less originating in ourselves. Instead of enjoying self-rule, we threaten to become ruled by technology, through a kind of ‘‘autocomplete for life’’ 1 1 1 Brendan McCord (2024). “What can Aristotle teach us about AI?”. American Optimist. Ep 105, 14/12/2024. . In the long run, agency without autonomy is empty, and autonomy without agency is impotent. Worse still, the absence of either tends to corrode the other. The hazards are real but we cannot turn back. AI is both too consequential and will become too widely embedded to reject. The question is how to navigate the treacherous passage between loss of agency and loss of autonomy. What does it take to design AI agents as products that bolster our ability to act decisively and remain self-governing in the face of new complexities? How can we avoid becoming passive instruments of digital architecture while still reaping its tremendous benefits? In this paper, I will argue that to answer these questions well, we need to distill the essence of philosophical practice into the design of AI products along lines I will outline in this paper. Moreover, we need to pay close attention to the relationship between truth-seeking and decentralization. This perspective goes against a widespread focus on hyper-centralization that is found both in the discourse about AI technological development itself and in discourse about how its risks and ethical dimensions should be approached. 2 2 2 For recent synoptic discussions heavy on centralization, see: Kissinger, Henry A., Eric Schmidt, and Craig Mundie. Genesis: Artificial Intelligence, Hope, and the Human Spirit . New York: Little, Brown and Company, 2024; Suleyman, Mustafa, and Michael Bhaskar. The Coming Wave: Technology, Power, and the Twenty-first Century’s Greatest Dilemma . New York: Crown Publishing Group, 2023. It is tempting to think that there is in fact no dilemma at all, because we might just task AI with improving our well-being in some reasonably liberally minded way, which would then simply subsume what is worth having in agency and autonomy. To address the pitfalls of this view, it is worth considering a version of it that predates the development of AI: the “nudge” approach to influencing choice in service of welfare that had its heyday in the first quarter of the 21st century. This approach raises many of the same issues we face in the context of reliance on AI agents, albeit writ small in a way that makes some of the challenges easier to diagnose. I will then zoom out and consider consequences in the context of the new capabilities afforded by AI. Proponents lauded the nudge approach as liberal paternalism, using minimal interventions like default enrollments or psychologically informed choice framing to guide individuals toward better outcomes. 3 3 3 Thaler, R. H., & Sunstein, C. R. (2008). Nudge: Improving decisions about health, wealth, and happiness . New Haven, CT: Yale University Press. The nudge approach could be seen as an attempt to resolve our dilemma, at an earlier stage of technological development: individuals are seen to make sub-optimal choices, and scientifically informed interventions are made as a partial remedy, in a way that (so the hope goes) does not impinge on our freedom. The philosophy of nudges also foreshadows the temptations of being ruled by a new kind of technology; temptations that are rapidly growing with AI. If it could be made to work very broadly, a naïve philosophy of nudging would be the apotheosis of technocratic government: guiding the masses through techne alone with no need for physical force or even traditional propaganda. Augmented with AI, this approach promises the utopia of autocomplete for life. I will argue that when fused with large-scale AI systems, nudge philosophy risks turning into a subtle but sweeping form of digital rhetoric, one that can invisibly shape the collective mind, inhibit the decentralized adaptive learning that underlies human truth-seeking, and ultimately undermine human autonomy. At AI-driven scale, nudging threatens to turn “soft-paternalism” into a kind of soft totalitarianism, to the detriment of long-term vitality of human reason. The key problem is to instead chart a course for AI agents that can help us maintain effective agency in an ever more complex world, while allowing us to maintain autonomy. This paper will conclude by presenting a paradigm for how we can chart such a course, arguing for a philosophic turn in AI agents. This marks a shift from the rhetorical school of designing “choice architectures” to cultivating systems that foster decentralized truth-seeking. Rather than nudging users into predetermined pathways, we could build AI to ask catalytic questions while keeping complexity at bay, facilitate open-ended inquiry, and help preserve