The Counterexample Game: Iterated Conceptual Analysis and Repair in Language Models
Daniel Drucker Kyle Mahowald Department of Philosophy Department of Linguistics The University of Texas at Austin {drucker,kyle}@utexas.edu · 2026
Read The Counterexample Game: Iterated Conceptual Analysis and Repair in Language Models by Daniel Drucker Kyle Mahowald Department of Philosophy Department of Linguistics The University of Texas at Austin {drucker,kyle}@utexas.edu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-03936.txt.
Introduction
Daniel Drucker and Kyle Mahowald test whether language models can do conceptual analysis, the classic method of proposing a definition and refining it against counterexamples. They set up iterated chains. One model instance generates counterexamples to a proposed definition. Another instance repairs the definition, and the loop repeats. The study covers twenty concepts and thousands of counterexample-repair cycles.
Many model-generated counterexamples were judged invalid by both expert humans and a language model judge, though the model judge accepted roughly twice as many as the humans did. Per-item judgments agreed moderately well across judges. Longer iteration produced increasingly verbose definitions without improving accuracy. Some concepts resisted stable definitions altogether. The repair loop, the authors suggest, hits shrinking returns quickly.
Catalog record
| CREATOR | Daniel Drucker Kyle Mahowald Department of Philosophy Department of Linguistics The University of Texas at Austin {drucker,kyle}@utexas.edu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 28 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.03936
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
The Counterexample Game: Iterated Conceptual Analysis and Repair in Language Models Daniel Drucker Kyle Mahowald Department of Philosophy Department of Linguistics The University of Texas at Austin {drucker,kyle}@utexas.edu Abstract Conceptual analysis—proposing definitions and refining them through counterexamples—is central to philosophical methodology. We study whether language models can perform this task through iterated analysis and repair chains: one model instance generates counterexamples to a proposed definition, another repairs the definition, and the process repeats. Across 20 concepts and thousands of counterexample-repair cycles, we find that, although many LM-generated counterexamples are judged invalid by both expert humans and an LM judge, the LM judge accepts roughly twice as many as humans do. Nonetheless, per-item validity judgments are moderately consistent across humans and between humans and the LM. We further find that extended iteration produces increasingly verbose definitions without improving accuracy. We also see that some concepts resist stable definitions in general. These findings suggest that while LMs can engage in philosophical reasoning, the counterexample-repair loop hits diminishing returns quickly and could be a fruitful test case for evaluating whether LMs can sustain high-level iterated philosophical reasoning. Keywords: language models; philosophy; conceptual analysis; iterated learning Introduction Formulating and refining conceptual analyses by subjecting them to counterexamples has long been a core part of philosophy. In book one of Plato’s Republic (c. 375), to Cephalus’ proposed analysis of justice as paying back debts, Socrates presents this case: what if, sane, a person lends you their weapon, but crazed, they ask for it back? This method of counterexample and repair has been a core philosophical competence since at least then. Figure 1: (A) The counterexample-repair loop, illustrated with two iterations of a game chain. A seed analysis A_{0} is challenged by CE_{1} ; all five humans (H1–H5) and Opus accept it as valid. The repair A_{1} is challenged by CE_{2} ; four of the five humans reject this CE while Opus and one human accept it. Quoted snippets demonstrate reasoning. (B) Counterexample validity over iterations for Opus self-play vs. mixed-model chains, rated by Opus. Validity degrades over iterations. This method is so well-established that graduate students in philosophy sometimes pass the time playing The Counterexample Game: Person A comes up with an analysis for a concept, Person B tries to poke holes in it, Person A tries to repair it. Recent work with modern language models (LMs) has shown the importance of a kind of version of The Counterexample Game, in the form of adversarial “actor-critic” models for improving LM performance in a variety of domains ( 11 ; 10 ) . In these paradigms, a model makes a proposal, and then a critic model improves it. Likely because of the much-studied generator-discriminator gap ( 9 ; 3 ) , this approach has been quite successful since it allows a critic to discriminate, which then improves the generator. Here, we bring the actor-critic model back to bear on the philosophical setting. Specifically, we test the philosophical capacities of LMs by having them play a version of The Counterexample Game. We start with a simple conceptual analysis for a concept, such as friend ; ask another model instance (either of the same model or a different one) to give a counterexample; then ask another instance to repair the definition given that counterexample, iterating this process. The result is a chain of definitions, counterexamples, and repairs, so the work can be thought of as an instance of iterated communication ( 8 ; 7 ; 1 ) . That literature has studied the emergence of efficient linguistic behavior over iterations; here, we study whether a similar approach allows for the emergence of good conceptual analyses (relative to one’s purposes), above and beyond merely increasing complexity. Thus, our goals are threefold. First, insofar as conceptual analysis is core to philosophical thinking, we explore whether LMs can identify cogent counterexamples and generate good conceptual analyses through this iterated process. In benchmarking LMs on conceptual analyses, we join a body of work exploring conceptual analyses in LMs ( 14 , e.g.,) (although none that we reviewed focused on iterated counterexample repairs). While there has been substantial work on getting LMs to think like philosophers in the ethical domain ( 6 ; 5 ; 4 ) , there has been relatively little on getting them to think like philosophers of language. Second, insofar as this is an iterated communication task, we explore the properties of the chains that emerge for different concepts, in hopes of understanding the long-range behavior of this kind of iterated repair—as well as what it can tell us about particular concepts. Third, we hope to raise more theoretical questions that would be of interest to researchers on LM and human cognition. Specifically, it could be that in general LM counterexamples don’t improve with iteration. This is in some ways surprising, because human philosophers do produce better analyses and counterexamples over long periods of philosophical work. ( 2 , See, e.g., the literature on causation, e.g.,) . Why should this process succeed when human philosophers pursue it over long periods, but not when LMs do over shorter ones? Answering that more fully would require empirical investigations of human philosophers’ ability to improve their analyses and counterexamples over shorter periods (which was outside the scope of this project). We do, though, make progress on several fronts: We find that, while in some cases human annotators disagree as to which counterexamples are valid, there is sufficient overlap to conclude there is real signal as to which counterexamples are good or not. We find that giving good counterexamples and repairing conceptual analyses is hard even for the best LM we tested (Claude Opus 4.5): 5 expert human annotators and Opus 4.5 both judged many model-generated counterexamples invalid. Repeated iterations lead to looping sub-concepts (parts of the analyses given) and longer, less natural conceptual analyses. This task could, we think, serve as a challenge for developing systems that can play The Counterexample Game well and do philosophy more like philosophers. Finally, we note that not every reader will think that there is a once-and-for-all accurate analysis for any of these concepts, especially as they are presented out of context. While one of us is more sanguine than the other about such a picture of conceptual analysis, all we rely on is approximation to reasonable ranges of variation in extension, upon which there is significant human convergence. Methods We study the iterative refinement of conceptual analyses through a counterexample-repair loop. A conceptual analysis proposes necessary and sufficient conditions for a concept (e.g., “To lie is to say something when you don’t believe it’s true”). A chain begins with a simple human-authored seed analysis A_{0} (written by one of the authors, D.D., an academic philosopher), then at each step i a language model generates a counterexample CE_{i} —a concrete scenario the current analysis would misclassify—and another instance revises the analysis to produce A_{i} (Figure 1 ). Concepts We selected 20 concepts, 10 nouns and 10 verbs (see Figure 3 for list), varying in abstractness and social complexity. Each was seeded with a simple human-authored analysis (e.g., friend : “A person you like who also likes you”). Models For the mixed-model experiments, we used three language