Can LLM generate interesting mathematical research problems?

Xiaoyang Chen, Xiang Jiang · 2026

Read Can LLM generate interesting mathematical research problems? by Xiaoyang Chen, Xiang Jiang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-18813.txt.

Introduction

Chen and Jiang ask whether language models can propose good new math research problems. Their agent works in differential geometry and writes problems meant to be unknown. It produced 665 candidate research problems. Human experts then checked the list by hand. Many problems were new to the experts and carried real research value, the authors report. The study builds on their earlier criteria and benchmark for machine mathematical creativity. It shifts the test from solving known problems to posing fresh ones worth study.

Catalog record

CREATORXiaoyang Chen, Xiang Jiang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36553
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.18813

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Can LLM generate interesting mathematical research problems? Xiaoyang Chen, Xiang Jiang Abstract This paper is the second one in a series of work on the mathematical creativity of LLM. In the first paper, the authors proposed three criteria for evaluating the mathematical creativity of LLM and constructed a benchmark dataset to measure it. This paper further explores the mathematical creativity of LLM, with a focus on investigating whether LLM can generate valuable and cutting-edge mathematical research problems. We develop an agent to generate unknown problems and produced 665 research problems in differential geometry. Through human verification, we find that many of these mathematical problems are unknown to experts and possess unique research value. 1 Introduction The current research on the application of large language models in mathematics is experiencing explosive growth. Mainstream evaluation benchmarks and model optimization directions are almost exclusively focused on reasoning ability—that is, whether a model can derive the correct answer step by step to solve mathematical problems. However, mathematics is more than just a mechanical combination of logical derivations. The soul of mathematics lies in creativity—proposing unprecedented concepts, inventing ingenious methods, and constructing counterexamples that subvert established understanding. This paper is the second in a series of work on the mathematical creativity of LLM. In the first paper [ 2 ] , to scientifically evaluate creativity, the authors proposed an evaluation model based on three key criteria: 1. Generation of New Concepts This represents the highest level of creativity, reflected in the introduction of unprecedented mathematical concepts or ideas that open up entirely new fields of research. For example, the emergence of the Riemannian metric laid the foundation for modern differential geometry and ultimately provided the mathematical language for Einstein’s theory of general relativity. 2. Invention of New Methods Another form of creativity involves inventing entirely new techniques or tools to solve previously intractable complex problems. For instance, a milestone method in geometric analysis is the Bochner technique, which ingeniously connects geometry with analysis, using curvature conditions to constrain the topological properties of manifolds such as Betti numbers, offering an elegant pathway for proving many geometric theorems. 3. Creation of New Mathematical Objects In the process of mathematical research, it is often necessary to construct specific mathematical objects. For example, to obtain a priori estimation of partial differential equations, one typically needs to construct special auxiliary functions. On the other hand, to prove that certain mathematical propositions are false, mathematicians need to construct specific counterexamples. In contrast to abstract concepts and theories, these concrete, constructible mathematical objects are more amenable to verification and thus offer a valuable entry point for evaluating the creative capabilities of large language models. In the subsequent research work, based on the above three evaluative dimensions of creativity, we will study the mathematical creativity of LLM from various perspectives. In this paper, we focus on exploring whether LLM can generate valuable, cutting-edge mathematical research questions. We build an agent to generate unknown problems and produced 665 problems in differential geometry. Through human verification, we find that many of these mathematical problems are unknown to experts and possess unique research value. In future work, we plan to build on this dataset by incorporating reinforcement learning to enhance the mathematical capabilities of LLM for creative thinking. 2 DeepMath-generate: an agent to generate research problems Proposing questions and solving problems are two distinct aspects of mathematical research. While solving problems is certainly important, asking a good question is equally crucial, as a good question can lead new research directions. Current mathematical research on LLMs focuses on whether LLM can accurately solve certain challenging mathematical problems. For example, mathematicians from top research institutions recently released a dataset named ”first proof” to test the ability of LLM to solve research-level mathematical problems [ 1 ] . Gemini Deep Think managed to solve 6 out of the 10 problems in ”first proof” [ 3 ] . Although these problems are extremely difficult, they all have standard answers. This paper focuses on investigating whether LLM can generate valuable mathematical research questions. First, we need to address a fundamental question: What makes a good mathematical problem? In mathematics, judging whether a problem is a ”good problem” depends not merely on its difficulty, but on whether it can advance the development of the field, reveal deep structures, or connect seemingly unrelated domains. Based on the characteristics of cutting-edge mathematical research, a good mathematical problem typically possesses the following core attributes: 1. Profound Insight and Foresight A good problem often directly targets the core essence of a discipline or anticipates a potential new field. For example, the Riemann Hypothesis, proposed by Bernhard Riemann in 1859, was not an arbitrary computational exercise but a profound insight into the distribution of prime numbers. Although it remains unproven to this day, it has spurred the development of multiple branches, such as analytic number theory and algebraic geometry, over the past century and beyond. A good problem is, in itself, a beacon. 2. Serving as a Bridge Between Different Fields A key characteristic of cutting-edge mathematics is cross-disciplinary integration. Problems that can connect two seemingly unrelated fields are often significant. For instance, the Atiyah–Singer Index Theorem profoundly reveals the intrinsic link between analysis (the number of solutions to differential equations) and topology (the geometric shape of manifolds). If a mathematical problem compels one to invoke tools from another field to solve it, it often leads to revolutionary progress. 3. Extreme Simplicity A beautiful problem is often expressed in extremely simple terms, sometimes understandable even to non-experts. Consider the Poincaré Conjecture. Its statement is remarkably straightforward: ”Every simply connected, closed 3-manifold is diffeomorphic to a 3-sphere?” Anyone with a basic understanding of topological concepts can grasp this statement. Yet it baffled topologists for an entire century until Grigori Perelman solved it using Ricci flow. This kind of problem—”narrow entrance, profound depth”—represents the pinnacle of mathematical aesthetics. To enable LLM to generate good mathematical problems, we construct a specialized agent: DeepMath-generate. This agent consists of two components: a generator, which creates mathematical problems, and an evaluator, which assesses whether a generated problem is ”valuable.” The generator creates mathematical problems based on the instructions in the system prompt, and then the evaluator assesses the generated problems according to the prompt’s requirements. Subsequently, the generator produces improved mathematical problems based on the evaluator’s feedback, and this iterative process continues. The generator and the evaluator utilize the GPT 5 / GPT 5.3 model via API calls respectively, and the detailed code is available on the GitHub homepage: https://github.com/DeepMathLLM/DeepMath/tree/main/DeepMath-generator .. To achieve good results, appropriate prompts are crucial. The core of the entire process lies in how to make the LLM understand the essence of a good mathematical problem. On the other hand, since a LLM has learned a vast amount of mathematical knowledge, it is necessary to design a basic filtering mechanism to prevent the generated mathematical problems from overlapping with existing mathematical research. Based on these considerations, the complete system prompt we design is as follows: Generator Prompt You are a mathematical problem generator specializing in ”good” research-level mathematics problems. Follow the instructions strictly. **Task** Generate one mathematics problem based on the knowledge points provided by the user. **Requirements** 1.

Read the complete text