Probing the Knowledge Boundary: An Interactive Agentic Framework for Deep Knowledge Extraction Yuheng Yang, Siqi Zhu, Tao Feng, Ge Liu, Jiaxuan You Abstract Large Language Models (LLMs) can be seen as compressed knowledge bases, but it remains unclear what knowledge they truly contain and how far their knowledge boundaries extend. Existing benchmarks are mostly static and provide limited support for systematic knowledge probing. In this paper, we propose an interactive agentic framework to systematically extract and quantify the knowledge of LLMs. Our method includes four adaptive exploration policies to probe knowledge at different granularities. To ensure the quality of extracted knowledge, we introduce a three-stage knowledge processing pipeline that combines vector-based filtering to remove exact duplicates, LLM-based adjudication to resolve ambiguous semantic overlaps, and domain-relevance auditing to retain valid knowledge units. Through extensive experiments, we find that recursive taxonomy is the most effective exploration strategy. We also observe a clear knowledge scaling law, where larger models consistently extract more knowledge. In addition, we identify a Pass@1-versus-Pass@k trade-off: domain-specialized models achieve higher initial accuracy but degrade rapidly, while general-purpose models maintain stable performance during extended extraction. Finally, our results show that differences in training data composition lead to distinct and measurable knowledge profiles across model families. 1 Introduction Large language models (LLMs) have become a central component of modern AI systems, demonstrating strong performance across a wide range of tasks and domains. As LLMs are increasingly used in high-stakes settings such as scientific research and decision-making, evaluating them only by task performance is no longer sufficient. Instead, we need to understand what a black-box LLM actually knows and does not know. To this end, we define the knowledge boundary of an LLM as the set of knowledge that can be reliably obtained within a given topic, under a limited number of prompts and verification steps. Identifying this boundary is important for interpretability, alignment, and safety, because it clarifies whether an incorrect or misleading output stems from a failure to retrieve existing knowledge or from the model operating beyond its reliable knowledge boundary. However, quantifying this boundary presents three fundamental challenges that prevent the problem from being reduced to traditional accuracy evaluation. First, the definition of a “knowledge ceiling” lacks a verifiable ground truth in open-ended domains, rendering standard recall metrics inapplicable. Recent work has begun to investigate how LLMs perceive their own knowledge boundaries through internal representations ( 29 ; 22 ) , but these approaches require white-box access. Second, current evaluation paradigms rely heavily on static benchmarks (e.g., MMLU) and predefined question sets ( 12 ) . These approaches not only face increasing risks of data contamination but are also inherently passive: they sample the model’s capabilities at sparse, discrete points ( 10 ) rather than actively exploring the continuous landscape of its knowledge coverage. Third, and perhaps most critically, LLMs exhibit a strong inertia to remain within a “comfort zone” of high-probability tokens. When queried directly, models tend to output generic, repetitive, or shallow knowledge. This behavior, coupled with the diversity of semantic expressions for identical facts, makes it difficult to achieve “saturation-based” extraction, where one must distinguish unique insights from semantic redundancies and hallucinations. Prior literature has largely failed to address the systemic nature of these challenges. Existing works predominantly focus on static, benchmark-driven evaluations or employ single-strategy agentic extraction that explores the model locally. Such settings lack the adaptive, hierarchical, and recursive mechanisms necessary to push the model to its limits. Consequently, current methods often measure what the model is willing to express (surface realization), rather than approximating what the model actually knows (latent capacity). There remains a significant gap in methodologies that treat the aggregation and verification of knowledge points as a central component of the evaluation process. To bridge this gap, we propose an Interactive Agentic Framework for Knowledge Extraction and Evaluation , designed to systematically answer the following questions: What does the model know? How much does it know? How can we maximize the excavation of this knowledge? Our framework treats the black-box model as an environment to be explored, deploying multiple Agentic Extraction Pipelines to break through the model’s output inertia. Crucially, these pipelines are coupled with a robust Knowledge Processor , which handles semantic de-duplication, validity verification, and structural organization of the generated content. Among our proposed strategies, Recursive Taxonomy demonstrates the highest efficacy in coverage and efficiency. Our contributions are as follows: • We provide a formal formulation for the problem of black-box knowledge boundary probing, moving beyond static testing to dynamic, saturation-based evaluation. • We introduce a novel multi-agent framework that adaptively navigates the model’s knowledge space, significantly outperforming naive prompting and standard chain-of-thought baselines in uncovering deep-tail knowledge. • Empirically, we conduct four systematic experiments to characterize the knowledge topology of black-box LLMs. We first establish that Recursive Taxonomy is the Pareto-optimal extraction strategy, significantly outperforming naive probing methods. We then identify a Knowledge Scaling Law : extractable knowledge grows with model size, with larger models achieving superior coverage of long-tail concepts. We also reveal a Pass@1-versus-Pass@k trade-off : domain-specific fine-tuning improves initial accuracy but causes rapid degradation and reduced recall. Finally, we demonstrate that training data composition strongly shapes knowledge quality, as different model families exhibit stable recall patterns but domain-specific accuracy variations. 2 Related Work Our work intersects multiple research directions: knowledge evaluation in LLMs, agentic systems for exploration, and semantic deduplication. We position our contributions relative to each area below. Knowledge Evaluation in LLMs. Traditional approaches rely on static benchmarks such as MMLU ( 12 ) and TruthfulQA ( 18 ) , which suffer from data contamination risk ( 20 ) , passive sampling of sparse knowledge subsets ( 10 ) , and inability to detect saturation. Recent efforts address these limitations through dynamic prompt-based evaluation ( 9 ) and hierarchical capability profiling ( 34 ; 1 ) . Notably, 34 decompose model capabilities into hierarchical trees, which is conceptually similar to our Recursive Taxonomy approach but focused on weakness identification rather than exhaustive extraction. While probing classifiers ( 3 ) and knowledge boundary cognition studies ( 29 ; 22 ) analyze internal representations, these require white-box access and do not measure extractable knowledge volume. Our scaling analysis extends prior work on scaling laws ( 15 ; 13 ) from loss/perplexity to knowledge volume, while our RL findings complement observations that fine-tuning may degrade diversity ( 16 ) and that LLMs can be calibrated to acknowledge knowledge limitations ( 24 ) . Agentic Systems for Knowledge Exploration. While AutoGPT ( 26 ) , BabyAGI ( 21 ) , ReAct ( 32 ) , and Voyager ( 27 ) demonstrate autonomous task execution and exploration, they focus on task completion rather than knowledge extraction. Recent agentic approaches target knowledge mining specifically: FlowSearch ( 14 ) proposes structured knowledge flows, 35 introduce scalable proxy agents, and 5 demonstrate self-organizing knowledge networks. Self-refinement methods ( 19 ; 25 ) inspire our Self-Reflective Refinement strategy, but lack hierarchical decomposition. Chain-of-Thought ( 28 ) , Tree-of-Thoughts ( 31 ) , Graph-of-Thoughts ( 4 ) , and Self-Discover ( 39 ) provide structured reasoning but target single-query problem solving. Multi-agent debate ( 8 ; 17 ) inspired our Multi-Perspective strategy, though prior work optimizes for correctness (consensus) rather than coverage (diversity). Society of Mind ( 37 ) lacks our systematic deduplication and saturation-based stopping criteria. Semantic Deduplication and Knowledge Merging. The challenge of identifying unique knowledge atoms is related to paraphrase detection ( 36 ) and semantic textual similarity ( 6 ) . Embedding-based methods ( 23 ) provide efficient clustering but struggle with subtle negations and technical nuances. Recent work employs LLMs as judges for pairwise comparison ( 38 ) , which we adopt in our two-stage deduplication pipeline. UniArk ( 30 ) addresses consistency in factual knowledge extraction through debiasing, while 7 explores concept map-based semantic domain discovery. For distinguishing valid knowledge from hallucination, 11 proposes factuality probes that detect hallucinations in long-form generation, a challenge directly relevant to our domain auditing stage. However, prior work does not combine these techniques with Bloom’s Taxonomy-based domain-relevance auditing, which is critical for filtering meta-statements and generic fluff. Positioning Our Work. Our approach presents a unified framework that jointly addresses hierarchical exploration, semantic redundancy control, saturation-aware stopping, and cross-scale evaluation. By formulating knowledge extraction as a tree search via Recursive Taxonomy, we further reveal how RL and training data composition affect extractable knowledge profiles. 3 Methodology Figure 1 : Overview of the Interactive Agentic Framework. (a) Agentic Exploration Policies actively probe the black-box LLM; the diagram illustrates the Recursive Taxonomy strategy. (b) Knowledge Processor transforms raw outputs into valid points via three-stage filtering: Vector Filtering, LLM Adjudication, and Domain Auditing. In this work, we propose an interactive agentic framework designed to explicitly characterize the knowledge boundaries of black-box LLMs. Our goal is to move beyond coarse, task-level evaluation by systematically eliciting fine-grained, verifiable knowledge units and tracking when the model’s marginal knowledge yield saturates. As illustrated in Figure 1 , the system operates as a closed-loop pipeline comprising two core modules: (1) a set of agentic exploration policies that actively mine the model’s latent parameter space and (2) a knowledge processor for rigorous semantic de-duplication and domain-relevance auditing. 3.1 Problem Formulation Formally, let \mathcal{M} be the target LLM and \mathcal{T} be a specific topic domain. We define a knowledge atom, denoted as k , as a discrete, verifiable statement categorized under Bloom’s Taxonomy ( 2 ) (specifically, factual, conceptual, or procedural types). Each knowledge atom must be formulated such that, given the definitions fixed by topic domain \mathcal{T} , it can be evaluated as either true or false without interpretational ambiguity. The knowledge boundary is defined as the set \Omega_{\mathcal{M}}(\mathcal{T}) containing all unique, valid atoms extractable from \mathcal{M} as the interaction cost C\to\infty . Our objective is to approximate this boundary by maximizing the set of extracted atoms \mathcal{K}_{\mathrm{ext}} while minimizing token consumption. A turn represents one complete interaction cycle: the agent generates a prompt, receives a response from the model, and extracts candidate knowledge atoms via bullet-point parsing followed by processor-based de-duplication and filtering. Let n_{t} denote the number of novel (non-duplicate) atoms discovered at turn t , and let r_{t} denote the total number of raw atoms extracted before deduplication. We define two saturation indicators: • Growth rate: g_{t}=n_{t}/|\mathcal{K}_{1:t-1}| , measuring how much the knowledge set expands relative to its current size. • Efficiency: e_{t}=n_{t}/r_{t} , measuring what fraction of raw output survives deduplication. Extraction terminates when knowledge saturation is detected, defined by any of the following conditions: (1) g_{t}<1\% , (2) e_{t}<10\% , (3) n_{t}<3 , or (4) a maximum of 15 turns is reached. 3.2 Agentic Exploration Policies We design four extraction strategies with progressively stronger structural guidance to encourage more diverse and informative outputs. Sequential Associative Probing. This policy serves as our baseline, where the agent iteratively asks “What else?” or “Provide more specific points.” Formally, the prompt at turn t is conditioned on the query \mathcal{T} and the flat interaction history H_{1:t-1} . This tests the model’s associative retrieval depth without explicit task decomposition. Self-Reflective Refinement. Inspired by the Reflexion framework ( 25 ) , this policy introduces a critic-actor loop. In each turn, the model first audits its previously generated points \mathcal{K}_{1:t-1} to identify missing sub-domains or logical inconsistencies, and then generates a targeted prompt to fill these gaps. This strategy aims to break the model’s output inertia through self-correction. Recursive Taxonomy Explorer. This strategy transforms the global retrieval problem into a hierarchical search task. It is governed by two key hyperparameters: the branching factor ( W ) and maximum depth ( D_{max} ). 1. Taxonomy Induction: The agent recursively decomposes \mathcal{T} into a tree of sub-fields. In our implementation, each node at level l is expanded into W_{l} children (with W_{1}=W_{2}=W in our experiments). 2. Leaf-Node Mining: Once the tree reaches D_{max} , parallel agents are deployed to exhaustively mine each leaf node. By narrowing the focus to fine-grained sub-topics, this method forces the model to bypass dominant concepts and access long-tail parametric memory. Multi-Perspective Parallel Probing. This policy exploits the model’s cognitive diversity by instantiating N distinct expert personas (e.g., Engineer, Legal Scholar, Ethicist). The key hyperparameter is the profile count ( N ). The agent first dynamically generates N diverse profiles relevant to domain \mathcal{T} . In each turn, these N experts independently provide insights from their unique vantage points. By synchronizing the global knowledge set \mathcal{K} across all experts at each turn, the framework ensures that specialized perspectives capture nuances often missed by a single neutral agent. 3.3 The Knowledge Processor A critical challenge in saturation-based extraction is distinguishing between unique facts and semantic rephrasing. We implement a rigorous three-stage processing pipeline. Stage 1: Vector Space Filtering. We utilize qwen3-8b-emb to map atoms to dense vectors. Pairs with cosine similarity S>0.92 are immediately merged. This stage provides a fast, initial pruning of high-confidence redundancies. Stage 2: Semantic Adjudication via LLM-Judge. Vector similarity often fails to distinguish logical negation or subtle technical differences due to high lexical overlap. For pairs in the ambiguity zone ( 0.70 DeepSeek-R1 (32.7%, 36.0%, 34.7%) > Llama (30.0%, 29.7%, 23.6%). This consistency suggests that each model family adopts a characteristic exploration strategy: Qwen prioritizes breadth (aggressive sampling), Llama emphasizes precision (conservative generation), and R1 occupies the middle ground. Importantly, these patterns persist despite domain shifts, indicating that recall is primarily governed by the model’s internal knowledge organization rather than domain-specific expertise. Domain-Specific Accuracy Reveals Training Data Composition. In stark contrast to the stable recall patterns, accuracy varies dramatically across domains (Figure 4 , top row), revealing clear domain preferences. Llama excels in engineering domains with 89.2% (Deep Learning) and 91.5% (ML Systems), but drops to 83.4% in Probabilistic Methods, reflecting Meta’s focus on practical, code-adjacent training data. Qwen dominates theoretical domains, achieving 93.5% accuracy in Probabilistic Methods (the highest across all model-domain pairs) while showing moderate performance in engineering domains (86.9%, 80.9%), suggesting Alibaba’s corpus includes substantial mathematical and theoretical content. DeepSeek-R1 shows the lowest accuracy in Deep Learning (77.1%, - 10% vs. base Qwen) and consistently underperforms in all domains, indicating that reasoning-oriented distillation compresses the knowledge distribution, sacrificing domain-specific expertise for abstract reasoning capabilities. Training Data Dominates Model Behavior. The divergence between stable recall and variable accuracy demonstrates that training data composition determines the quality of extractable knowledge, while model architecture and capacity govern the volume. Notably, Qwen’s ability to achieve both high recall (43.2%) and high accuracy (93.5%) in Probabilistic Methods, a “Pareto-optimal” outcome, underscores the critical role of domain-aligned pretraining. Conversely, DeepSeek-R1’s uniformly degraded accuracy across domains suggests that reasoning enhancement, when achieved through aggressive distillation, may inadvertently prune domain-specific knowledge in favor of generalized reasoning patterns. We note that while Llama-3.1-8B has slightly more parameters than the 7B models, this does not confound our conclusions: the 7B models (Qwen, DeepSeek) consistently achieve higher recall than the 8B model across all domains, indicating that the observed differences reflect training data composition rather than parameter count. 5 Conclusion We presented an interactive agentic framework for characterizing the knowledge boundaries of black-box LLMs, combining four exploration strategies with a three-stage processor for semantic deduplication and domain auditing. Our experiments reveal three key findings. First, strategy matters: the Recursive Taxonomy approach achieves Pareto dominance, with structured decomposition significantly outperforming naive sequential probing. Second, knowledge scales with size: recall increases from 27.3% (8B) to 39.0% (405B), confirming a knowledge scaling law. Third, specialization has costs: domain-specific fine-tuning improves initial accuracy in target domains but reduces recall across all domains and degrades both accuracy and recall in non-target domains, while training data composition fundamentally shapes each model family’s knowledge profile. These findings provide both a methodology for auditing model knowledge before deployment and insight into how pretraining choices shape the topology of machine knowledge. Future work may extend this framework to non-technical domains and incorporate human validation to further calibrate the LLM-based auditing pipeline. Impact Statement This paper presents work whose goal is to advance the field of machine learning. There are many potential societal consequences of our work, none of which we feel must be specifically highlighted here. Appendix Appendix A Implementation Details A.1 Hyperparameters and Thresholds Table 2 lists the key hyperparameters and thresholds used in our experiments. Parameter Value Description Strict dedup threshold 0.92 Cosine similarity for automatic merge Fuzzy dedup range 0.70–0.92 Range for LLM judge intervention Max turns 15 Maximum extraction turns per run Min growth ratio 0.01 Saturation stopping criterion Min efficiency ratio 0.10 Minimum novel/raw ratio per turn Min novel count 3 Absolute minimum new points per turn Embedding model Qwen3-8B-Emb Sentence embedding Judge model DeepSeek-V3.1 Deduplication and domain audit Embedding batch size 128 Texts per API call LLM concurrency 20–50 Parallel API requests Table 2: Hyperparameters and thresholds used in all experiments. A.2 Domain Queries We evaluate three domains selected from ICML’s official topic taxonomy. Throughout the paper, we refer to domains as code-adjacent when typical discussions involve implementation details, and as non-code when the content is primarily mathematical or conceptual. • Deep Learning : Engineering-focused, code-adjacent domain covering neural network architectures, optimization techniques, and training methodologies. • Machine Learning Systems : Systems-focused, code-adjacent domain covering distributed training, inference optimization, and ML infrastructure. • Probabilistic Methods : Theory-focused, non-code domain covering Bayesian inference, probabilistic graphical models, and uncertainty quantification. A.3 Pipeline Configurations Table 3 summarizes the eight pipeline configurations evaluated in the Pareto analysis (Stage 1). Pipeline ID Strategy Parameters Description P2_Sequential Sequential – Iterative “What else?” P3_Reflection Reflection – Critic-actor loop P4_Taxonomy_L2W2 Taxonomy W=2 2 \times 2 = 4 leaf nodes P4_Taxonomy_L3W3 Taxonomy W=3 3 \times 3 = 9 leaf nodes P4_Taxonomy_L5W5 Taxonomy W=5 5 \times 5 = 25 leaf nodes P5_MultiProfile_N3 Multi-Profile N=3 3 expert personas P5_MultiProfile_N10 Multi-Profile N=10 10 expert personas P5_MultiProfile_N20 Multi-Profile N=20 20 expert personas Table 3: Pipeline configurations for Pareto analysis. W denotes branching factor per level; N denotes number of expert profiles. A.4 Pipeline Filtering Statistics Table 4 reports the filtering rates at each stage of the knowledge processor. Here, raw points denote all extracted candidates before any filtering, and unique points denote candidates after the deduplication stage. On average, deduplication removes 2.9% of raw points, indicating that different extraction strategies rarely produce semantically identical statements. The domain audit stage is stricter: it rejects 14.0% of unique points that do not meet our Bloom’s Taxonomy-based valid knowledge point rubric. Larger models exhibit lower audit rejection rates, suggesting higher precision in generating substantive knowledge points. Table 4: Pipeline filtering statistics showing the effect of each processing stage. Dedup Rate measures the fraction filtered by vector-based and LLM-judge deduplication (raw \to unique). Audit Rate measures the fraction filtered by domain relevance auditing (unique \to valid). Data aggregated from the Scaling Law experiment (Llama-3.1 family). Domain Model Raw Unique Valid Dedup Audit Deep Learning 8B 3179 3056 2454 3.9% 19.7% 70B 4351 4244 3746 2.5% 11.7% 405B 4353 4234 3589 2.7% 15.2% ML Systems 8B 3454 3319 2873 3.9% 13.4% 70B 4567 4432 4111 3.0% 7.2% 405B 5416 5317 4757 1.8% 10.5% Probabilistic 8B 3991 3863 2968 3.2% 23.2% 70B 4089 3955 3394 3.3% 14.2% 405B 4131 4061 3603 1.7% 11.3% Average 4059 3942 3499 2.9% 14.0% Appendix B Prompt Templates This section provides the exact prompts used in each exploration strategy and the evaluation judges. B.1 Sequential Probing (P2) Turn 1 Prompt List all atomic knowledge points about ’{query}’ in bullet points. Turn t>1 Prompt {history} User: What else? Please provide more specific and in-depth points that were not mentioned above. B.2 Self-Reflective Refinement (P3) Turn t>1 Prompt You are a senior subject matter expert in ’{query}’. We have already extracted the following {N} unique knowledge points: {points_str} ### Step 1: Self-Criticism Analyze the coverage above. What advanced theories, subtle edge cases, or fundamental principles of ’{query}’ are missing, or described too superficially? ### Step 2: New Extraction Based on your analysis, list ONLY the new, missing knowledge points in bullet points. ### CONSTRAINTS - DO NOT repeat any points or concepts already mentioned above. - Focus on depth and obscurity. - Use the standard bullet point format (- Point). B.3 Recursive Taxonomy Explorer (P4) Level 1 Taxonomy Generation You are a subject matter expert in ’{query}’. Task: Break down the domain ’{query}’ into exactly {W} major, distinct sub-categories. Output format: Output ONLY {W} lines, one category name per line, starting with ‘‘- ’’. No descriptions, no explanations, no numbering. Level 2 Expansion In the field of ’{query}’, the sub-topic ’{category}’ can be further divided. Task: List exactly {W} specific sub-fields or key components of ’{category}’. Output format: Output ONLY {W} lines, one sub-field name per line, starting with ‘‘- ’’. No descriptions, no explanations. Leaf Node Mining (Turn 1) You are an expert in ’{query}’, specifically in ’{leaf}’. Task: List fundamental knowledge points about ’{leaf}’. Each knowledge point must be: 1. A complete, self-contained factual statement 2. Technically precise and accurate 3. Specific to ’{leaf}’ (not generic statements) Output format: Each line starts with ‘‘- ’’ followed by a complete sentence. No headers, no explanations, no numbering. B.4 Multi-Perspective Parallel Probing (P5) Profile Generation Identify {N} distinct types of experts for ’{query}’. 1 sentence per expert. Bullet points. Expert Extraction You are expert: {profile}. Expertise: ’{query}’. Collected: {points_str} Identify 5 new niche advanced knowledge points. Bullet points ONLY. B.5 Deduplication Judge Prompt Semantic Redundancy Check You are a knowledge engineering expert. Compare two knowledge points and determine if one is redundant given the other. Point A: {text1} Point B: {text2} Criteria for redundancy (YES): 1. They refer to the exact same concept using different wording. 2. One is a pure synonym of the other. Criteria for uniqueness (NO): 1. One provides more specific details than the other. 2. They are related but distinct concepts. 3. They describe different aspects of the same topic. Respond ONLY with ’YES’ or ’NO’. B.6 Domain Relevance Audit Prompt Bloom’s Taxonomy Validation Role: Senior Research Scientist in {query}. Task: Evaluate if the given ‘‘Knowledge Point’’ constitutes a substantive piece of technical knowledge according to the following scientific rubric. A valid ‘‘Knowledge Point’’ must fall into one of these three categories: 1. Factual Knowledge : Precise definitions, specific technical details, or discrete bits of information. 2. Conceptual Knowledge : Principles, theories, models, or interrelationships between basic elements. 3. Procedural Knowledge : Algorithms, techniques, methods, specific implementation steps, or mathematical formulas. Criteria for ’YES’ (Must meet ALL): - Truth/Accuracy: The statement must be factually correct. - Substantive Content: It must provide actual information. Reject meta-statements. - Technical Precision: It should use domain-specific language correctly. - Completeness: It must be a full, coherent sentence or proposition. Criteria for ’NO’ (Reject these): - Introductory Fluff: Generic statements like ‘‘Data quality is important’’. - Meta-Knowledge: Statements about field development. - Structural Fragments: Headers, titles, or list pointers. Knowledge Point: ‘‘{knowledge_point}’’ Decision: Respond with ONLY ’YES’ or ’NO’. Appendix C Detailed Experimental Results C.1 Stage 1: Per-Domain Pareto Data Table 5 shows the final yield ratio achieved by each pipeline in each domain at saturation (up to 15 turns). Table 5: Final yield ratio (normalized to Taxonomy-L2W2 = 1.0) per domain and aggregated statistics. The Mean \pm Std column corresponds to the values plotted in Figure 2 . Pipeline Deep Learning ML Systems Prob. Methods Mean \pm Std Sequential 0.28 0.25 0.31 0.28 \pm 0.02 Reflective 0.32 0.29 0.34 0.32 \pm 0.02 Taxonomy-L2W2 1.00 1.00 1.00 1.00 \pm 0.00 Taxonomy-L3W3 2.15 2.08 2.21 2.15 \pm 0.05 Taxonomy-L5W5 5.87 5.92 6.14 5.98 \pm 0.12 MultiProfile-N3 1.42 1.38 1.45 1.42 \pm 0.03 MultiProfile-N10 2.89 2.76 2.95 2.87 \pm 0.08 MultiProfile-N20 4.21 4.05 4.32 4.19 \pm 0.11 C.2 Stage 2: Full Scaling Law Results Table 6 presents the complete metrics for all model sizes across all domains. Model Domain Recall Accuracy Llama-3.1-8B Deep Learning 28.1% 79.5% ML Systems 26.8% 82.1% Prob. Methods 27.0% 82.0% Average 27.3% 81.2% Llama-3.1-70B Deep Learning 37.2% 88.4% ML Systems 35.9% 89.8% Prob. Methods 37.6% 88.8% Average 36.9% 89.0% Llama-3.1-405B Deep Learning 39.5% 87.2% ML Systems 38.2% 88.1% Prob. Methods 39.3% 87.8% Average 39.0% 87.7% Table 6: Full scaling law results across all model sizes and domains. Recall measures coverage of the cross-model knowledge union; Accuracy measures the fraction of unique outputs that pass domain audit. Average values match those reported in the main text (Table 1 ). C.3 Stage 3: RL Fine-Tuning Detailed Comparison Table 7 provides the complete comparison between Qwen 2.5-7B Instruct (General) and Qwen 2.5-7B Coder (RL-tuned). Domain Model Final Recall Final Acc. Init. Acc. Decline Rate Deep Learning General 57.7% 89.2% 92.3% 0.21%/turn Coder 42.2% 86.4% 96.4% 0.78%/turn ML Systems General 61.4% 90.1% 94.1% 0.27%/turn Coder 40.4% 88.4% 97.0% 0.57%/turn Prob. Methods General 66.7% 81.0% 85.2% 0.28%/turn Coder 34.0% 60.1% 72.3% 0.81%/turn Table 7: RL fine-tuning comparison. Init. Acc. = accuracy at turn 1; Decline Rate = average accuracy drop per turn. C.4 Stage 4: Cross-Series Full Comparison Table 8 presents the complete comparison across model families. Domain Model Recall Accuracy Deep Learning Llama-3.1-8B 30.0% 89.2% Qwen-2.5-7B 38.2% 86.9% DeepSeek-R1-7B 32.7% 77.1% ML Systems Llama-3.1-8B 29.7% 91.5% Qwen-2.5-7B 36.4% 80.9% DeepSeek-R1-7B 36.0% 82.3% Prob. Methods Llama-3.1-8B 23.6% 83.4% Qwen-2.5-7B 43.2% 93.5% DeepSeek-R1-7B 34.7% 79.8% Table 8: Cross-series comparison at \sim 7B scale. Recall measures coverage of the knowledge union; Accuracy measures the fraction of unique outputs that pass domain audit. C.5 Absolute Counts and Union Sizes Table 9 provides the raw extraction counts and union sizes for the Cross-Series experiment, enabling readers to verify recall calculations and understand the absolute scale of extracted knowledge. Table 9: Absolute knowledge counts and union sizes for the Cross-Series experiment (Stage 4). Raw = total extracted points before processing; Unique = after deduplication; Valid = after domain audit; Union = merged valid points across all models after cross-model deduplication. Domain Model Raw Unique Valid Union Deep Learning Llama-3.1-8B 3,045 2,997 2,674 8,919 Qwen-2.5-7B 3,992 3,917 3,405 DeepSeek-R1-7B 3,961 3,779 2,915 ML Systems Llama-3.1-8B 3,132 3,078 2,817 9,493 Qwen-2.5-7B 4,343 4,274 3,459 DeepSeek-R1-7B 4,278 4,096 3,414 Prob. Methods Llama-3.1-8B 2,676 2,647 2,208 9,373 Qwen-2.5-7B 4,397 4,329 4,046 DeepSeek-R1-7B 3,995 3,852 3,253