Slogans or Stance? A Label-Light Diagnostic for Entrepreneurial-Discourse Measurement on Chinese SOE Speeches
Ting Gong, Shangquan SunTsinghua University [email protected] · 2026
Read Slogans or Stance? A Label-Light Diagnostic for Entrepreneurial-Discourse Measurement on Chinese SOE Speeches by Ting Gong, Shangquan SunTsinghua University [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-29188.txt.
Introduction
Ting Gong and Shangquan Sun test entrepreneurial-discourse measures in Chinese state-owned speeches with a label-light diagnostic, not a new extractor. In 80 speeches by centrally administered firm leaders, 24 different speakers and 5 same speakers test whether scores track the leader, firm fixed. LDA fails, while dictionary and encoder scores land in between. A zero-shot 9B open-weight model lifts the paired effect to about 1.1, but style residualisation halves it, suggesting leader idiolect. Gold-standard consistency claims are downgraded, and the corpus and tools are released.
Catalog record
| CREATOR | Ting Gong, Shangquan SunTsinghua University [email protected] |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 50701 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.29188
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Slogans or Stance? A Label-Light Diagnostic for Entrepreneurial-Discourse Measurement on Chinese SOE Speeches Ting Gong, Shangquan SunTsinghua University [email protected] Abstract Dictionary methods, topic models, and embedding-similarity scorers are widely used in CSS and management research to measure constructs such as “entrepreneurial spirit” in corporate speeches. We contribute a label-light measurement diagnostic for such instruments rather than a new extraction model. On a corpus of 80 speeches by leaders of centrally administered Chinese state-owned enterprises, we exploit a natural experiment of 24 same-company different-speaker pairs and 5 same-company same-speaker pairs to test whether a method’s per-document indices vary with leader identity holding firm constant. LDA fails (Cohen d = 0.20 d=0.20 , 95% CI [ − 0.72 , 1.20 ] [-0.72,1.20] ); a dictionary scorer reaches d = 0.81 d=0.81 and a Chinese sentence encoder d = 0.65 d=0.65 on doc-vector distances of order 10 − 3 10^{-3} . A zero-shot 9B open-weight LLM (Qwen3.5:9b) raises paired-contrast d d to 1.09 1.09 (exact permutation p 1 = 0.034 p_{1}=0.034 ). We downgrade three claims accordingly: gold F 1 F_{1} measures consistency with the LLM’s own prompt rule rather than external construct recovery; doc-level style residualisation cuts the LLM’s d d to 0.43 0.43 ( p 1 = 0.22 p_{1}=0.22 ), so roughly half of the effect is consistent with leader idiolect; and a confidence-weighted calibration trades Δ \Delta for variance with an auto-mined slogan lexicon near-inert in ablation. We release the 2,190-segment scored corpus, the 170-paragraph pilot, the slogan lexicon, two-family LLM scores, and the evaluation harness. 1 Introduction Empirical work on entrepreneurship and corporate governance relies on textual indices derived from corporate disclosures and leadership addresses. Such indices serve as inputs to studies of firm performance, innovation, and political affiliation, and they often rest on one of three method families: keyword dictionaries 30 ; 5 ; 25 , latent topic models 6 , and pre-trained word or sentence embeddings 35 ; 15 . All three measure topical coverage : how much a document discusses innovation, risk, or sustainability. None was designed to separate the speaker’s substantive stance on a construct from the speaker’s symbolic-rhetorical performance about it. This separation matters in discourse genres where symbolic performance is part of the institutional contract. Speeches by leaders of centrally administered Chinese state-owned enterprises (SOEs) are a clear example. An SOE chairperson’s address is expected to include canonical political invocations — for example the policy slogan “cultivate world-class enterprises with global competitiveness” or the doctrinal formulation “state-owned enterprises are an important material and political foundation of socialism with Chinese characteristics” (see Table 2 for further entries) — alongside operational reporting such as a specific divestiture, a named joint venture, or a numerically anchored R&D programme. The two coexist in the same speech, often in the same paragraph. A dictionary-based “innovation index” computed over such a speech is largely driven by the former, because slogans contain most of the keywords that a hand-curated dictionary recognises and are interchangeable across speeches. We therefore ask: do standard entrepreneurial-discourse extraction methods, as widely deployed on Chinese corporate corpora, measure leader-level stance, or do they measure recurrent political symbolism? To answer this without commissioning a new annotation round we exploit a property of our corpus: 29 of 51 companies appear in two interview waves. Twenty-four of those wave pairs involve a change of speaker at the same company; five involve the same speaker reappearing. If a method captures leader-level stance, its per-document vectors should differ more across leader-change pairs than across same-leader pairs. If a method captures the company’s industry topic or shared political ritual, the two distributions should be indistinguishable. Our contributions are: 1. A leader-change paired evaluation for stance extraction in performative corporate discourse that requires no in-domain annotation (§ 5 ). 2. An audit of four method families on 80 central-SOE speeches that shows that dictionary, LDA, and BGE-encoder methods fail the evaluation: their paired-contrast effect either crosses zero in its 95% bootstrap CI or is computed on doc-vector distances of order 10^{-3} (§ 6 ). A complementary paraphrase- robustness experiment confirms that the dictionary baseline increases its score when substantive content is rewritten in slogan style (§ 6.6 ). 3. A confidence-weighted calibration on a zero-shot 9B open-weight LLM (Qwen3.5:9b) that trades two paired-contrast metrics: it raises absolute \Delta by 27% but reduces Cohen’s d from 1.09 to 0.83 ; ablation localises the lift to LLM self-confidence, not to the auto-mined slogan lexicon. Qualitative ordering is preserved under a within-family cross-LLM check (Qwen3.5:27b, § 6.5 ). 4. Release of the 2,190-segment scored corpus, the 170-paragraph pilot gold set, the 53-entry auto-mined slogan lexicon, and the full evaluation harness. 2 Related Work Entrepreneurial orientation and entrepreneurial leadership. The management and entrepreneurship literature has long treated entrepreneurial orientation (EO) as a structured construct of innovativeness, proactiveness, risk-taking, autonomy, and competitive aggressiveness 36 ; 13 ; 31 , and subsequent reviews emphasise both its firm-level centrality and the instability of its operationalisation across contexts 40 ; 52 . Parallel work on corporate entrepreneurship and entrepreneurial leadership argues that such constructs are enacted through strategic posture and leader discourse rather than through isolated keywords 14 ; 28 ; 21 ; 4 . Our paper inherits this measurement target and asks whether standard text-as-data pipelines recover it from SOE speeches. Dictionary-based discourse measurement. The Loughran–McDonald financial sentiment dictionary 30 , Tetlock’s media-sentiment work 50 , and the Baker–Bloom–Davis economic-policy uncertainty index 5 , with its Chinese-language extension 25 , are emblematic of a research programme that operationalises latent corporate-discourse constructs via hand-curated word lists. Within the Chinese-corporate literature, the same template has been applied to “entrepreneurial spirit”, innovation orientation, and political-mission framing, typically as document-level proportions of seed-word hits. The implicit assumption is that the distribution of construct-related vocabulary in a document is informative about the document’s underlying stance. Our paired-contrast evaluation makes this assumption testable: if the assumption holds, dictionary scores must vary more across leaders than within them. Our findings (§ 6 ) indicate that, for SOE leadership speeches at least, the assumption is empirically weak. Topic models, hierarchical classification, and embedding similarity. Latent Dirichlet Allocation 6 is ubiquitous in CSS analyses of long political and corporate text 20 ; 43 . Embedding-based topic models 2 generalise the idea to a continuous space; hierarchical multi-label text classification 9 ; 47 ; 54 ; 16 is a closer match to our L1/L2 taxonomy but requires labelled training data, which is unavailable here. Modern Chinese sentence encoders such as BGE 53 , building on the Sentence-BERT line 41 , achieve strong zero-shot retrieval performance and are a common default for unsupervised dimension scoring in CSS. We benchmark all three families and analyse why each underperforms on our paired-contrast task: LDA recovers industry topics rather than stance dimensions, and a domain-monolithic sentence encoder collapses per-document distances on a homogeneous corpus (§ 6 , § 7 ). Stance, framing, and performative discourse. A long line of NLP work distinguishes stance from topic, mostly for short-form social-media data 37 ; 1 . Framing analysis in political communication 8 ; 17 treats discourse as a choice among competing emphases rather than a position on a single axis, and several recent papers extend it