Using Embedding Models to Improve Probabilistic Race Prediction
Noah Dasanaike, Kosuke Imai · 2026
Read Using Embedding Models to Improve Probabilistic Race Prediction by Noah Dasanaike, Kosuke Imai (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-22555.txt.
Introduction
Dasanaike and Imai improve race prediction for people whose surnames the Census does not cover. Researchers often use Bayesian Improved Surname Geocoding, which leans on Census surname tables. Those tables miss uncommon surnames, leaving out about 10 percent of the United States population. Standard BISG then falls back on a flat generic prior for such names, degrading predictions. Their embedding-powered BISG instead represents names as dense vectors from pretrained text embeddings and trains neural networks on 2020 Census surname and first-name data.
Catalog record
| CREATOR | Noah Dasanaike, Kosuke Imai |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 39086 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.22555
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Using Embedding Models to Improve Probabilistic Race Prediction Thanks: We thank Bruce Willsie of L2, Inc. for his generosity in sharing the voter files used in this paper. Noah Dasanaike, Kosuke Imai Abstract Estimating racial disparity requires individual-level race data, which are often unavailable due to the sensitivity of collecting such information. To address this problem, many researchers utilize Bayesian Improved Surname Geocoding (BISG), which have critically relied on Census surname data. Unfortunately, these data capture race-surname relationships only for common surnames, omitting approximately 10% of the US population. We show that predictive performance degrades substantially for individuals with such omitted, uncommon surnames because standard BISG implementation relies on an uninformative generic prior in these cases. To address this limitation, we propose embedding-powered BISG (eBISG), which uses pre-trained text embeddings to represent names as dense vectors and trains neural networks on 2020 Census surname and first-name data to estimate race probabilities for names not covered in the Census. We compare five approaches: standard BISG using only surnames, BIFSG incorporating first name probabilities, surname embedding for unlisted names, surname and first name embedding combining both, and a full-name embedding trained on voter file data from Southern states that captures interactions between name components. We show that each successive eBISG approach improves race prediction, with the full-name embedding yielding the largest gains, particularly for Hispanic and Asian voters whose surnames are absent from the Census list. 1 Introduction Measuring racial disparities across diverse social, political, and economic domains requires knowing the race of individuals in administrative records ( 1 ; 8 ; 10 , e.g.,) . Yet, individual race information is often not available in these data owing to legal restrictions, privacy concerns, or the perceived sensitivity of collecting such information ( 7 ) . The most widely adopted solution to this problem is Bayesian Improved Surname Geocoding (BISG). Using Bayes’ rule, BISG combines a surname-based racial prior P(R\mid S) drawn from the Census Bureau’s surname list with geographic racial composition P(R\mid G) to produce individual-level race probabilities P(R\mid G,S) under the assumption of conditional independence between surname and geography given race S\!\perp\!\!\!\perp G\mid R ( 6 ; 11 ; 12 ) . Since its introduction, BISG has become standard across the social and health sciences. The Consumer Financial Protection Bureau adopted it for fair lending enforcement ( 4 ) , health researchers use it to track disparities in managed care populations ( 1 ) , and political scientists rely on it to study voter turnout by race ( 8 ) , with widely used software implementations making BISG and its extensions accessible to applied researchers ( 14 ) . 5 have recently evaluated machine-learning-modified BISG for redistricting, and 10 document consequences of BISG prediction errors for fair lending enforcement. Most applications of BISG rely critically on Census name data. The latest release, published in April 2026, provides race distributions for 156,620 surnames and 53,616 first names occurring at least 100 times in the 2020 Census. However, racial distributions for common first names were not publicly available prior to this release. As a result, typical applications have relied solely on surname data: individuals whose surnames do not appear in the Census list (approximately 10% of the population) are assigned a generic prior equal to the national racial distribution, which conveys no information about their likely race. Using North Carolina and Florida voter files where self-reported race provides ground truth, we show that the predictive performance of BISG substantially degrades for these voters, with precision-recall performance falling sharply relative to voters with matched surnames. These unmatched voters are not a random cross-section of the electorate: 16 to 18 percent of Asian voters and 10 to 12 percent of Hispanic voters have unmatched surnames, compared with 6 to 11 percent of white voters. To address this limitation, we propose a class of methods called embedding-powered BISG (eBISG) that replaces the uninformative generic prior for unmatched surnames with informative, name-specific race probabilities derived from embeddings, while leaving Census-based priors and the BISG framework otherwise unchanged. Our approach uses open-source pre-trained text embedding models to represent names as dense vectors in a high-dimensional space, such that morphologically and linguistically similar names receive similar representations. In our implementation, we use E5-Large ( 21 ) , though alternative embedding models could also be used. We evaluate the performance of five approaches, including three of our own, that progressively incorporate more name information. First, we consider two existing methods. Standard BISG uses only surname probabilities from the Census. BIFSG (Bayesian Improved First name and Surname Geocoding) supplements this with first name probabilities, treating surname, first name, and geolocation as conditionally independent of one another given race, i.e., P(S,F,G\mid R)=P(S\mid R)P(F\mid R)P(G\mid R) ( 20 ) . As mentioned earlier, the latest release of the 2020 Census name data includes the information about frequently occurring first names, which makes the application of BIFSG straightforward. Second, we propose three versions of eBISG. Our surname embedding approach replaces the uninformative generic prior for unmatched surnames with an embedding-based prediction trained on the Census surname list. Our surname and first name embedding approach extends this by training a separate embedding model on the Census first name list, incorporating both as Bayesian factors for voters with unlisted names. Our full-name embedding approach, trained on voter files from Southern states, concatenates first, middle, and last name into a single representation, allowing the model to capture interactions between name components that the conditional independence assumption precludes. All three eBISG methods modify only the prior assigned to unmatched names, leaving predictions unchanged for the roughly 90 percent of voters whose surnames appear in the Census list. Furthermore, the proposed eBISG methodology seamlessly integrates with any downstream analysis that takes BISG posteriors as inputs, including the BIRDiE estimator introduced by 16 . We empirically evaluate all of these approaches using voter registration data from North Carolina and Florida, training the full-name model on voter files from four other Southern states to ensure a clean separation between training and evaluation samples while requiring generalization. We find that the approach based on surname embeddings yields consistent improvements over standard BISG for voters with unmatched names, while the method, which leverages full-name embeddings, produces substantially larger gains across all racial categories in both states. The full-name approach also reduces the systematic, income-correlated bias identified by 3 : where standard BISG overpredicts white share in wealthy Census tracts and underpredicts minority share across the income distribution, the full-name embeddings approach reduces these biases toward zero. Related Literature A growing literature has sought to go beyond the Census list by training machine learning models on labeled data to classify individuals by race from their names. 19 show that character-level recurrent networks can achieve high accuracy on Florida voter data, and subsequent work has pushed further with fine-tuned transformers ( 17 ) and interpretable feature-based models that exploit name popularity patterns rather than character sequences ( 13 ) . 22 and 23 take a different tack, learning name embeddings from communication patterns and social media data rather than from labeled racial categories. These methods classify each individual to a single racial category and are proposed as standalone alternatives to BISG. However, probabilistic predictions play