On Unbiased Parameter Estimation and Signal Reconstruction Journal: Inverse Problems
Joonas Lahtinen · 2026
Read On Unbiased Parameter Estimation and Signal Reconstruction Journal: Inverse Problems by Joonas Lahtinen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-05276.txt.
Introduction
Joonas Lahtinen extends a theory of unbiased source finding to unbiased parameter estimation and signal reconstruction for any number of active settings. The topic touches exact recovery, studied in compressed sensing and multi-source fitting across imaging problems. Unbiased methods are prized because they avoid steady shrinkage, but their noise behaviour had an open puzzle.
Lahtinen derives upper bounds on how many settings can be recovered in the noiseless case and defines a chance measure for recovering all active parameters in the correct size order. The theory explains the noise toughness question for standardised and fair methods and reveals a trade-off between sensor count and signal-to-noise ratio. Computer tests confirm what the theory predicts.
Catalog record
| CREATOR | Joonas Lahtinen |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 54 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.05276
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
On Unbiased Parameter Estimation and Signal Reconstruction Journal: Inverse Problems Joonas Lahtinen Abstract In this paper, we expand the theory of depth-unbiased source localization to unbiased parameter estimation and signal reconstruction of an arbitrary number of non-zero parameters to be recovered. The topic touches on the concept of exact reconstructibility, most commonly known in compressed sensing and multisource estimation in various imaging problems. The theoretical results derive upper bounds on the number of recoverable parameters in the noiseless case, and a probability measure is defined to assess the probability of obtaining all non-zero parameters with correct magnitude order. The work provides a mathematical explanation of the open question regarding the noise robustness of standardized and unbiased methods. Also, the paper reveals a trade-off between the number of sensors and the signal-to-noise ratio. Numerical experiments demonstrate the theoretical findings. Keywords : Linear forward problem, Parameter estimation, Signal reconstruction, Solution bias 1 Introduction In inverse problems where the objective is to recover data that explains parameters or to reconstruct a signal or image from indirect observations, one can ask whether it is possible to exactly reconstruct the source from a limited amount of data. On some occasions, when the observed signal depends on the source type and the distance between the source and the sensor, an estimation bias may arise. A biased estimate arises from cheap but non-realistic solutions of a given optimization problem that reduce the data error, i.e., the likelihood in the Bayesian sense. The bias could be reduced by introducing a highly sophisticated regularization scheme or a priori; however, when the number of model parameters to be estimated is high, as in the reconstruction of high-resolution images or the neuroelectromagnetic inverse source problem [ 1 , 2 , 3 ] , electrocardiography inverse problem [ 4 ] , hydrogeology [ 5 ] , and electrical resistance tomography [ 6 , 7 ] , advanced prior models are not computationally feasible, even when Monte Carlo methods are employed. A technique called standardization [ 8 ] was first introduced for the static neuroelectromagnetic inverse source problem, which aims to determine the location, magnitude, and orientation of the source, and was later generalized to localization problems arising from the Poisson equations with Neumann boundary conditions [ 9 ] , as well as to time-varying localization problems [ 10 ] . The technique uses Gaussian random fields to infer the source’s unbiased location, i.e., unbiased depth. In practice, it is a linear transformation from biased source estimation to depth-unbiased Z-scores [ 11 , 12 ] . As a unbiasing strategy, it provides unbiased localization only if the observations are noiseless, and it can find only one source as the location is determined to be the one with the highest Z-score. Standardized methods have been among the most successful for localizing the epileptic focus in the human brain [ 13 , 14 , 15 , 16 , 17 , 18 ] . Partially, the success can be explained by the unbiased localization that allows the source to be estimated everywhere within the given domain, but standardized methods are also highly robust against additive measurement noise due to yet an unknown reason. An obvious limitation of the technique is that it recovered one of the parameters needed to define the source. In this paper, we further generalize the transformation to yield unbiased sparse estimates by considering unbiased parameters rather than a single parameter, the location. We take a particular interest in models in which multiple parameters define a source, as well as in multisource scenarios. We address the conditions required for exact source and multisource reconstructions in the noiseless case and in the presence of observation noise. The findings of this study provide a complete explanation of why the standardization technique yields unbiased, noise-robust estimates and why it sometimes seems beneficial to use fewer sensors to estimate the source. In the experiments, we demonstrate the properties of unbiased estimation in compressive sensing and 2- and 3-dimensional electrical source imaging, using a realistic multicompartment head model in the 3-dimensional case. 2 Preliminary We consider the following observation model: {\bf y}=L{\bf x}, (1) where observations {\bf y}\in\mathbb{R}^{m} , the lead field or system matrix L\in\mathbb{R}^{m\times dn} is built as L=\begin{bmatrix}L_{1}&\cdots&L_{n}\end{bmatrix}, (2) where any submatrix L_{k} , k=1,\cdots,n belongs to \mathbb{R}^{m\times d} , where d is the number of parameters describing a source and n is the number of possible distinct sources. As previously established, exact reconstructions are not guaranteed in the presence of random noise [ 9 ] ; therefore, we do not consider noise-contaminated observations yet. In the paper, it has been proved that in the one-dimensional case, where d=1 , one source can be recovered exactly by k=\underset{i=1,\cdots,n}{\mathrm{arg\>max}}\left\{\frac{{\bf L}_{i}^{T}\Sigma^{-1}{\bf y}}{\sqrt{{\bf L}_{i}^{T}\Sigma^{-1}{\bf L}_{i}}}\right\}, (3) where \Sigma=LL^{T}+C , and C is the observation noise covariance stemming from the assumed Gaussian likelihood model, and computing \hat{x}_{k}={\bf L}^{\dagger}_{k}{\bf y}, (4) where (\cdot)^{\dagger} is the pseudoinverse. Now, by simply expanding the index to a parameter variable \bm{\theta}_{k}\in\mathbb{S}^{d}\subset\mathbb{R}^{d} such that (\hat{\bm{\theta}},k)=\underset{i=1,\cdots,n,\>\bm{\theta}\in\mathbb{S}^{d}}{\mathrm{arg\>max}}\left\{\frac{\bm{\theta}^{T}L_{i}^{T}\Sigma^{-1}{\bf y}}{\sqrt{\bm{\theta}^{T}L_{i}^{T}\Sigma^{-1}L_{i}\bm{\theta}}}\right\}, (5) the estimate \hat{\bf x}_{k}=\left\|L_{k}^{\dagger}{\bf y}\right\|_{2}\hat{\bm{\theta}} end up being biased. This can be shown to be true by denoting \hat{\bf y}=\Sigma^{-1/2}{\bf y} and using the compact singular value decomposition \Sigma^{-1/2}L_{k}=\check{U}_{k}\check{S}_{k}\check{V}_{k}^{T} , where \check{S}_{k} is a square diagonal matrix with non-zero diagonals. Since there exists {\bf v}\in\mathbb{S}^{d} , i.e., on the d -dimensional hypersphere, such that \bm{\theta}=\check{V}_{k}{\bf v} , hence, the solution can be written as \check{U}_{k}\check{S}_{k}{\bf v}=r\hat{\bf y} , for some r\in\mathbb{R} . Because the solution depends on the nonzero entries of \check{S}_{k} , it is biased. Namely, the solution is biased on the normalized parameter space \mathbb{S}^{d} . However, this consideration reveals to us that unbiased solutions can be obtained by the following weighting of the individual source estimates: \begin{split}{\bf z}_{k}&=(\check{V}_{k}\check{S}_{k}\check{V}_{k}^{T})^{-1}\check{V}_{k}\check{S}_{k}\check{U}_{k}^{T}\hat{\bf y}=\check{V}_{k}\check{S}_{k}^{-1}\check{V}_{k}^{T}\check{V}_{k}\check{S}_{k}\check{U}_{k}^{T}\hat{\bf y}\\ &=\check{V}_{k}\check{U}_{k}^{T}\hat{\bf y}.\end{split} (6) By denoting A_{k}=\check{U}_{k}\check{V}_{k}^{T} , we obtain {\bf z}_{k}=A_{k}^{\dagger}\hat{\bf y}. (7) Moreover, Theorem 5.1 in [ 9 ] , shows that if there is an index k such that the observations are {\bf y}=L_{k}{\bf x}_{k} for any {\bf x}_{k}\in\mathbb{R}^{d} , the highest Z-score is obtained for all vectors from the preimage of L_{k} . Now, by writing the minimization problem used in the proof with A : \textnormal{maximize}\>{\bf z}^{T}A^{T}\hat{\bf y}\quad\textnormal{subject to }\sqrt{{\bf z}^{T}A^{T}A{\bf z}}=c, (8) for some c>0 , we get the same solution for {\bf z}_{k} once the observations comes from the range of \Sigma^{-1/2}L_{k} . The next theorem shows that the estimate is indeed unbiased. Theorem 2.1 . Let A=\begin{bmatrix}\check{U}_{1}\check{V}_{1}^{T}&\cdots&\check{U}_{n}\check{V}_{n}^{T}\end{bmatrix}, (9) where the submatrices are originated from the compact singular value decompositions of modified sub-lead fields \Sigma^{-1/2}L_{k}P_{k}=\check{U}_{k}\check{S}_{k}\check{V}_{k}^{T} , and \Sigma=LPL^{T}+C with source covariance P and measurement covariance C . Then {\bf z}_{k}=A_{k}^{\dagger}\Sigma^{-1/2}{\bf y} (10) gives unbiased estimation for the problem {\bf y}=L{\bf x} if there is one source generating the observations {\bf y} . Proof. Assume that the source has magnitude a>0 and parameters \bm{\theta}\in\mathbb{R}^{d} and is at the k th position, then the modified observations are \Sigma^{-1/2}{\bf y}=a\Sigma^{-1/2}L_{k}P_{k}\bm{\theta}=a\check{U}_{k}\check{S}_{k}\check{V}_{k}^{T}\bm{\theta} . Let there be a sub-matrix such that \Sigma^{-1/2}L_{j}P_{j}=\check{U}_{k}\check{S}_{j}\check{V}_{j}^{T} , then, on one hand \displaystyle{\bf z}_{j}=A_{j}^{\dagger}\Sigma^{-1/2}{\bf y}=a\check{V}_{j}\check{S}_{k}\check{V}_{k}^{T}\bm{\theta}, and on the other hand {\bf z}_{k}=a\check{V}_{k}\check{S}_{k}\check{V}_{k}^{T}\bm{\theta} . This yields \left\|{\bf z}_{j}\right\|_{2}=\left\|{\bf z}_{k}\right\|_{2} , thus proving that the solution is unbiased. ∎ From the result above, we note that instead of weighting source estimates, we