Fact-checked by Grok 2 weeks ago

Inverse-variance weighting

Inverse-variance weighting is a statistical technique used to combine multiple estimates—such as effect sizes from independent studies—by assigning weights to each estimate that are inversely proportional to its variance, thereby producing a pooled estimate with minimized overall variance.^[1] This method is foundational in meta-analysis, where it enables the synthesis of evidence across studies by emphasizing those with higher precision, typically indicated by smaller standard errors and larger sample sizes.^[1] The weighted average is calculated as the sum of each study's effect estimate multiplied by its weight, divided by the sum of the weights, with weights defined as the reciprocal of the variance (or equivalently, the square of the standard error).^[1] It is applied in both fixed-effect models, which assume a common true effect, and random-effects models, which account for between-study heterogeneity by incorporating an additional variance component.^[1] The optimality of inverse-variance weighting stems from its derivation as the best linear unbiased estimator when variances are known and estimates are independent, yielding lower bias and greater efficiency compared to alternatives like sample-size weighting.^[2] However, in practice, estimated variances introduce slight biases, though these are generally minimal and outweighed by the method's efficiency gains.^[2] Widely implemented in software such as RevMan for Cochrane reviews, it supports analyses of various outcome types, including mean differences, odds ratios, and hazard ratios.^[1] Beyond meta-analysis, inverse-variance weighting extends to weighted least squares regression, where it adjusts for heteroscedasticity by downweighting observations with higher variance, and to trend tests like the generalized Cochran-Armitage procedure for proportions.^[3] It also facilitates aggregation in survival analysis, such as meta-analyzing median survival times by estimating within-study standard errors for weighting.^[4] Despite its strengths, the method can amplify issues like spurious precision in observational data if variances are underestimated, underscoring the need for robust variance estimation.^[5]

Core Concepts

Definition and Intuition

Inverse-variance weighting is a statistical technique used to combine multiple estimates of a parameter by assigning greater influence to those estimates that exhibit lower variability, thereby producing a more reliable overall estimate. In this method, the weight assigned to each estimate is inversely proportional to its variance, ensuring that more precise measurements—those with smaller spreads around their means—dominate the aggregation process.^[6] Variance serves as a fundamental measure of uncertainty in statistical estimates, quantifying the expected squared deviation of an estimate from its true value and thus indicating the reliability or precision of that estimate. Estimates with low variance are considered more trustworthy because they cluster closely around the expected value, reflecting less random error or noise in the data collection process. The intuitive rationale for inverse-variance weighting follows from this: by emphasizing low-variance estimates in the combination, the method reduces the overall uncertainty in the final result, as more reliable information carries proportionally more weight than less reliable data. This approach aligns with the principle of maximum likelihood under assumptions of independent errors, yielding the minimum-variance unbiased estimator when variances are known.^[7]^[6]^[6] Consider a simple scenario involving two independent measurements of the same physical quantity, such as the length of an object. If one measurement has a low variance (high precision, say from a calibrated instrument), it should influence the combined estimate more heavily than a second measurement with higher variance (lower precision, perhaps from a less accurate tool). In the special case where both measurements have equal variance, inverse-variance weighting simplifies to the arithmetic mean, treating them as equally reliable. This example illustrates how the method intuitively balances contributions based on inherent reliability, leading to a combined estimate with lower total uncertainty than either individual measurement alone.^[6] The origins of inverse-variance weighting can be traced to Carl Friedrich Gauss's pioneering work on the method of least squares in the early 19th century, where he first formalized the idea of weighting observations according to their precision to minimize estimation error. In his 1809 publication Theoria Motus Corporum Coelestium, Gauss justified least squares under Gaussian error assumptions, laying the groundwork for later extensions to unequal variances. Gauss further developed weighted least squares in subsequent works around 1821–1823, explicitly incorporating weights as the reciprocals of observation variances to handle heterogeneous uncertainties.^[8]^[8]^[8]

Basic Formulation

In inverse-variance weighting, the weight assigned to each estimate \hat{\theta}_i from the i-th source is defined as w_i = \frac{1}{\sigma_i^2}, where \sigma_i^2 is the variance of \hat{\theta}_i. This weighting scheme gives greater influence to estimates with smaller variances, reflecting their higher precision. The combined estimator \hat{\theta} is then computed as the weighted average:

\hat{\theta} = \frac{\sum_i w_i \hat{\theta}_i}{\sum_i w_i}. $$ Under the assumption of [independent](/page/Independent) estimates, the variance of this combined estimator is

\mathrm{Var}(\hat{\theta}) = \frac{1}{\sum_i w_i} = \left( \sum_i \frac{1}{\sigma_i^2} \right)^{-1}.

For interpretive purposes, the weights are sometimes normalized to sum to unity, yielding $\tilde{w}_i = \frac{w_i}{\sum_i w_i}$, such that $\hat{\theta} = \sum_i \tilde{w}_i \hat{\theta}_i$. In this normalized form, the $\tilde{w}_i$ represent the relative contributions of each estimate to the combined result, while preserving the same variance formula for $\hat{\theta}$. ## Applications and Context ### In Weighted Averages and Meta-Analysis In meta-analysis, inverse-variance weighting serves as a fundamental method for synthesizing evidence from multiple independent studies by assigning weights to each study's effect size estimate proportional to the inverse of its sampling variance.[](https://onlinelibrary.wiley.com/doi/book/10.1002/9780470743386) This approach ensures that studies with greater precision—reflected in smaller variances—contribute more substantially to the overall pooled estimate, thereby minimizing the uncertainty in the combined result under the fixed-effects model, which assumes a single true effect size across all studies. The weights are derived from the basic formulation where each is the reciprocal of the variance of the individual estimate, promoting efficiency in evidence synthesis.[](https://onlinelibrary.wiley.com/doi/book/10.1002/9780470743386) A practical application occurs in clinical trials, where inverse-variance weighting combines effect measures such as [odds ratio](/page/Odds_ratio)s for binary outcomes or mean differences for continuous outcomes. For instance, in evaluating the efficacy of an [intervention](/page/Intervention) across several randomized controlled trials, each trial's [odds ratio](/page/Odds_ratio) is weighted by the inverse of its variance, yielding a pooled [odds ratio](/page/Odds_ratio) that reflects the overall treatment effect while accounting for varying study precisions.[](https://onlinelibrary.wiley.com/doi/book/10.1002/9780470743386) This fixed-effects assumption is appropriate when heterogeneity is minimal, allowing the method to produce a summary estimate that leverages the strengths of larger, more precise studies. The resulting pooled estimate, denoted as $\hat{\theta}$, represents the best linear unbiased estimator of the common effect, with its variance given by $\text{Var}(\hat{\theta}) = 1 / \sum w_i$, where $w_i$ are the inverse-variance weights.[](https://onlinelibrary.wiley.com/doi/book/10.1002/9780470743386) The confidence interval for this estimate is then constructed as $\hat{\theta} \pm z \sqrt{\text{Var}(\hat{\theta})}$, providing a measure of the [precision](/page/Precision) of the synthesized [evidence](/page/Evidence). This method is commonly implemented in specialized software tools, such as RevMan developed by the Cochrane Collaboration for systematic reviews, which applies inverse-variance weighting in fixed-effects meta-analyses of clinical data. Similarly, the metafor package in [R](/page/R) facilitates inverse-variance weighted models for meta-analytic computations, enabling researchers to perform these analyses efficiently on diverse datasets.[](https://cran.r-project.org/web/packages/metafor/metafor.pdf) ### In [Regression](/page/Regression) and [Estimation](/page/Estimation) Inverse-variance weighting plays a central role in regression analysis when dealing with heteroscedastic data, where the variance of the errors differs across observations. In such cases, ordinary least squares (OLS) estimation, which assumes homoscedasticity, can lead to inefficient parameter estimates. To address this, weighted least squares (WLS) incorporates weights that are inversely proportional to the error variances, thereby giving greater influence to observations with smaller uncertainties. The WLS objective function is formulated as minimizing $\sum_{i=1}^n w_i (y_i - \mathbf{x}_i^T \boldsymbol{\beta})^2$, where $w_i = 1/\sigma_i^2$ and $\sigma_i^2$ is the variance of the $i$-th error term.[](https://online.stat.psu.edu/stat501/lesson/13/13.1)[](https://www.stat.cmu.edu/~cshalizi/uADA/16/lectures/08.pdf) Under the assumptions of the Gauss-Markov theorem extended to heteroscedastic errors, WLS with inverse-variance weights achieves the best linear unbiased estimator ([BLUE](/page/Blue)) property. This means the WLS estimator has the minimum variance among all linear unbiased estimators of the [regression](/page/Regression) coefficients $\boldsymbol{\beta}$, provided the weights accurately reflect the true [error](/page/Error) variances. By downweighting observations with larger variances, WLS corrects for the inefficiency of OLS in heteroscedastic settings, ensuring unbiasedness while minimizing the [mean squared error](/page/Mean_squared_error).[](https://www.fsb.miamioh.edu/lij14/311_note_ch8.pdf)[](https://www.stat.cmu.edu/~larry/=stat401/lecture-24.pdf)[](https://belkcollegeofbusiness.charlotte.edu/azillant/wp-content/uploads/sites/846/2014/12/ECON3112_metric6out.pdf) A practical example arises when fitting a [linear regression](/page/Linear_regression) line to data where error variances vary, such as in measurements from experiments with differing sample sizes—larger samples yield smaller variances and thus higher weights ($w_i = 1/\sigma_i^2$). For instance, consider regressing yield on fertilizer amount across plots, where plots with more replicates have lower $\sigma_i^2$; applying inverse-variance weights in WLS produces a slope estimate that more closely aligns with the true relationship than OLS, as the noisier single-replicate plots exert less pull on the fitted line.[](https://online.stat.psu.edu/stat501/lesson/13/13.1)[](https://www.stat.cmu.edu/~cshalizi/uADA/16/lectures/08.pdf)[](https://darkwing.uoregon.edu/~mauro/psy612/WLS.htm) Inverse-variance weighting in WLS is a special case of [generalized least squares](/page/Generalized_least_squares) (GLS) when the error [covariance matrix](/page/Covariance_matrix) is diagonal, with the weight matrix set to the inverse of the variance-covariance matrix $\boldsymbol{\Sigma}^{-1}$. GLS extends this framework to handle known structures in the error variances, maintaining the BLUE property while accommodating more complex heteroscedasticity patterns.[](https://www.stat.cmu.edu/~cshalizi/mreg/15/lectures/24/lecture-24--25.pdf)[](https://www.biostat.jhsph.edu/~iruczins/teaching/jf/ch5.pdf)[](https://clas.ucdenver.edu/marcelo-perraillon/content/hsr-old-week-10-heteros-ii) ## Derivation ### Uncorrelated Measurements Consider a set of $ n $ unbiased estimators $ \hat{\theta}_i $ of a common [parameter](/page/Parameter) $ \theta $, where each $ \hat{\theta}_i $ has finite variance $ \sigma_i^2 > 0 $ and the estimators are uncorrelated, meaning $ \text{Cov}(\hat{\theta}_i, \hat{\theta}_j) = 0 $ for $ i \neq j $.[](https://doi.org/10.4236/ojs.2017.72017) A general [linear combination](/page/Linear_combination) of these estimators that preserves unbiasedness is the weighted [average](/page/Average) $ \hat{\theta} = \sum_{i=1}^n \lambda_i \hat{\theta}_i $, subject to the [constraint](/page/Constraint) $ \sum_{i=1}^n \lambda_i = 1 $.[](https://doi.org/10.4236/ojs.2017.72017) Since the estimators are uncorrelated, the variance of this weighted estimator simplifies to

\text{Var}(\hat{\theta}) = \sum_{i=1}^n \lambda_i^2 \sigma_i^2.

This expression follows directly from the properties of variance for independent random variables.[20] To find the weights that minimize this variance while satisfying the unbiasedness constraint, one can use the method of Lagrange multipliers. Define the Lagrangian

\mathcal{L}(\lambda_1, \dots, \lambda_n, \mu) = \sum_{i=1}^n \lambda_i^2 \sigma_i^2 + \mu \left(1 - \sum_{i=1}^n \lambda_i \right),

where $ \mu $ is the [Lagrange multiplier](/page/Lagrange_multiplier). Taking partial derivatives and setting them to zero yields

\frac{\partial \mathcal{L}}{\partial \lambda_i} = 2 \lambda_i \sigma_i^2 - \mu = 0 \implies \lambda_i = \frac{\mu}{2 \sigma_i^2}, \quad i = 1, \dots, n.

Substituting into the constraint gives $ \sum_{i=1}^n \lambda_i = \frac{\mu}{2} \sum_{i=1}^n \frac{1}{\sigma_i^2} = 1 $, so $ \mu = \frac{2}{\sum_{j=1}^n 1/\sigma_j^2} $. Thus, the optimal weights are

\lambda_i = \frac{1/\sigma_i^2}{\sum_{j=1}^n 1/\sigma_j^2}.

These are the inverse-variance weights.[20] The minimum variance achieved by this estimator is

\text{Var}(\hat{\theta}) = \sum_{i=1}^n \lambda_i^2 \sigma_i^2 = \frac{1}{\sum_{i=1}^n 1/\sigma_i^2},

which is lower than the variance of any individual [estimator](/page/Estimator), confirming the efficiency gain from combining uncorrelated [information](/page/Information).[](https://doi.org/10.4236/ojs.2017.72017) This result aligns with the Gauss-Markov theorem in the special case of uncorrelated errors with known heterogeneous variances, where the optimal linear unbiased [estimator](/page/Estimator) uses inverse-variance weighting.[](https://www.stat.cmu.edu/~cshalizi/mreg/15/lectures/24/lecture-24--25.pdf) ### Correlated Measurements When the estimates from multiple measurements are correlated, the inverse-variance weighting approach must account for the covariances between them to achieve the [minimum-variance unbiased estimator](/page/Minimum-variance_unbiased_estimator). Consider a [vector](/page/Vector) of unbiased estimates $\hat{\boldsymbol{\theta}} = (\hat{\theta}_1, \dots, \hat{\theta}_k)^T$ of a common [parameter](/page/Parameter) $\theta$, where the [covariance matrix](/page/Covariance_matrix) $\boldsymbol{\Sigma}$ captures both the variances on the diagonal and the covariances off the diagonal.[](https://doi.org/10.1016/S0042-6989(03)00435-8) A general [linear combination](/page/Linear_combination) of these estimates is given by $\hat{\theta} = \boldsymbol{\lambda}^T \hat{\boldsymbol{\theta}}$, where $\boldsymbol{\lambda}$ is a vector of weights. For unbiasedness, the weights must satisfy the constraint $\boldsymbol{1}^T \boldsymbol{\lambda} = 1$, with $\boldsymbol{1}$ denoting the vector of ones. The variance of this combined estimator is then $\operatorname{Var}(\hat{\theta}) = \boldsymbol{\lambda}^T \boldsymbol{\Sigma} \boldsymbol{\lambda}$. To minimize this variance subject to the unbiasedness constraint, the optimal weights are derived using the method of Lagrange multipliers, yielding $\boldsymbol{\lambda} = \frac{\boldsymbol{\Sigma}^{-1} \boldsymbol{1}}{\boldsymbol{1}^T \boldsymbol{\Sigma}^{-1} \boldsymbol{1}}$. The resulting minimum variance is $\operatorname{Var}(\hat{\theta}) = \left( \boldsymbol{1}^T \boldsymbol{\Sigma}^{-1} \boldsymbol{1} \right)^{-1}$.[](https://doi.org/10.1016/S0042-6989(03)00435-8) This formulation generalizes the uncorrelated case, where $\boldsymbol{\Sigma}$ is diagonal with entries equal to the individual variances $\sigma_i^2$; in that scenario, the optimal weights simplify to $\lambda_i = \frac{1/\sigma_i^2}{\sum_j 1/\sigma_j^2}$, recovering the standard inverse-variance weights. The off-diagonal elements of $\boldsymbol{\Sigma}$, representing covariances or correlations between estimates, adjust the weights to downweight or upweight contributions based on dependencies—for instance, positive correlations reduce the effective information from redundant estimates, while negative correlations can enhance overall precision.[](https://doi.org/10.1016/S0042-6989(03)00435-8) In practice, when $\boldsymbol{\Sigma}$ is unknown, it is estimated from data, such as via a sample [covariance matrix](/page/Covariance_matrix), and substituted into the weight formula, though this introduces additional variability that must be accounted for in the final variance estimate. This matrix-weighted approach ensures the combined [estimator](/page/Estimator) remains unbiased and achieves the lowest possible variance among linear combinations, making it a cornerstone for aggregating correlated data in fields like [meta-analysis](/page/Meta-analysis) and [sensor fusion](/page/Sensor_fusion). ### Normal Distributions Under the assumption that independent estimators $\hat{\theta}_i \sim \mathcal{N}(\theta, \sigma_i^2)$ for $i = 1, \dots, k$, where $\theta$ is the common true parameter and the $\sigma_i^2 > 0$ are known variances, the inverse-variance weighting arises naturally as the maximum likelihood estimator (MLE) of $\theta$.[](http://www.phys.ufl.edu/courses/phy4803L/statistics/statmain.pdf) The likelihood function is the product of the individual normal densities:

L(\theta) = \prod_{i=1}^k \frac{1}{\sqrt{2\pi \sigma_i^2}} \exp\left( -\frac{(\hat{\theta}_i - \theta)^2}{2\sigma_i^2} \right).

The log-likelihood is then

\ell(\theta) = -\frac{1}{2} \sum_{i=1}^k \frac{(\hat{\theta}_i - \theta)^2}{\sigma_i^2} + C,

where $C$ is a constant independent of $\theta$. To find the MLE, differentiate $\ell(\theta)$ with respect to $\theta$ and set the result to zero:

\frac{\partial \ell}{\partial \theta} = \sum_{i=1}^k \frac{\hat{\theta}_i - \theta}{\sigma_i^2} = 0,

yielding

\hat{\theta}{\text{MLE}} = \frac{\sum{i=1}^k (1/\sigma_i^2) \hat{\theta}i}{\sum{i=1}^k 1/\sigma_i^2}.

This is precisely the inverse-variance weighted average, with weights $w_i = 1/\sigma_i^2$.[](http://www.phys.ufl.edu/courses/phy4803L/statistics/statmain.pdf) The MLE $\hat{\theta}_{\text{MLE}}$ is normally distributed as $\mathcal{N}\left(\theta, 1 / \sum_{i=1}^k 1/\sigma_i^2 \right)$, since it is a [linear combination](/page/Linear_combination) of independent normals. This variance achieves the minimum possible among unbiased linear estimators of $\theta$, confirming its efficiency under [normality](/page/Normality).[](http://www.phys.ufl.edu/courses/phy4803L/statistics/statmain.pdf) For hypothesis testing, the [statistic](/page/Statistic) $\sum_{i=1}^k ((\hat{\theta}_i - \theta_0)/\sigma_i)^2$ follows a $\chi^2$ distribution with $k$ [degrees of freedom](/page/Degrees_of_freedom) under the [null hypothesis](/page/Null_hypothesis) $\theta = \theta_0$, enabling tests for the common mean.[](http://www.phys.ufl.edu/courses/phy4803L/statistics/statmain.pdf) This framework extends to correlated estimators $\hat{\boldsymbol{\theta}} = (\hat{\theta}_1, \dots, \hat{\theta}_k)^T \sim \mathcal{N}(\theta \mathbf{1}, \boldsymbol{\Sigma})$, where $\mathbf{1}$ is the vector of ones and $\boldsymbol{\Sigma}$ is the known [covariance matrix](/page/Covariance_matrix). The joint likelihood is the multivariate normal density, and the MLE for $\theta$ becomes the generalized inverse-variance weighted average $\hat{\theta}_{\text{MLE}} = (\mathbf{1}^T \boldsymbol{\Sigma}^{-1} \hat{\boldsymbol{\theta}}) / (\mathbf{1}^T \boldsymbol{\Sigma}^{-1} \mathbf{1})$, with variance $1 / (\mathbf{1}^T \boldsymbol{\Sigma}^{-1} \mathbf{1})$.[](https://userweb.ucs.louisiana.edu/~kxk4695/JSCS-3129.pdf) ## Extensions ### Multivariate Case In the multivariate case, inverse-variance weighting generalizes to combining multiple [independent](/page/Independent) vector-valued estimates $\hat{\boldsymbol{\theta}}_k$ of a common parameter vector $\boldsymbol{\theta}$, where each estimate has an associated [covariance matrix](/page/Covariance_matrix) $\boldsymbol{\Sigma}_k$ representing its uncertainty. This setup arises when estimating multidimensional parameters, such as multiple correlated effect sizes or regression coefficients, from separate data sources or models. Assuming the estimates are unbiased and normally distributed, the optimal combination minimizes the trace of the resulting [covariance matrix](/page/Covariance_matrix) and is achieved by weighting each estimate by the inverse of its covariance matrix, known as the precision matrix $\boldsymbol{\Sigma}_k^{-1}$.[](https://doi.org/10.1177/0962280215611702) The weighted combination formula is given by

\hat{\boldsymbol{\theta}} = \left( \sum_k \boldsymbol{\Sigma}_k^{-1} \right)^{-1} \sum_k \boldsymbol{\Sigma}_k^{-1} \hat{\boldsymbol{\theta}}_k,

where the summation is over all $K$ estimates. The covariance matrix of this combined estimate is

\boldsymbol{\Sigma} = \left( \sum_k \boldsymbol{\Sigma}_k^{-1} \right)^{-1},

which represents the matrix harmonic mean of the individual precisions, yielding lower overall uncertainty than any single estimate when the $\boldsymbol{\Sigma}_k$ differ. This approach accounts for correlations within each vector estimate through the full precision matrix, ensuring efficient aggregation even when components are dependent. The formulation derives from maximum likelihood estimation under multivariate normality and provides the best linear unbiased estimator (BLUE) for $\boldsymbol{\theta}$.[](https://doi.org/10.1177/0962280215611702) A practical example occurs in combining multivariate [regression](/page/Regression) coefficients estimated from subsets of data, such as in multilevel [meta-analysis](/page/Meta-analysis) of treatment effects across experimental designs. For instance, if data is partitioned into subgroups (e.g., by participant characteristics), separate multivariate linear regressions yield coefficient vectors $\hat{\boldsymbol{\beta}}_k$ with [covariance](/page/Covariance) matrices $\boldsymbol{\Sigma}_k$ (often the sandwich estimators). These are then pooled using the above formulas to obtain a global $\hat{\boldsymbol{\beta}}$ that borrows strength across subsets while respecting within-vector correlations, improving [precision](/page/Precision) for policy or clinical inferences. This multivariate weighting also underpins sequential estimation methods, such as the update step in the [Kalman filter](/page/Kalman_filter), where the state vector is recursively refined as a precision-weighted average of the [prior](/page/Prior) estimate and incoming observations, with the posterior precision accumulating as the sum of [prior](/page/Prior) and [measurement](/page/Measurement) precisions.[](https://www.dynsyslab.org/archive/RecEst2010/www.idsc.ethz.ch/Courses/Archives/Recursive_Estimation/recursive_filtering_2010/EstimationNotes.pdf) ### Limitations and Alternatives Inverse-variance weighting assumes that the variances of the [individual](/page/Individual) estimates are known precisely, but in practice, these are typically estimated from sample [data](/page/Data), leading to biased weights and potentially distorted overall estimates. This estimation error can introduce negative [bias](/page/Bias), particularly in small samples or when variances are underestimated, as the sample variance does not equal the true [population](/page/Population) variance. Additionally, the method weights estimates based solely on their [precision](/page/Precision) (inverse variance) and does not account for potential biases in the [individual](/page/Individual) estimates themselves, such as systematic errors from study design flaws or selection effects, which can propagate into the weighted average. The approach is also sensitive to outliers, as studies with unusually small estimated variances receive disproportionately high weights, potentially dominating the result even if their estimates are imprecise or erroneous due to low counts or other anomalies. When variances are unknown or poorly estimated, practitioners often use plug-in estimates of the variances in place of true values, though this can exacerbate [bias](/page/Bias); robust alternatives include trimming extreme weights or applying penalized estimators to mitigate the influence of unreliable variance estimates. For instance, in meta-analyses with selective [reporting](/page/Reporting) or small studies, robust variance [estimation](/page/Estimation) schemes that downweight smaller studies can provide more stable results compared to standard inverse-variance approaches. Alternatives to inverse-variance weighting include equal weighting, which assigns the same weight to each estimate and is unbiased when precisions are similar across studies, avoiding the pitfalls of variance estimation errors. In meta-analysis contexts, quality-based weights can be applied by downweighting studies according to risk-of-bias assessments, such as those from the [GRADE](/page/Grade) framework, to incorporate study quality beyond mere [precision](/page/Precision). For scenarios with substantial heterogeneity among studies, random-effects models are preferred, as they incorporate between-study variance into the weighting scheme, providing a more appropriate synthesis when effects vary systematically rather than purely due to [sampling error](/page/Sampling_error). Inverse-variance weighting approximates sample-size weighting when the variance of an estimate is roughly proportional to the inverse of its sample size (e.g., in large-sample normal approximations), but the latter is simpler and less sensitive to variance misestimation in such cases.

References

[1]
https://training.cochrane.org/handbook/current/chapter-10
[2]
Weighting by Inverse Variance or by Sample Size in Meta-Analysis
In meta-analysis, the optimal weight is inverse variance, but two alternative estimators are used. This study assesses their bias and efficiency.
[3]
The Inverse Variance Weighted Least Squares Simple Regression ...
Nov 20, 2024 · This article shows that the inverse variance weighted least squares simple regression model works as the generalized Cochran–Armitage test for trend.
[4]
Meta-analysis of median survival times with inverse-variance ... - arXiv
Mar 5, 2025 · In this article, we consider an inverse-variance weighted approach to meta-analyze median survival times that estimates the within-study standard errors.
[5]
Spurious precision in meta-analysis of observational research - Nature
Sep 26, 2025 · Here we show that such spurious precision undermines standard meta-analytic techniques, including inverse-variance weighting and bias ...
[6]
[PDF] Data Analysis Toolkit #12: Weighted averages and their uncertainties
One can show that this so-called "inverse variance weighting" scheme is optimal in the sense that it minimizes the uncertainty in the weighted mean.Missing: intuition | Show results with:intuition
[7]
Maths and Stats - Variance, Standard Deviation and Standard Error
Oct 6, 2025 · Variance is a measure of how far the observed values in a dataset fall from the arithmetic mean, and is therefore a measure of spread.
[8]
A tutorial history of least squares with applications to astronomy and ...
This article surveys the history, development, and applications of least squares, including ordinary, constrained, weighted, and total least squares.
[9]
Introduction to Meta‐Analysis | Wiley Online Books
Mar 11, 2009 · This book provides a clear and thorough introduction to meta-analysis, the process of synthesizing data from a series of separate studies.
[10]
[PDF] metafor: Meta-Analysis Package for R - CRAN
Jan 28, 2025 · Instead of using inverse-variance weighting (i.e., weighted/generalized least squares) to combine the estimates within clusters, one can set ...
[11]
13.1 - Weighted Least Squares | STAT 501
Since each weight is inversely proportional to the error variance, it reflects the information in that observation. · The weights have to be known (or more ...
[12]
[PDF] Weighted Least Squares, Heteroskedasticity, Local Polynomial ...
Feb 6, 2016 · For example, when taking polls or surveys, the variance of the proportions we find should be inversely proportional to the sample size. So we ...
[13]
[PDF] 1 Chapter 8, Heteroskedasticity Consider a simple regression y = 𝛽 ...
(C) OLS is the best linear unbiased estimator (BLUE), a result called Gauss-Markov Theorem (covered in eco411). The heteroskedasticity can be detected using ...
[14]
[PDF] Lecture 24: Weighted and Generalized Least Squares
We conclude that WLS, with W = Σ-1, has the least variance among all possible linear, unbiased estimators of the regression coefficients. Notes: 1. If all the ...Missing: heteroscedasticity | Show results with:heteroscedasticity<|control11|><|separator|>
[15]
[PDF] 1 Heteroscedasticity - UNC Charlotte Pages
Since our model now meets the assumptions of the. Gauss-Markov theorem we know that we have best linear unbiased estimators. 1.3 Tests for heteroscedasticity.
[16]
Heteroscedasticity
This is called weighted least squares because the ordinary least squares (OLS) expression is “weighted” (by the inverse of the variance). Note than when si2 ...
[17]
[PDF] Lecture 24–25: Weighted and Generalized Least Squares
that picking weights to minimize the variance in the WLS estimate. 1Less anthropomorphically, the objective function ...Missing: history | Show results with:history
[18]
[PDF] Generalized Least Squares
Generalized least squares (GLS) minimizes when errors have non-constant variance or are correlated, where the correlation and relative variance are known, but ...
[19]
[PDF] Week 10: Heteroskedasticity II
Suppose that we know or suspect that the variance is a function of some or all the explanatory variables. For example: var( |x1, ...xp) = σ2f (x1, ...,xp).Missing: fitting | Show results with:fitting
[20]
https://doi.org/10.4236/ojs.2017.72017
[21]
https://doi.org/10.1016/S0042-6989(03
[22]
[PDF] Statistical Analysis of Data in the Linear Regime - UF Physics
Equation 2.9 is called a weighted average of g(y); each value of g(yj) in ... where the weight wi for each yi is given by the inverse of the variance for.
[23]
[PDF] ON COMBINING CORRELATED ESTIMATORS OF THE COMMON ...
Halperin derived the maximum likelihood estimator (MLE) and developed two interval estimates for the common mean of a multivariate normal population. We ...
[24]
https://doi.org/10.1177/0962280215611702
[25]
[PDF] Introduction to Estimation and the Kalman Filter
Jan 2, 2001 · expected from our understanding of the Kalman filter as a weighted average; the updated estimate is simply a weighted sum of observation and ...