Fact-checked by Grok 2 weeks ago

Minimum-variance unbiased estimator

In statistics, a minimum-variance unbiased estimator (MVUE) is an unbiased estimator of a parameter that achieves the lowest possible variance among all unbiased estimators of that parameter.^[1] This property makes it a desirable choice for point estimation, as it balances lack of bias with optimal precision under squared error loss.^[2] The concept of an MVUE is fundamentally linked to the Cramér–Rao lower bound (CRLB), which establishes a theoretical minimum on the variance of any unbiased estimator based on the Fisher information in the data.^[1] An unbiased estimator attains MVUE status if its variance equals the CRLB, rendering it efficient in the sense that no other unbiased estimator can perform better.^[3] The CRLB was independently derived by C. R. Rao in his 1945 paper on the accuracy attainable in parameter estimation and by Harald Cramér in his 1946 work on sufficient statistics and optimal estimation.^[1] In practice, the uniformly minimum-variance unbiased estimator (UMVUE) extends this idea by requiring minimum variance uniformly across the entire parameter space, often leveraging complete sufficient statistics via the Lehmann–Scheffé theorem.^[2] Examples include the sample mean for the mean of a normal distribution and the sample proportion for a binomial probability, both of which achieve the CRLB under regularity conditions.^[1]

Fundamentals of Estimation

Unbiased Estimators

An estimator is a function of the observed sample data designed to approximate an unknown parameter of the underlying probability distribution.^[4] An estimator \hat{\theta}(X) is unbiased for the parameter \theta if its expected value equals the true parameter value for all \theta in the parameter space, formally E[\hat{\theta}(X)] = \theta, where X denotes the random sample.^[5] The bias of an estimator \hat{\theta} is defined as \text{Bias}(\hat{\theta}) = E[\hat{\theta}(X)] - \theta, measuring the systematic deviation from the true parameter; an estimator is unbiased precisely when this bias is zero.^[6] Due to the linearity of expectation, the sum or linear combination of unbiased estimators is also unbiased.^[5] The concept of unbiased estimation was introduced by Carl Friedrich Gauss in the early 19th century, in the context of least squares estimation for astronomical data.^[7] For intuition, consider estimating the bias probability p of a coin from n independent flips, where heads is coded as 1 and tails as 0; the sample proportion \hat{p} = \frac{1}{n} \sum_{i=1}^n X_i (the sample mean) is unbiased because E[\hat{p}] = p.^[8]

Variance in Estimators

In statistics, the variance of an estimator \hat{\theta} of a parameter \theta, based on data X, is defined as \operatorname{Var}(\hat{\theta}) = E[(\hat{\theta}(X) - E[\hat{\theta}(X)])^2]. This quantity measures the expected squared deviation of the estimator from its own expected value, thereby quantifying the uncertainty or dispersion in the possible values that \hat{\theta} can take across repeated sampling from the same distribution.^[6] Lower variance indicates higher precision, as the estimator's outcomes cluster more tightly around its mean. A key metric for evaluating estimator performance is the mean squared error (MSE), which decomposes as \operatorname{MSE}(\hat{\theta}) = \operatorname{Var}(\hat{\theta}) + [\operatorname{Bias}(\hat{\theta})]^2, where \operatorname{Bias}(\hat{\theta}) = E[\hat{\theta}(X)] - \theta. This relationship highlights variance's contribution to total estimation error, distinct from systematic deviations captured by bias.^[9] The variance of any estimator is inherently non-negative, as it represents a second moment of deviation that cannot be negative. For unbiased estimators, where bias is zero, MSE reduces exactly to the variance, making it the direct measure of accuracy.^[6]^[10] Although low variance is desirable for consistent and precise estimates, it alone does not guarantee good performance; an estimator with minimal variance but substantial bias can still produce systematically inaccurate results. Balancing low variance with low bias is thus critical for reliable inference. As an illustrative example, the sample mean \bar{X}_n = \frac{1}{n} \sum_{i=1}^n X_i serves as an estimator of the population mean \mu for independent and identically distributed samples X_1, \dots, X_n from a distribution with finite variance \sigma^2. Its variance is \operatorname{Var}(\bar{X}_n) = \frac{\sigma^2}{n}, showing that estimation uncertainty decreases proportionally with increasing sample size n.^[11]

Core Concepts

Definition of MVUE

In statistics, a minimum-variance unbiased estimator (MVUE) of a parameter \theta is an unbiased estimator \hat{\theta}^* such that its variance satisfies \operatorname{Var}(\hat{\theta}^*) \leq \operatorname{Var}(\hat{\theta}) for every other unbiased estimator \hat{\theta} of \theta, with the inequality holding for all \theta in the parameter space \Theta.^[2] This property establishes \hat{\theta}^* as optimal within the class of unbiased estimators, minimizing the dispersion of estimates around the true parameter value while preserving unbiasedness, defined as \mathbb{E}[\hat{\theta}] = \theta.^[3] The term is often synonymous with uniformly minimum-variance unbiased estimator (UMVUE). Relative efficiency provides a measure of performance comparison among unbiased estimators, defined as \operatorname{Eff}(\hat{\theta}, \hat{\theta}^*) = \frac{\operatorname{Var}(\hat{\theta}^*)}{\operatorname{Var}(\hat{\theta})}, where the value is at most 1 for an MVUE \hat{\theta}^*, indicating superior precision.^[12] Under certain regularity conditions, such as the existence of a complete sufficient statistic T, the MVUE is unique up to sets of measure zero. To see this, suppose \hat{\theta}_1 and \hat{\theta}_2 are two unbiased estimators with minimum variance, both functions of T. Their difference \hat{\theta}_1 - \hat{\theta}_2 is then an unbiased estimator of zero that is a function of T; completeness implies \mathbb{P}(\hat{\theta}_1 - \hat{\theta}_2 = 0) = 1, establishing uniqueness.^[13]^[14] The related Cramér–Rao lower bound, providing a theoretical minimum variance for unbiased estimators, was derived by C. R. Rao in 1945 and Harald Cramér in 1946.^[15] The MVUE concept is further developed through results like the Lehmann–Scheffé theorem.

Efficiency and the Cramer-Rao Bound

In estimation theory, an unbiased estimator \hat{\theta} of a parameter \theta is defined as efficient if its variance equals the Cramér–Rao lower bound (CRLB), that is, \operatorname{Var}(\hat{\theta}) = 1 / I(\theta), where I(\theta) denotes the Fisher information in the sample.^[16] This bound represents the theoretical minimum variance achievable by any unbiased estimator, serving as a benchmark for the performance of the minimum-variance unbiased estimator (MVUE). Efficiency thus indicates that the estimator extracts all available information about \theta from the data, with no room for improvement in variance among unbiased alternatives. The CRLB is derived for parametric families of distributions satisfying certain regularity conditions, such as the differentiability of the log-likelihood function with respect to \theta and the ability to interchange differentiation and integration. Specifically, for an unbiased estimator \hat{\theta} based on a sample from a distribution with probability density f(x; \theta), the bound states that \operatorname{Var}(\hat{\theta}) \geq 1 / I(\theta), with equality holding if the estimator is a function of the score statistic in a manner that satisfies the conditions for attainment. The derivation typically proceeds by noting that \operatorname{Cov}(\hat{\theta}, \partial / \partial \theta \log f(X; \theta)) = 1 under regularity conditions, and applying the Cauchy–Schwarz inequality: [\operatorname{Cov}(\hat{\theta}, \operatorname{score})]^2 \leq \operatorname{Var}(\hat{\theta}) \cdot I(\theta), yielding the variance lower bound.^[16]^[17] The Fisher information I(\theta) quantifies the amount of information the sample carries about \theta and is given by

I(\theta) = \mathbb{E}\left[ \left( \frac{\partial}{\partial \theta} \log f(X; \theta) \right)^2 \right] = -\mathbb{E}\left[ \frac{\partial^2}{\partial \theta^2} \log f(X; \theta) \right],

where the expectations are taken with respect to the distribution parameterized by \theta. This measure, introduced by Ronald Fisher, captures the curvature of the log-likelihood and the sensitivity of the distribution to changes in \theta.^[17] For the CRLB to be attainable, the distribution must belong to the regular exponential family or satisfy similar conditions ensuring the existence of an estimator that achieves equality in the bound. In such cases, the MVUE coincides with an efficient estimator, fully realizing the theoretical variance minimum.^[16] In the multiparameter setting, where \theta = (\theta_1, \dots, \theta_k)^\top is a vector of unknown parameters, the CRLB extends to a matrix inequality: the covariance matrix of any unbiased estimator \hat{\theta} satisfies \operatorname{Cov}(\hat{\theta}) \geq I(\theta)^{-1}, where I(\theta) is now the k \times k Fisher information matrix with elements I_{ij}(\theta) = \mathbb{E}\left[ \frac{\partial}{\partial \theta_i} \log f(X; \theta) \cdot \frac{\partial}{\partial \theta_j} \log f(X; \theta) \right]. This form accounts for correlations between estimators of different parameters, providing bounds on variances and covariances via the inverse matrix elements. Equality holds componentwise under analogous regularity conditions, such as the information matrix being positive definite and the estimator being asymptotically normal. When an MVUE exists in these multiparameter regular cases, it attains the CRLB, ensuring optimality across the parameter vector.^[16]

Construction Methods

Complete Sufficient Statistics

In statistical estimation, a statistic T(\mathbf{X}) is said to be sufficient for the parameter \theta if the conditional distribution of the sample \mathbf{X} given T(\mathbf{X}) does not depend on \theta. This means that T(\mathbf{X}) captures all the information about \theta contained in the sample, allowing for data reduction without loss of inferential content. The concept was formalized through the Neyman-Fisher factorization theorem, which provides a practical criterion: the joint probability density (or mass) function can be expressed as f(\mathbf{x}; \theta) = g(T(\mathbf{x}); \theta) \, h(\mathbf{x}), where g depends on \theta only through T, and h is independent of \theta. Among sufficient statistics, a minimal sufficient statistic represents the coarsest possible reduction of the data while remaining sufficient. It is a sufficient statistic such that every other sufficient statistic can be expressed as a function of it, ensuring maximal data compression without sacrificing information about \theta. This notion arises naturally in the context of partitioning the sample space based on likelihood ratios and is essential for identifying the simplest form of sufficient reduction. Completeness is a property of the family of distributions of a statistic T that complements sufficiency by preventing "wasted" information in unbiased estimation. Specifically, the family \{ P_\theta : \theta \in \Theta \} of the distribution of T is complete if, for every measurable function g such that E_\theta [g(T)] = 0 for all \theta \in \Theta, it follows that P_\theta (g(T) = 0) = 1 for all \theta. This ensures that no non-trivial unbiased estimator of zero exists within the family, which is crucial for the uniqueness of minimum-variance unbiased estimators based on complete sufficient statistics. The Rao-Blackwell theorem leverages sufficiency to improve estimators. If \delta(\mathbf{X}) is an unbiased estimator of \theta and T is sufficient for \theta, then the refined estimator \delta'(T) = E[\delta(\mathbf{X}) \mid T] is also unbiased for \theta and satisfies \mathrm{Var}(\delta'(T)) \leq \mathrm{Var}(\delta(\mathbf{X})), with equality if and only if \delta(\mathbf{X}) is already a function of T. This theorem provides a method to condition any initial unbiased estimator on a sufficient statistic, yielding a more efficient alternative that serves as a building block for achieving minimum variance. A related concept is bounded completeness, which relaxes the condition to bounded functions g with |g(T)| \leq M for some finite M. The family is boundedly complete if E_\theta [g(T)] = 0 for all \theta implies g(T) = 0 almost surely. This weaker property still guarantees uniqueness for certain classes of unbiased estimators and plays a key role in results like Basu's theorem, where a boundedly complete sufficient statistic is independent of ancillary statistics, aiding in the construction of optimal estimators.

Lehmann-Scheffe Theorem

The Lehmann-Scheffé theorem establishes a key result in point estimation theory, linking completeness and sufficiency to the existence and uniqueness of minimum-variance unbiased estimators. Specifically, the theorem states that if T is a complete sufficient statistic for a parameter \theta, and \hat{\theta} = g(T) is any unbiased estimator of \theta (i.e., E_\theta[g(T)] = \theta for all \theta in the parameter space), then g(T) is the unique uniformly minimum-variance unbiased estimator (UMVUE) of \theta.^[18] The proof outline proceeds in two main steps, building on prior results in estimation theory. First, the Rao-Blackwell theorem guarantees that for any unbiased estimator W of \theta, the conditional expectation E(W \mid T) is also unbiased and has variance no greater than that of W, with equality only if W is already a function of T. Second, completeness of T ensures uniqueness: suppose there exists another unbiased estimator \tilde{\theta} with variance less than or equal to that of g(T); then E[(\tilde{\theta} - g(T)) \mid T] = 0 for all \theta, implying by completeness that \tilde{\theta} = g(T) almost surely. The theorem holds under regularity conditions that ensure the existence of a complete sufficient statistic, such as those satisfied by full-rank exponential families with an open parameter space. In such families, the natural sufficient statistic (e.g., the sum of observations in a one-parameter exponential family) is complete, allowing direct application of the theorem to derive UMVUEs.^[19] The result generalizes straightforwardly to estimating any function \psi(\theta): if T is complete sufficient and \hat{\psi} = h(T) satisfies E_\theta[h(T)] = \psi(\theta) for all \theta, then h(T) is the unique UMVUE of \psi(\theta). This extension is immediate from the original proof, replacing \theta with \psi(\theta).^[18] Despite its utility, the theorem has limitations, as not all parametric families possess a complete sufficient statistic. For instance, in the uniform distribution on [\theta, \theta + 1], the joint order statistics (X_{(1)}, X_{(n)}) form a minimal sufficient statistic, but it is not complete, precluding the guarantee of a unique UMVUE via this method.^[20]

Applications and Examples

Uniform Distribution Example

Consider an independent and identically distributed (i.i.d.) sample X_1, \dots, X_n drawn from the uniform distribution on the interval [0, \theta], where \theta > 0 is the unknown parameter to be estimated. The probability density function for each X_i is f(x; \theta) = 1/\theta for $0 \leq x \leq \theta, and 0 otherwise. The maximum likelihood estimator (MLE) for \theta is the sample maximum, \hat{\theta}_{\text{MLE}} = X_{(n)} = \max\{X_1, \dots, X_n\}. To derive this, the likelihood function is L(\theta) = \theta^{-n} if X_{(n)} \leq \theta and 0 otherwise; maximizing it yields \hat{\theta}_{\text{MLE}} = X_{(n)}. However, this estimator is biased, as its expected value is E[X_{(n)}] = n\theta / (n+1). An unbiased estimator is obtained by adjusting for the bias: \hat{\theta} = \frac{n+1}{n} X_{(n)}.^[21] To verify unbiasedness, note that E[\hat{\theta}] = \frac{n+1}{n} E[X_{(n)}] = \frac{n+1}{n} \cdot \frac{n\theta}{n+1} = \theta. The order statistic X_{(n)} is a sufficient statistic for \theta by the factorization theorem, as the joint density factors into g(X_{(n)}; \theta) \cdot h(\mathbf{x}), where g(X_{(n)}; \theta) = \theta^{-n} I(0 \leq X_{(n)} \leq \theta) and h(\mathbf{x}) is independent of \theta. Moreover, X_{(n)} is complete because the uniform family satisfies the conditions for completeness of the maximal order statistic.^[21] By the Lehmann-Scheffé theorem, any unbiased function of a complete sufficient statistic, such as \hat{\theta}, is the minimum-variance unbiased estimator (MVUE) for \theta.^[21] To compute the variance, first find the distribution of X_{(n)}. The cumulative distribution function is F_{X_{(n)}}(x) = [x/\theta]^n for $0 \leq x \leq \theta, so the density is f_{X_{(n)}}(x) = n x^{n-1} / \theta^n. Then, E[X_{(n)}] = n \int_0^\theta x^n / \theta^n \, dx = n \theta / (n+1), as before. For the second moment, E[X_{(n)}^2] = n \int_0^\theta x^{n+1} / \theta^n \, dx = n \theta^2 / (n+2). Thus, \operatorname{Var}(X_{(n)}) = E[X_{(n)}^2] - [E[X_{(n)}]]^2 = n \theta^2 / (n+2) - [n \theta / (n+1)]^2 = n \theta^2 / [(n+1)^2 (n+2)]. Scaling for the unbiased estimator gives \operatorname{Var}(\hat{\theta}) = \left( \frac{n+1}{n} \right)^2 \operatorname{Var}(X_{(n)}) = \theta^2 / [n(n+2)].

Exponential Distribution Example

Consider a random sample X_1, X_2, \dots, X_n from the exponential distribution with rate parameter \lambda > 0, where the pdf is given by f(x; \lambda) = \lambda e^{-\lambda x} for x \ge 0. The parameter of interest is the rate \lambda, which represents the expected number of events per unit time. The sufficient statistic for \lambda is T = \sum_{i=1}^n X_i, and T follows a Gamma distribution with shape parameter n and rate parameter \lambda.^[22] An unbiased estimator for \lambda is \hat{\lambda} = \frac{n-1}{T}, derived by adjusting the method of moments estimator n/T (which is biased) to achieve unbiasedness, since E[1/T] = \lambda / (n-1) for n > 1.^[22] To establish that \hat{\lambda} is the minimum-variance unbiased estimator (MVUE), observe that T is a complete sufficient statistic for \lambda in this one-parameter exponential family. Since \hat{\lambda} is an unbiased function of the complete sufficient statistic T, the Lehmann-Scheffé theorem guarantees that \hat{\lambda} is the unique MVUE for \lambda.^[23]^[22] The variance of this MVUE is \Var(\hat{\lambda}) = \frac{\lambda^2}{n-2} for n > 2. The Cramér-Rao lower bound (CRLB) provides a lower limit on the variance of any unbiased estimator of \lambda, given by \frac{\lambda^2}{n}. The relative efficiency of \hat{\lambda} is thus \frac{n-2}{n}, which approaches 1 as the sample size n increases. Numerical simulations illustrate that the estimator's performance relative to the CRLB improves with larger n, confirming its asymptotic efficiency.^[22]

Limitations and Extensions

Comparison to Biased Estimators

While minimum-variance unbiased estimators (MVUEs) minimize variance among unbiased estimators, their mean squared error (MSE) equals their variance since bias is zero by definition. In contrast, biased estimators have MSE equal to variance plus squared bias, allowing for potentially lower overall MSE if the introduced bias is small and the reduction in variance is substantial.^[8] A prominent class of biased estimators that outperform MVUEs in MSE are shrinkage estimators, which pull estimates toward a central value to reduce variability. The James-Stein estimator exemplifies this for estimating the mean vector of a multivariate normal distribution under quadratic loss; it shrinks the unbiased sample mean toward zero and dominates the sample mean in MSE for dimensions greater than two, regardless of the true mean.^[24] In the uniform distribution on [0, θ], the maximum likelihood estimator (MLE) θ̂ = max(X_i) is biased downward but achieves lower MSE than the MVUE ((n+1)/n) max(X_i) for finite sample sizes n, as the bias term is outweighed by the MLE's smaller variance.^[25] MVUEs remain preferable in large samples, where they often attain asymptotic efficiency and unbiasedness ensures reliable long-run average performance, or in regulatory contexts such as clinical trials where institutional constraints demand unbiased estimates to avoid systematic over- or underestimation.^[26]^[27] Asymptotically, MVUEs are typically efficient under regularity conditions, matching the Cramér-Rao lower bound, but biased estimators like shrinkage methods can yield lower MSE in small samples by exploiting the bias-variance trade-off.^[28]

Bayesian and Generalized Analogs

In Bayesian statistics, point estimators serve as counterparts to frequentist minimum-variance unbiased estimators (MVUE), but prioritize minimizing the expected posterior loss rather than enforcing unbiasedness and minimizing variance within that constraint. The Bayes estimator under squared error loss is the posterior mean, which achieves the minimum posterior expected squared error by integrating prior beliefs with observed data.^[29] This approach contrasts with MVUE by allowing bias in the frequentist sense to incorporate prior information, often resulting in lower overall risk when priors reflect substantive knowledge.^[29] Bayesian credible intervals provide an analog to frequentist confidence intervals, quantifying uncertainty as the range containing the parameter with a specified posterior probability, such as 95%. Unlike confidence intervals, which achieve coverage in repeated sampling under the true parameter, credible intervals directly interpret probability conditional on the data and prior. Under squared error loss, Bayesian efficiency emphasizes minimizing posterior risk, offering a coherent measure of estimator performance that aligns with decision-theoretic optimality.^[30] Empirical Bayes methods and hierarchical models introduce shrinkage estimators as biased analogs to MVUE, leveraging data-driven priors to reduce mean squared error at the cost of unbiasedness. In hierarchical settings, parameters are treated as draws from a higher-level distribution, leading to estimators that pull individual estimates toward a central tendency. The James-Stein estimator exemplifies this for estimating multiple normal means under squared error loss, shrinking sample means toward their grand mean and dominating the unbiased maximum likelihood estimator when the dimension exceeds two, with risk reduction up to 12% in high dimensions. Generalized analogs to MVUE arise in decision theory through minimax estimators that maintain unbiasedness under group invariance, minimizing the maximum risk over invariant parameter spaces. These estimators achieve the minimax property among invariant unbiased rules, extending MVUE to structured problems like location-scale families where transformations preserve the model. Such generalizations ensure robustness in invariant decision problems, often coinciding with Bayes rules under least favorable priors. From a Bayesian viewpoint, frequentist MVUE limitations stem from disregarding prior information, which can inflate posterior risk in scenarios with informative priors. For estimating the rate \theta of an exponential distribution based on i.i.d. samples X_1, \dots, X_n \sim \exp(\theta), the MVUE is (n-1) / \sum X_i, but with a gamma conjugate prior \theta \sim \Gamma(\alpha, \beta), the posterior is \Gamma(\alpha + n, \beta + \sum X_i), and the posterior mean (\alpha + n) / (\beta + \sum X_i) shrinks the MLE \hat{\theta} = n / \sum X_i toward the prior mean \alpha / \beta, typically yielding lower mean squared error when the prior is accurate.^[31]^[32]

References

[1]
[PDF] 6 Classic Theory of Point Estimation - Purdue Department of Statistics
It was proved independently by C.R. Rao and Harald Cramér, (Rao (1945), Cramér (1946)). The Cramér-Rao lower. 324. Page 42. bound (CRLB) is fundamental on its ...
[2]
[PDF] Unbiased estimation - Stat@Duke
Mar 23, 2025 · An estimator δ : X → h(Θ) is the uniformly minimum variance unbiased estimator (UMVUE) of h(θ) if it is unbiased and for any other unbiased.
[3]
[PDF] 5.5 Minimum Variance Estimators - URI Math Department
78. Definition. 1. is a best or Minimum Variance Unbiased Estimator if it is unbiased and for all unbiased estimators , 2. An unbiased estimator is efficient ...
[4]
[PDF] Lecture 9 Estimators
Sep 25, 2019 · We defined an estimator as any function of the data which is not allowed to depend on the value of the unknown parameters.
[5]
1.3 - Unbiased Estimation | STAT 415 - STAT ONLINE
In summary, we have shown that, if X i is a normally distributed random variable with mean μ and variance σ 2 , then S 2 is an unbiased estimator of σ 2 . It ...
[6]
[PDF] Properties of Estimators I 7.6.1 Bias
The bias of an estimator measures whether or not in expectation, the estimator will be equal to the true parameter. Definition 7.6.1: Bias. Let ˆθ be an ...
[7]
Gauss on least-squares and maximum-likelihood estimation
Apr 2, 2022 · Gauss' 1809 discussion of least squares, which can be viewed as the beginning of mathematical statistics, is reviewed.
[8]
[PDF] Unbiased Estimation - Arizona Math
The mean square error for an unbiased estimator is its variance. ... Because ¯X has this variance, it is a uniformly minimum variance unbiased estimator.
[9]
[PDF] Lecture 1: Optimal Prediction (with Refreshers)
Mean squared error is bias (squared) plus variance. This is the simplest form of the bias-variance decomposition, which is one of the central parts of ...
[10]
[PDF] Bias, Variance, and MSE of Estimators
Sep 4, 2010 · Since the MSE decomposes into a sum of the bias and variance of the estimator, both quantities are important and need to be as small as ...
[11]
24.4 - Mean and Variance of Sample Mean | STAT 414
Our result indicates that as the sample size n increases, the variance of the sample mean decreases. That suggests that on the previous page, if the instructor ...
[12]
[PDF] Unbiased Estimation Lecture 15: UMVUE: functions of sufficient and ...
Definition 3.1 (UMVUE). An unbiased estimator T(X) of ϑ is called the uniformly minimum variance unbiased estimator (UMVUE) iff Var(T(X)) ≤ Var(U(X)) for.
[13]
[PDF] 3 Evaluating the Goodness of an Estimator: Bias, Mean-Square ...
We can use the relative efficiency to decide which of the two unbi- ased estimators is preferred. • If. Eff(ˆθ1, ˆθ2) = Var(ˆθ2). Var(ˆθ1). > 1,.
[14]
[PDF] Lecture 6: Minimum Variance Unbiased Estimators
Apr 27, 2015 · An estimator is said to be unbiased if b(bθ) = 0. If multiple unbiased estimates of θ are available, and the.
[15]
[PDF] Sufficiency and Unbiased Estimation - Oxford statistics department
MVUE, U∗ is also MVUE. The essential uniqueness of a. MVUE implies U = U∗. 12. Page 13. Completeness. A statistic T is said to be complete w.r.t. θ if for all.Missing: via | Show results with:via
[16]
Introduction to Rao (1945) Information and the Accuracy Attainable ...
ChapterPDF Available. Introduction to Rao (1945) Information and the Accuracy Attainable in the Estimation of Statistical Parameters. January 1992. DOI:10.1007 ...
[17]
[PDF] Information and the Accuracy Attainable in the Estimation of ... - Gwern
The earliest method of estimation of statistical parameters is the method of least squares due to Markoff. A set of observations whose expectations are.
[18]
[PDF] On the Mathematical Foundations of Theoretical Statistics Author(s)
On the illathematical Foundations of Theoretical Statistics. 1By R. A. FISHER, M.A., Fellow of Gonville and Caims College, Cambridge, Chief. Statistician, ...
[19]
Lehmann, E.L. and Scheffe, H. (1950) Completeness ... - Scirp.org.
This paper applies Rao-Blackwell and Lehmann-Scheffeé Theorems to deduce the uniformly minimum-variance unbiased estimator (UMVUE) for the gamma cumulative ...
[20]
https://genome.sph.umich.edu/w/images/3/38/Bios602-wi13-lec06-handout.pdf
[21]
[PDF] Biostatistics 602 - Statistical Inference Lecture 06 Basu's Theorem
Jan 29, 2013 · ∼ Uniform(θ, θ + 1), θ ∈ R. • Is T(X)=(X(1),X(n)) a complete ... A minimal sufficient statistic is not necessarily complete. (Recall ...
[22]
[PDF] Lecture Notes for Math 448 Statistics - math.binghamton.edu
Dec 23, 2022 · By using the linearity of expectation: E h. (bθ − θ)2 i ... This estimator is unbiased, because bβ0 and bβ1 are unbiased estimators of β0.
[23]
[PDF] Solutions Manual for Statistical Inference, Second Edition
Page 1. Solutions Manual for. Statistical Inference, Second Edition. George Casella. University of Florida. Roger L. Berger. North Carolina State University.
[24]
Completeness, Similar Regions, and Unbiased Estimation-Part I
The aim of this paper is the study of two classical problems of mathematical statistics, the problems of similar regions and of unbiased estimation.Missing: original | Show results with:original
[25]
[PDF] Estimation with quadratic loss
STEIN, "Inadmissibility of the usual estimator for the mean of a multivariate normal distribution,” Proceedings of the Third Berkeley Symposium on Mathematical ...
[26]
[PDF] Parametric Inference - University of Michigan
Apr 14, 2004 · (d) Unbiased estimators are not always better than biased estimators. ... Hence our results will not apply to the Uniform distribution (or ones.
[27]
[PDF] Efficient and asymptotically efficient estimation - Stat@Duke
Apr 3, 2025 · The MSE of the MLE will be (asymptotically) smaller than that of the. MOME, but for finite samples, the MLE has bias, and its variance is not ...
[28]
Conditionally unbiased estimation in phase II/III clinical trials ... - NIH
Feb 15, 2013 · Regulatory guidance, indicates that the bias of estimates obtained following an ASD should be considered. Cohen and Sackrowitz and Shen have ...
[29]
[PDF] Nearly weighted risk minimal unbiased estimation
Dec 18, 2018 · Also, regulatory or other institutional constraints might make it desirable that, in repeated quantile forecasts, the realized value takes on ...
[30]
Statistical Decision Theory and Bayesian Analysis - SpringerLink
Access this book ; eBook USD 139.00 · Available as PDF ; Softcover Book USD 189.00 · Compact, lightweight edition ; Hardcover Book USD 189.00 · Durable hardcover ...
[31]
Understanding and interpreting confidence and credible intervals ...
Dec 31, 2018 · Confidence intervals (CI) measure the uncertainty around effect estimates. Frequentist 95% CI: we can be 95% confident that the true estimate would lie within ...
[32]
[PDF] Chapter 9 The exponential family: Conjugate priors - People @EECS
The objective Bayesian perspective takes the more pessimistic view that prior knowledge is often not available and that priors should be chosen to have as ...