Fact-checked by Grok 2 weeks ago

Statistical inference

Statistical inference is the process of using data analysis to infer properties of an underlying probability distribution, particularly to draw conclusions about population parameters from a sample of data.^[1] It involves constructing statistical models that describe the relationships between random variables and parameters, making assumptions about their distributions, and accounting for residuals or errors in the data generation process.^[1] The primary goals of statistical inference include estimation, where unknown parameters are approximated using sample statistics, and hypothesis testing, where claims about parameters are evaluated based on evidence from the data.^[1] Point estimation provides a single best guess, such as the sample mean as an estimate of the population mean, while interval estimation offers a range of plausible values, often via confidence intervals that quantify uncertainty.^[1] Hypothesis testing assesses whether observed data support specific hypotheses, typically using p-values or test statistics derived from sampling distributions.^[1] Statistical inference relies on the sampling distribution of estimators, which describes the variability of statistics across repeated samples, often approximated by the Central Limit Theorem for large samples where the distribution approaches normality.^[1] Two main paradigms dominate the field: the frequentist approach, which treats parameters as fixed unknowns and bases inferences on long-run frequencies of procedures, and the Bayesian approach, which incorporates prior beliefs about parameters to update them with data into posterior distributions.^[2] In frequentist methods, uncertainty is captured through confidence intervals and p-values, whereas Bayesian inference uses credible intervals from posterior probabilities to measure belief in parameter values.^[2] Key concepts in evaluation include bias, the expected difference between an estimator and the true parameter; variance, measuring the spread of the estimator; and mean squared error, combining bias and variance to assess overall accuracy.^[3] Desirable properties like consistency ensure that estimators converge to the true value as sample size increases, enabling reliable inferences in diverse applications from scientific research to policy analysis.^[3]

Introduction

Definition and scope

Statistical inference is the process of using data from a sample to draw conclusions about an unknown population, typically involving the estimation of population parameters or the testing of hypotheses regarding those parameters.^[4]^[5] This approach enables generalizations beyond the observed data, providing probabilistic statements about features of the population such as means, proportions, or relationships between variables.^[6] Unlike descriptive statistics, which summarize the sample itself, statistical inference bridges the gap to the broader population by accounting for sampling variability and uncertainty.^[7] The scope of statistical inference encompasses inductive reasoning under conditions of uncertainty, where conclusions are drawn from specific observations to broader generalizations without the certainty afforded by deductive logic.^[8]^[9] It formalizes this process through probability theory, yielding inferences expressed as confidence intervals, p-values, or posterior distributions that quantify the reliability of claims about unknown quantities.^[10] Central to this scope are key concepts such as the distinction between the population—the entire set of entities or outcomes of interest—and the sample, a subset drawn from it to represent the whole.^[11] Random sampling plays a crucial role, ensuring each population member has a known probability of selection, which allows the application of probability-based methods to extend sample findings to the population.^[12] Thus, inference serves as the mechanism for connecting empirical evidence from the sample to probabilistic assertions about the population.^[7] The term "statistical inference" first appeared in the mid-19th century, with its earliest documented use in 1843, though its foundational principles are rooted in the probability theory developed by pioneers like Pierre-Simon Laplace in the late 18th century.^[13]^[14] Statistical inference often relies on underlying statistical models to structure the relationship between data and population characteristics.^[15]

Importance in science and decision-making

Statistical inference plays a pivotal role in scientific research by enabling researchers to draw reliable conclusions from sample data about broader populations or processes, thereby supporting evidence-based hypotheses and discoveries across disciplines such as physics and biology.^[15] In physics experiments, it helps quantify uncertainties in measurements, allowing validation of theoretical models, while in biological trials, it assesses the significance of observed effects, such as gene expressions or ecological patterns.^[4] This process ensures that scientific advancements are grounded in probabilistic reasoning rather than anecdotal evidence, fostering progress in understanding natural phenomena.^[16] In medicine, statistical inference is essential for evaluating clinical trials, where it determines the efficacy and safety of treatments by estimating population parameters like response rates and testing hypotheses about differences between interventions and controls.^[17] For instance, inference methods guide decisions on drug approvals by providing confidence intervals around effect sizes, helping regulatory bodies like the FDA balance risks and benefits.^[18] Similarly, in economics, it underpins policy evaluation through techniques like randomized controlled trials and instrumental variables, enabling causal inferences about interventions such as minimum wage laws or subsidy programs.^[19] In engineering, particularly quality control, inference monitors process variability using control charts and hypothesis tests to detect deviations, ensuring product reliability and reducing defects in manufacturing.^[20] Beyond specific fields, statistical inference facilitates decision-making under uncertainty by quantifying the reliability of estimates and probabilities of errors, allowing individuals and organizations to make informed choices when complete information is unavailable.^[21] It reduces bias in inductive reasoning by providing tools like confidence intervals and p-values to assess evidence strength, which is crucial in scenarios ranging from resource allocation to risk assessment.^[22] On a societal level, it informs policy through applications like election polling, where inference models predict voter behavior to guide democratic processes; in law, it supports empirical legal studies by evaluating evidence in discrimination cases via causal inference; and in business, it aids forecasting and market analysis to optimize strategies amid economic volatility.^[23]^[24] However, challenges in statistical inference, such as p-hacking—where researchers selectively analyze data to achieve statistical significance—can undermine validity and lead to false positives, eroding trust in scientific findings.^[25] This practice contributes to reproducibility crises, as many published results fail replication due to overlooked assumptions or selective reporting, emphasizing the need for transparent methods and preregistration to maintain integrity.^[26] Addressing these issues is vital to preserve the role of inference in robust, ethical decision-making.^[27]

Historical Development

Early foundations (17th-19th centuries)

The foundations of statistical inference emerged in the 17th century through early developments in probability theory, which provided tools for reasoning under uncertainty. In 1654, Blaise Pascal and Pierre de Fermat exchanged letters addressing the "problem of points," a gambling puzzle about dividing stakes in an interrupted game of chance, laying the groundwork for probabilistic calculations by introducing concepts like expected value and combinatorial enumeration.^[28]^[29] This correspondence marked the birth of probability as a mathematical discipline, shifting focus from deterministic outcomes to quantified chances. Around the same time, John Graunt analyzed London's Bills of Mortality in his 1662 work Natural and Political Observations Made upon the Bills of Mortality, constructing the first life tables by systematically tabulating birth and death data to estimate population patterns, such as sex ratios and mortality rates from plagues, representing an early form of inductive inference from observational data.^[30]^[31] The 18th century advanced these ideas toward inverse reasoning, where probabilities of causes are inferred from observed effects. Thomas Bayes's posthumously published 1763 essay, "An Essay towards Solving a Problem in the Doctrine of Chances," introduced a method for updating probabilities based on evidence, known as inverse probability, using a thought experiment with a billiard table to derive what would later be formalized as Bayes's theorem.^[32]^[33] Building on this, Pierre-Simon Laplace expanded the framework in his 1774 memoir "Mémoire sur la probabilité des causes par les événements," applying probabilistic principles to astronomical data and legal evidence, such as estimating the reliability of witness testimonies by treating causes as hypotheses with prior probabilities updated by observed outcomes.^[34] Laplace's work emphasized the symmetry between direct and inverse probabilities, influencing later Bayesian approaches by framing inference as a reversal of causal probabilities. In the 19th century, statistical inference evolved through methods for parameter estimation amid measurement errors, transitioning from ad hoc adjustments to systematic probabilistic models. Adrien-Marie Legendre introduced the method of least squares in 1805 for fitting planetary orbits to observational data, minimizing the sum of squared residuals to obtain optimal estimates under the assumption of normally distributed errors.^[35]^[36] Carl Friedrich Gauss independently developed and justified the same method probabilistically in 1809, arguing that it yields maximum likelihood estimates when errors follow a Gaussian distribution, thus grounding estimation in probability theory.^[35]^[36] Francis Galton advanced relational inference in the 1880s with his studies on heredity, coining "regression" in 1885 to describe how offspring traits revert toward the population mean and introducing "correlation" in 1888 to quantify linear associations, using bivariate data from heights to illustrate these concepts.^[37]^[38] William Sealy Gosset's work on small-sample inference, rooted in 19th-century brewing practices at Guinness where he analyzed yield variations from limited trials starting in the late 1890s, led to the t-distribution for testing means, though published in 1908.^[39]^[40] This period witnessed a profound shift from viewing errors and uncertainty as deterministic flaws to be eliminated toward probabilistic phenomena inherent in observation and induction, enabling inference as a tool for scientific prediction and decision-making under variability.^[41]^[42]

Modern developments (20th century onward)

In the early 20th century, Ronald Fisher formalized key concepts in statistical inference, introducing the likelihood function as a central tool for parameter estimation and developing significance testing to assess the compatibility of data with a null hypothesis. Fisher's approach emphasized the use of p-values to quantify the strength of evidence against a hypothesis, laying the groundwork for modern experimental design in fields like agriculture and genetics. Concurrently, in the 1930s, Jerzy Neyman and Egon Pearson advanced hypothesis testing through their lemma, which provided a framework for constructing optimal tests by maximizing power against specific alternatives while controlling the type I error rate. In the 1930s, Jerzy Neyman developed confidence intervals, building on his joint work with Egon Pearson in hypothesis testing, offering a method to quantify uncertainty around parameter estimates by considering the procedure's long-run performance across repeated samples. Abraham Wald contributed to decision theory in the 1940s, formalizing statistical problems as choices under uncertainty with associated losses, which influenced sequential analysis and robust inference in wartime applications like quality control. Post-World War II, Bayesian methods experienced a revival, driven by figures like Leonard Savage, who axiomatized subjective probability and decision-making under uncertainty, bridging personal beliefs with objective data. The late 20th century saw computational advances transform inference, with Bradley Efron's 1979 bootstrap method enabling nonparametric estimation of sampling distributions by resampling data, thus approximating complex variability without strong parametric assumptions. Parallel developments in Bayesian computation included Markov chain Monte Carlo (MCMC) techniques, pioneered by Tanner and Wong in 1987 through data augmentation for posterior sampling, and popularized by Gelfand and Smith in 1990 for marginal density calculations in high-dimensional models. These methods democratized Bayesian analysis for intractable integrals, fostering its adoption in diverse applications from epidemiology to physics. Throughout these developments, debates between frequentist and Bayesian paradigms intensified, exemplified by Savage's 1954 critique, which argued for subjective probabilities as rationally coherent under his axioms, challenging the objective long-run frequencies emphasized by Neyman and Fisher. In the 21st century, statistical inference has integrated with big data and machine learning, where methods like penalized likelihood and ensemble techniques blend predictive modeling with inferential rigor to handle massive, high-dimensional datasets. Emphasis on reproducibility has grown, highlighted by the American Statistical Association's 2016 statement clarifying the proper interpretation of p-values to mitigate misuse in scientific reporting. Extensions in causal inference, refining Donald Rubin's potential outcomes framework, have incorporated modern tools like doubly robust estimation to address confounding in observational studies, enhancing applications in policy evaluation and biomedicine.

Statistical Models and Assumptions

Parametric and nonparametric models

In statistical inference, models are broadly classified into parametric and nonparametric categories based on the structure of the assumed probability distribution for the data. Parametric models assume that the data are generated from a specific family of distributions characterized by a finite number of parameters, typically represented as a vector \theta \in \Theta, where \Theta is a finite-dimensional Euclidean space. The probability density or mass function is then denoted as f(x \mid \theta), allowing for explicit parameterization of the data-generating process.^[43] This approach facilitates tractable inference when the assumed form aligns with the underlying data mechanism. A classic example is the normal distribution, parameterized by mean \mu and variance \sigma^2, or linear regression, where the model is expressed as y = X\beta + \epsilon with \epsilon \sim \mathcal{N}(0, \sigma^2 I) and \beta as the finite-dimensional coefficient vector.^[44] Nonparametric models, in contrast, do not impose a fixed functional form on the distribution and instead estimate infinite-dimensional features of the data distribution, such as the entire density or cumulative distribution function, without relying on a predetermined parametric family. These models treat the parameter space as infinite-dimensional, enabling greater flexibility to capture complex or unknown data structures.^[45] For instance, the empirical distribution function serves as a nonparametric estimator of the cumulative distribution function, directly derived from the sample without distributional assumptions, while spline methods approximate smooth functions by piecewise polynomials to model relationships in regression without specifying a global form.^[46] The choice between parametric and nonparametric models involves key trade-offs in efficiency, robustness, and model complexity. Parametric models can achieve higher statistical efficiency—lower variance in estimators—when their assumptions hold true, as the finite parameters concentrate estimation power, but they risk severe bias if the assumed form is misspecified.^[47] Nonparametric models offer robustness to distributional misspecification by avoiding strong assumptions, making them suitable for exploratory analysis or heterogeneous data, though this flexibility comes at the cost of increased variance and slower convergence rates, often quantified by higher effective degrees of freedom that grow with sample size.^[45] Model complexity in parametric approaches is fixed by the dimensionality of \theta, whereas nonparametric methods adapt complexity to the data, balancing underfitting and overfitting through techniques like bandwidth selection.^[48]

Validity and checking of assumptions

Valid assumptions underpin the reliability of statistical inference, as violations can lead to biased estimates, inflated error rates, or invalid conclusions. For instance, in parametric models such as the t-test, failure to meet the normality assumption can result in increased Type I error rates, particularly under drastic deviations, though the impact diminishes with larger sample sizes.^[49]^[50] Ensuring assumptions hold is thus essential to maintain the integrity of inferential procedures across various statistical analyses.^[51] To assess assumption validity, analysts employ diagnostic tools focused on residuals, defined as the differences between observed and predicted values, e_i = y_i - \hat{y}_i. Residual analysis involves plotting these residuals against fitted values or predictors to detect patterns indicating non-linearity, heteroscedasticity, or outliers; deviations from randomness suggest model inadequacy.^[52] Quantile-quantile (Q-Q) plots compare the quantiles of residuals to those of a theoretical distribution, such as the normal, with points aligning closely to the reference line supporting the assumption.^[53]^[54] Goodness-of-fit tests provide formal quantitative checks, notably the chi-squared test, which evaluates whether observed frequencies match expected ones under the model. The test statistic is computed as:

\chi^2 = \sum_{i} \frac{(O_i - E_i)^2}{E_i}

where O_i are observed counts and E_i expected counts; under the null hypothesis of good fit, it follows a chi-squared distribution with degrees of freedom equal to the number of categories minus one (or adjusted for parameters estimated). A large value rejects the null, signaling assumption violation.^[55]^[56] Even when exact assumptions fail mildly, approximate inference remains viable through the central limit theorem (CLT), which establishes asymptotic normality for sample means and related estimators as sample size grows, regardless of underlying distribution, provided finite variance. This supports the robustness of many procedures, like the t-test, to moderate non-normality in large samples.^[57] When assumptions are suspect, consequences include biased inference from model misspecification, where incorrect functional forms or omitted variables distort results. Sensitivity analysis quantifies how inferences change under perturbed assumptions, aiding robustness evaluation. For heteroscedasticity detection—a common misspecification—White's test examines squared residuals regressed on explanatory variables and their squares/cross-products, yielding a chi-squared statistic to test the null of homoscedasticity.^[58]^[59]^[60]

Randomization-based approaches

Randomization-based approaches to statistical inference derive the sampling distribution of test statistics directly from the known randomization procedure employed in experimental design, bypassing the need for parametric models of the data-generating process. These methods exploit the exchangeability of observations induced by randomization under the null hypothesis, enabling exact inference even in finite samples. This contrasts with model-based methods by grounding validity solely in the design rather than distributional assumptions.^[61] In experimental settings, randomization ensures that treatment assignments are independent of potential outcomes, promoting balance across groups and serving as the foundation for inference. Ronald Fisher emphasized randomization as the "reasoned basis for inference," arguing that it justifies the use of the randomization distribution to assess the sharpness of null hypotheses. A seminal example is Fisher's exact test for 2x2 contingency tables in completely randomized experiments, where the p-value is calculated as the proportion of all possible treatment assignments—consistent with the experimental design—that produce a test statistic at least as extreme as the observed one. This test, introduced in Fisher's work on agricultural trials, provides an exact assessment without approximating the distribution via large-sample theory.^[62]^[63] Model-free inference within this framework relies on permutation tests, which construct the null distribution by exhaustively or approximately reshuffling treatment labels across fixed observed outcomes, under the sharp null hypothesis that the treatment has no effect for any experimental unit. Developed from early ideas in Fisher's randomization tests and formalized by subsequent work, permutation tests are applied in diverse fields to evaluate differences in group means, medians, or other statistics, offering nonparametric validity in randomized trials.^[64] For model-based extensions in randomized contexts, analysis of covariance (ANCOVA) adjusts post-treatment outcomes for baseline covariates, enhancing precision while maintaining randomization-based inference. Fisher advocated ANCOVA in randomized experiments to reduce variance in treatment effect estimates by accounting for prognostic factors observed prior to randomization. Modern implementations confirm that ANCOVA outperforms unadjusted analyses in power and bias reduction when covariates are uncorrelated with treatment assignment.^[65] These approaches offer key advantages, including guaranteed validity without reliance on normality or other distributional assumptions, making them ideal for A/B testing in technology and randomized clinical trials where model misspecification risks are high. They also facilitate exact p-values for sharp nulls, enhancing interpretability in small-sample settings.^[66]^[67] Limitations include the necessity of complete randomization without stratification or clustering, which may not align with all experimental designs, and higher computational demands for enumerating permutations in large datasets. Moreover, when parametric models are correctly specified, randomization-based methods can exhibit lower statistical power than their model-reliant counterparts.^[61]^[63]

Paradigms of Inference

Frequentist paradigm

The frequentist paradigm in statistical inference treats parameters as fixed but unknown constants, assigning probabilities solely to observable data or procedures rather than to the parameters themselves.^[68] Probability is interpreted as the long-run frequency of events in repeated sampling under the same conditions, emphasizing the behavior of inference procedures over hypothetical replications of the experiment.^[69] This approach ensures objectivity by relying on repeatable experiments and the sampling distribution of statistics, where inferences are derived from the distribution of the data given the parameter, without incorporating subjective priors.^[70] Central to this paradigm is the concept of coverage probability for procedures like confidence intervals, which guarantees that the interval contains the true parameter value in a specified proportion (e.g., 95%) of repeated samples from the population.^[71] In hypothesis testing, rejection regions are defined based on the sampling distribution under the null hypothesis, controlling the long-run Type I error rate (probability of false rejection) at a pre-specified level α. The superpopulation view models the data as draws from an infinite population, allowing assessment of procedure performance across all possible samples, which underpins the paradigm's focus on frequentist error rates and power.^[72] A representative example is the Z-test for a population mean, where the test statistic is compared to its sampling distribution under normality assumptions to decide whether to reject the null hypothesis of a specific mean value; here, the p-value quantifies the probability of observing data as extreme or more so under the null, but no probability is assigned directly to the hypothesis itself.^[73] This avoids probabilistic statements about parameters, contrasting with Bayesian methods that update beliefs via posteriors.^[74] Criticisms of the frequentist approach include its vulnerability to ad hoc adjustments in complex scenarios, such as optional stopping, which can inflate error rates without proper correction.^[75] Multiple testing problems exacerbate this, as conducting numerous tests without adjustment increases the family-wise error rate, leading to inflated false positives despite individual test control at α.^[76] In relation to decision theory, the frequentist paradigm incorporates minimax criteria for robust procedures that minimize maximum risk and admissibility, where a rule is inadmissible if another dominates it in risk for all parameters. Wald's complete class theorem establishes that admissible decision rules form a complete class, often coinciding with Bayes rules under certain conditions, providing a foundation for evaluating frequentist procedures.^[72]

Bayesian paradigm

The Bayesian paradigm treats unknown parameters as random variables, incorporating prior knowledge or beliefs about their distribution to update with observed data. This approach uses Bayes' theorem to compute the posterior distribution of the parameters, given by p(\theta | y) \propto p(y | \theta) p(\theta), where p(\theta | y) is the posterior, p(y | \theta) is the likelihood, and p(\theta) is the prior distribution.^[77] Unlike frequentist methods that rely on long-run frequencies, Bayesian inference provides a direct probability statement about the parameters conditional on the data.^[77] Credible intervals, derived from the posterior distribution, capture regions where the parameter lies with a specified probability, such as P(\theta \in [a, b] | y) = 1 - \alpha, offering a coherent measure of uncertainty.^[78] Prior specification is central to the Bayesian paradigm, with conjugate priors simplifying computations by yielding posteriors from the same family as the prior. For instance, the beta distribution is conjugate to the binomial likelihood; if the prior is \text{Beta}(\alpha, \beta) and data consist of s successes in n trials, the posterior is \text{Beta}(\alpha + s, \beta + n - s).^[79] This beta-binomial model is commonly applied to estimate proportions, such as success rates in clinical trials, where the posterior mean (\alpha + s)/(\alpha + \beta + n) serves as a point estimate shrunk toward the prior.^[80] Non-informative priors, like the Jeffreys prior \pi(\theta) \propto \sqrt{|I(\theta)|} based on the Fisher information matrix I(\theta), aim to minimize subjective influence while ensuring invariance under reparametrization.^[81] Hierarchical models extend this by specifying priors on hyperparameters, allowing partial pooling across groups, as detailed in frameworks for multilevel data analysis.^[82] The Bayesian paradigm excels in providing coherent uncertainty quantification, as all inferences derive from the full posterior distribution, enabling exact small-sample results without asymptotic approximations.^[83] It also facilitates handling complex models by naturally incorporating prior information, supporting predictive distributions and decision-making under uncertainty.^[84] However, criticisms highlight the subjectivity in choosing priors, which can unduly influence results if not justified by external knowledge.^[85] Lindley's paradox illustrates a tension in hypothesis testing, where Bayesian methods with vague priors may favor null hypotheses even when frequentist p-values suggest rejection, underscoring challenges in comparing paradigms.^[85]

Likelihood-based paradigm

The likelihood-based paradigm centers on the likelihood function as the primary vehicle for statistical inference, emphasizing the evidential content of the data with respect to model parameters without reliance on prior distributions or exhaustive consideration of sampling distributions. Developed by Ronald A. Fisher in the early 20th century, this approach posits that the likelihood L(\theta \mid x) = \prod_{i=1}^n f(x_i \mid \theta), where x = (x_1, \dots, x_n) are the observed data and \theta are the parameters of the probability density f, quantifies the relative support for different values of \theta given the data.^[86] Inference proceeds by treating the likelihood as an objective summary of the data, maximizing it to obtain point estimates and using ratios of likelihoods for comparisons or tests. A key principle is the maximization of the likelihood to derive estimators, particularly in models with multiple parameters where some are of primary interest and others are nuisances. The maximum likelihood estimator (MLE) \hat{\theta} solves \hat{\theta} = \arg\max_\theta L(\theta \mid x), or equivalently the log-likelihood \ell(\theta \mid x) = \log L(\theta \mid x), which simplifies computation due to its additive structure. For nuisance parameters \nu, the profile likelihood for the parameter of interest \psi is formed by L_p(\psi \mid x) = \max_\nu L(\psi, \nu \mid x), effectively concentrating the full likelihood over the nuisance space to focus inference on \psi.^[87] Central methods include MLE for estimation and the likelihood ratio test (LRT) for hypothesis testing. The LRT compares the maximum likelihood under the full model to that under a restricted model imposing the null hypothesis, yielding the test statistic \lambda = 2 \log \left( \frac{L(\hat{\theta} \mid x)}{L(\hat{\theta}_0 \mid x)} \right), where \hat{\theta} is the unrestricted MLE and \hat{\theta}_0 is the restricted MLE; under the null, \lambda asymptotically follows a chi-squared distribution with degrees of freedom equal to the difference in the number of free parameters, as established by Wilks' theorem.^[88] This paradigm offers several advantages, notably invariance under reparameterization: if \hat{\theta} maximizes L(\theta \mid x), then g(\hat{\theta}) maximizes the reparameterized likelihood for any one-to-one transformation g.^[89] Additionally, under regularity conditions, the MLE is asymptotically efficient, attaining the Cramér–Rao lower bound on the variance of unbiased estimators: \operatorname{Var}(\hat{\theta}) \geq \frac{1}{I(\theta)}, where the Fisher information is I(\theta) = -\mathbb{E}\left[ \frac{\partial^2 \ell(\theta \mid x)}{\partial \theta^2} \right].^[90] Illustrative examples highlight its application. In logistic regression, which models binary outcomes via the logit link, the parameters \beta in P(Y=1 \mid x) = \frac{1}{1 + e^{-x^T \beta}} are estimated by MLE, maximizing the binomial log-likelihood to yield coefficients that best fit the observed success probabilities.^[91] Wilks' theorem underpins the asymptotic validity of such tests in generalized linear models, ensuring reliable inference as sample size grows. Despite these strengths, the likelihood-based approach has limitations, particularly in finite samples where it overlooks the variability in the estimation process itself, potentially resulting in overly precise inferences that do not account for sampling error adequately.^[87]

Core Inference Methods

Point estimation

Point estimation involves deriving a single value, known as a point estimate, to approximate an unknown population parameter based on sample data. An estimator is a statistical function or rule that maps a random sample to a point estimate of the parameter; for instance, the sample mean \bar{X} is an estimator of the population mean \mu.^[44] The resulting numerical value from applying the estimator to observed data constitutes the point estimate.^[44] A key property of an estimator \hat{\theta} for a parameter \theta is its bias, defined as \text{Bias}(\hat{\theta}) = E[\hat{\theta} - \theta], which measures the expected deviation of the estimator from the true parameter value.^[44] An unbiased estimator satisfies E[\hat{\theta}] = \theta, implying zero bias. The mean squared error (MSE) provides a comprehensive measure of estimator performance, given by

\text{MSE}(\hat{\theta}) = \text{Var}(\hat{\theta}) + [\text{Bias}(\hat{\theta})]^2,

where \text{Var}(\hat{\theta}) captures the variability of the estimator around its expectation.^[44] This decomposition highlights the trade-off between bias and variance in evaluating estimator quality. Desirable properties of point estimators include consistency and sufficiency. An estimator \hat{\theta}_n, based on a sample of size n, is consistent if \hat{\theta}_n \to_p \theta in probability as n \to \infty, ensuring convergence to the true parameter in large samples.^[86] Sufficiency refers to a statistic T(X) that captures all information about \theta from the sample X; the Rao-Blackwell theorem states that conditioning an unbiased estimator on a sufficient statistic yields another unbiased estimator with variance less than or equal to the original, often improving efficiency.^[90] In the frequentist paradigm, common methods for point estimation include the method of moments and maximum likelihood estimation. The method of moments, introduced by Karl Pearson, equates sample moments to their population counterparts and solves for the parameters; for example, setting the sample mean equal to the expected value E[X; \theta] yields moment-based estimates.^[92] Maximum likelihood estimation, developed by R.A. Fisher, selects the parameter value \hat{\theta} that maximizes the likelihood function L(\theta | x) = f(x | \theta), and under standard regularity conditions, the maximum likelihood estimator is asymptotically unbiased and consistent as sample size increases.^[86] In the Bayesian paradigm, point estimates are derived from the posterior distribution \pi(\theta | x), which incorporates prior beliefs \pi(\theta) and observed data via Bayes' theorem. The posterior mean E[\theta | x] serves as a point estimate under squared error loss, minimizing the expected posterior loss, while the posterior mode maximizes the posterior density.^[44] A classic example is estimating the population mean \mu from a random sample X_1, \dots, X_n. The sample mean \bar{X} = \frac{1}{n} \sum_{i=1}^n X_i is an unbiased estimator of \mu for any distribution, with E[\bar{X}] = \mu and \text{Var}(\bar{X}) = \sigma^2 / n. Under normality assumptions, it is also efficient, achieving the lowest variance among unbiased estimators as per the Gauss-Markov theorem for linear models or the Cramér-Rao lower bound.^[44]

Interval estimation and confidence regions

Interval estimation provides a range of plausible values for an unknown parameter, extending point estimation by incorporating measures of uncertainty. In the frequentist paradigm, this is achieved through confidence intervals, which are constructed such that the probability that the interval contains the true parameter value is 1-α over repeated sampling from the population. Jerzy Neyman formalized this concept in 1937, defining a (1-α) confidence interval [L, U] for a parameter θ as satisfying P(θ ∈ [L, U]) = 1-α, where the probability is taken over the sampling distribution before observing the data.^[93] A classic example is the confidence interval for the mean of a normal distribution with unknown variance, known as the t-interval. For a sample of size n with mean \bar{x} and standard deviation s, the (1-α) interval is given by

\bar{x} \pm t_{n-1,1-\alpha/2} \frac{s}{\sqrt{n}},

where t_{n-1,1-α/2} is the (1-α/2) quantile of the Student's t-distribution with n-1 degrees of freedom. This interval arises from the pivotal quantity \sqrt{n}(\bar{x} - \mu)/s following a t-distribution, as derived by William Sealy Gosset in 1908 under the pseudonym "Student."^[94] The method relies on the assumption of normality or large sample sizes via the central limit theorem. In the Bayesian paradigm, interval estimation uses credible intervals derived from the posterior distribution of the parameter given the data. A (1-α) credible interval is an interval [C_L, C_U] such that the posterior probability P(θ ∈ [C_L, C_U] | data) = 1-α. Common types include the equal-tail credible interval, formed by the α/2 and 1-α/2 quantiles of the posterior, and the highest posterior density (HPD) interval, which contains the 1-α mass with the highest density and may be unequal-tailed. These were systematized in Harold Jeffreys' 1939 theory of probability, emphasizing objective priors for posterior inference. Unlike frequentist intervals, credible intervals directly quantify uncertainty conditional on the observed data. One method to construct confidence intervals, particularly for complex statistics, is the bootstrap, introduced by Bradley Efron in 1979. The percentile bootstrap interval resamples the data B times (typically B ≥ 1000) to generate bootstrap replicates \hat{θ}^*_b of the estimator \hat{θ}, sorts them, and takes the α/2 and 1-α/2 quantiles as the interval endpoints. This approximates the sampling distribution nonparametrically without strong parametric assumptions. For improved accuracy, the bias-corrected accelerated (BCa) method adjusts for bias and skewness, as refined by DiCiccio and Efron in 1992. Another approach is inversion of tests, where a confidence interval consists of all parameter values not rejected by a level-α test, ensuring exact coverage under the test's validity. Confidence intervals can also be derived from likelihood profiles or asymptotic normality of maximum likelihood estimators. For multidimensional parameters, such as a vector θ ∈ ℝ^p, interval estimation generalizes to confidence regions, which are sets in parameter space with coverage probability 1-α. These are often ellipsoids defined by quadratic forms, like {θ : n(\hat{θ} - θ)^T I(\hat{θ}) ( \hat{θ} - θ ) ≤ χ^2_{p,1-α} }, where I(\hat{θ}) is the observed information matrix and χ^2_{p,1-α} is the chi-squared quantile. Scheffé's method (1953) constructs conservative simultaneous regions for all linear contrasts in analysis of variance settings, useful for broad parameter spaces. A common pitfall in interpreting frequentist confidence intervals is treating them as posterior probability statements, such as claiming P(θ ∈ [L, U] | data) = 1-α, which conflates long-run frequency coverage with data-specific probability. Surveys show this misinterpretation is widespread among researchers, leading to overconfidence in specific intervals.^[95] In contrast, Bayesian credible intervals avoid this issue but require prior specification, potentially introducing subjectivity. Both approaches complement point estimates by quantifying precision, aiding decisions under uncertainty.

Hypothesis testing

Hypothesis testing is a core procedure in statistical inference for deciding between two competing hypotheses about a population parameter based on sample data. The framework typically involves formulating a null hypothesis H_0, which represents a default or status quo assumption (often no effect or no difference), and an alternative hypothesis H_a, which posits the presence of an effect or difference. A test statistic T is computed from the data, and the p-value is defined as the probability of observing a test statistic at least as extreme as the one obtained, assuming H_0 is true: p = P(T \geq t_{obs} \mid H_0).^[96] Decisions are made by comparing the p-value to a pre-specified significance level \alpha, typically 0.05, where rejection of H_0 occurs if p \leq \alpha.^[96] In the frequentist paradigm, hypothesis testing emphasizes controlling error rates under repeated sampling. The Neyman-Pearson lemma provides the theoretical foundation for constructing the most powerful test for simple hypotheses, stating that the likelihood ratio test, \Lambda = L(H_0)/L(H_a), rejects H_0 when \Lambda is small, maximizing power at a fixed type I error rate \alpha = P(reject H_0 \mid H_0 true).^[97] Type II error is the probability of failing to reject H_0 when H_a is true, denoted \beta, and the power of the test is $1 - \beta = P(reject H_0 \mid H_a true).^[97] This approach prioritizes long-run frequency properties, ensuring the proportion of false positives does not exceed \alpha over many tests.^[97] Bayesian hypothesis testing evaluates evidence by updating prior beliefs with data to compute posterior probabilities. The Bayes factor BF quantifies the relative support for H_0 versus H_a as BF = P(data | H_0)/P(data | H_a), where values greater than 1 favor H_0 and less than 1 favor H_a.^[98] Posterior odds are then obtained by multiplying the Bayes factor by the prior odds, P(H_0)/P(H_a), allowing direct probabilistic statements about hypotheses.^[98] This method avoids fixed error rates, instead providing a continuous measure of evidence strength.^[98] When multiple hypotheses are tested simultaneously, the risk of false positives increases, necessitating corrections. The Bonferroni correction adjusts the significance level to \alpha/k for k tests, controlling the family-wise error rate (FWER) at \alpha.^[99] The false discovery rate (FDR) approach, which controls the expected proportion of false positives among rejected hypotheses, uses the Benjamini-Hochberg procedure: rank p-values ascendingly, find the largest i such that p_{(i)} \leq (i/k) \alpha, and reject all H_{0j} for j \leq i.^[100] This method offers greater power than conservative FWER controls while managing multiplicity in large-scale testing.^[100] Common examples illustrate these concepts. The chi-squared test for independence assesses whether categorical variables are associated by comparing observed and expected frequencies under H_0: \chi^2 = \sum (O_i - E_i)^2 / E_i, which follows a chi-squared distribution under the null for large samples. Non-inferiority tests, often used in clinical trials, evaluate if a new treatment is not worse than a standard by at least a margin \delta, with H_0: \mu_{new} - \mu_{std} \leq -\delta and H_a: \mu_{new} - \mu_{std} > -\delta, rejecting H_0 to conclude non-inferiority.^[18] Randomization tests can also be applied here by permuting data under H_0 to generate the null distribution empirically.^[96]

Advanced Inference Topics

Predictive inference

Predictive inference focuses on drawing conclusions about future or unobserved data points, rather than estimating model parameters, by deriving the predictive distribution p(y_{\text{new}} | \data), which marginalizes over uncertainty in the parameters given observed data \data. This contrasts with parameter estimation, as predictive inference prioritizes the distribution of potential outcomes for new observations y_{\text{new}}, enabling assessments of model predictiveness without direct focus on underlying parameters.^[101] In the frequentist paradigm, predictive inference often employs prediction intervals, which provide a range likely to contain a future observation with a specified probability, such as 95%. For linear regression models, these intervals are wider than confidence intervals for the mean response because they account for both the uncertainty in the estimated regression coefficients and the inherent variability of a new response due to additional error terms. For instance, the prediction interval formula incorporates an extra variance component from the residual error, ensuring coverage for individual future points rather than just the expected value.^[102] Bayesian predictive inference centers on the posterior predictive distribution, defined as p(y_{\text{new}} | \data) = \int p(y_{\text{new}} | \theta) p(\theta | \data) \, d\theta, which integrates the likelihood of new data over the posterior distribution of parameters \theta. In conjugate cases, such as a normal likelihood with unknown mean and known variance paired with a normal prior, the posterior predictive distribution follows a normal distribution, reflecting compounded uncertainty from both prior beliefs and data. This approach naturally quantifies predictive uncertainty by simulating or analytically deriving distributions for unobserved data.^[103] Key methods for predictive inference include cross-validation, which assesses predictive accuracy by partitioning data into training and validation sets to estimate out-of-sample performance, such as mean squared error, without assuming specific distributional forms. Conformal prediction offers distribution-free guarantees, constructing prediction sets that contain the true future observation with at least a user-specified probability (e.g., 90%) across any data-generating distribution, relying on exchangeability rather than parametric assumptions. These techniques evaluate models based on their ability to generalize predictions.^[104]^[105] Applications of predictive inference span forecasting in time series, where posterior predictive simulations generate plausible future scenarios, and Monte Carlo simulations for risk assessment in finance or epidemiology. Model predictiveness is often quantified using the expected log predictive density (ELPD), \mathbb{E}[\log p(y_{\text{new}} | \data)], which measures average log-likelihood of held-out data and favors models with strong out-of-sample performance while penalizing overfitting.^[106]

Decision-theoretic frameworks

Decision-theoretic frameworks in statistical inference extend classical paradigms by incorporating actions and their consequences, framing inference as a basis for optimal decision-making under uncertainty. These frameworks evaluate statistical procedures not solely by their probabilistic properties but by their performance in terms of risk, defined via loss functions that quantify the cost of errors in actions. This approach unifies estimation, testing, and prediction under a common criterion, allowing for the comparison of rules across different inferential paradigms.^[107] The foundations of decision theory in statistics were laid by Abraham Wald, who formalized the decision problem as consisting of a parameter space Θ representing possible states of nature, an action space A for possible decisions, and a loss function L(a, θ) measuring the penalty for taking action a when the true state is θ. A decision rule d maps observed data X to actions a = d(X), and its risk function is given by R(θ, d) = E[L(d(X), θ) | θ], the expected loss under the true parameter θ. The goal is to select a rule d that minimizes risk in some sense, either pointwise or globally, providing a rigorous basis for evaluating inferential procedures beyond mere probability statements.^[108] In the Bayesian paradigm, decisions are optimized by minimizing the Bayes risk, which is the expected posterior loss r(π, d) = ∫ R(θ, d) π(θ) dθ, where π is a prior distribution over Θ. For a given posterior distribution π(θ | X), the optimal Bayes rule δ^π minimizes the posterior expected loss E[L(a, θ) | X] over a ∈ A. For instance, under quadratic loss L(a, θ) = (a - θ)^2, the Bayes rule is the posterior mean E[θ | X]; under absolute error loss L(a, θ) = |a - θ|, it is the posterior median. This approach integrates prior beliefs and data to yield actions with minimal average risk relative to the prior.^[107] Frequentist decision theory, in contrast, seeks rules with desirable frequentist risk properties, without relying on priors. A decision rule d is admissible if no other rule d' has R(θ, d') ≤ R(θ, d) for all θ, with strict inequality for some θ; inadmissible rules can be dominated and are typically discarded. Minimax rules minimize the maximum risk sup_θ R(θ, d), providing robustness against worst-case scenarios; for example, in estimating a normal mean under quadratic loss, the sample mean is minimax. These criteria ensure performance guarantees across the parameter space, linking to admissibility concepts in frequentist inference.^[108] Examples illustrate how decision theory reframes core inference tasks. Hypothesis testing can be viewed as a decision problem with actions "reject H_0" or "accept H_0" and 0-1 loss L(a, θ) = 0 if a matches the true state (H_0 or H_1) and 1 otherwise, where risk corresponds to error probabilities. For estimation under absolute error loss, the posterior median minimizes Bayes risk, offering a robust alternative to the mean in skewed distributions.^[107] A striking insight from decision theory is Stein's paradox, which reveals that in high dimensions, the maximum likelihood estimator (MLE) for multiple normal means is inadmissible under quadratic loss. The James-Stein estimator, which shrinks the MLE toward a grand mean, dominates the MLE by achieving lower risk for all θ, with the improvement most pronounced when dimensions p ≥ 3. Specifically, for estimating θ = (θ_1, ..., θ_p) from X ~ N(θ, I_p), the James-Stein rule is \hat{θ}^{JS} = \left(1 - \frac{(p-2)}{|X|^2}\right) X, yielding total risk less than p (the MLE risk) everywhere. This paradox highlights the benefits of incorporating inter-parameter dependencies, challenging the admissibility of componentwise procedures in multivariate settings.^[109]

Computational inference techniques

Computational inference techniques encompass a suite of simulation-based and optimization-driven methods that enable statistical inference in models where exact computations are infeasible, such as those involving high-dimensional parameters or complex likelihoods. These approaches approximate key quantities like posterior distributions, expectations, and variability measures by leveraging computational power to generate samples or optimize proxies, addressing the limitations of analytical methods in modern data-rich environments. They are particularly vital in Bayesian settings for posterior computation but also apply more broadly to frequentist and likelihood-based paradigms. Monte Carlo (MC) methods form the cornerstone of these techniques, using random sampling to approximate integrals central to inference, such as expectations under a target distribution \pi(\theta). In basic MC integration, the expectation \mathbb{E}_{\pi}[f(\theta)] = \int f(\theta) \pi(\theta) \, d\theta is estimated by \frac{1}{N} \sum_{i=1}^N f(\theta_i), where \{\theta_i\} are independent draws from \pi. This approach, pioneered in the context of statistical simulations, provides unbiased estimates whose variance decreases as O(1/N), making it reliable for low-dimensional problems but inefficient for rare events or high dimensions.^[110] Importance sampling refines MC by drawing from an easier-to-sample proposal distribution q(\theta) and reweighting observations with w_i = \pi(\theta_i)/q(\theta_i) to compute weighted averages, yielding \mathbb{E}_{\pi}[f(\theta)] \approx \sum_{i=1}^N w_i f(\theta_i) / \sum_{i=1}^N w_i. This method is crucial for estimating expectations in intractable distributions, though it suffers from high variance if q poorly overlaps with \pi. Markov chain Monte Carlo (MCMC) methods extend MC by generating dependent samples from \pi via Markov chains that converge to the target distribution, enabling exploration of complex spaces without direct sampling. The Metropolis-Hastings (MH) algorithm, a seminal MCMC procedure, starts from a current state \theta^{(t)} and proposes \theta^{(t+1)} \sim q(\cdot | \theta^{(t)}), accepting the proposal with probability \alpha = \min\left(1, \frac{\pi(\theta^{(t+1)}) q(\theta^{(t)} | \theta^{(t+1)})}{\pi(\theta^{(t)}) q(\theta^{(t+1)} | \theta^{(t)})}\right) and otherwise retaining \theta^{(t)}; the resulting chain has \pi as its stationary distribution under mild conditions like irreducibility. Gibbs sampling, a special case of MH, simplifies proposals by iteratively sampling each component \theta_j from its full conditional \pi(\theta_j | \theta_{-j}), which is often easier to evaluate in multivariate models and avoids tuning the acceptance ratio. This method excels in block-structured models, such as hierarchical ones, by ensuring high acceptance rates through exact conditional draws. Variational inference (VI) shifts from sampling to optimization, approximating the intractable posterior \pi(\theta | y) with a tractable distribution q(\theta) from a variational family, typically by maximizing the evidence lower bound (ELBO): \mathcal{L}(q) = \mathbb{E}_q[\log \pi(\theta, y)] - \mathbb{E}_q[\log q(\theta)] \leq \log \pi(y). In mean-field VI, q assumes independence across dimensions, q(\theta) = \prod_j q_j(\theta_j), turning the problem into coordinate ascent on the ELBO, which balances model fit and entropy to yield a fast, scalable approximation. This optimization-based paradigm contrasts with MCMC's simulation focus, offering deterministic convergence but potentially underestimating posterior variance.^[111] Beyond these, resampling and simulation-based methods address specific inferential challenges. The bootstrap technique estimates the sampling distribution of a statistic \hat{\theta} by repeatedly drawing B resamples with replacement from the observed data and recomputing \hat{\theta}_b^* for each, yielding empirical approximations for bias, variance, and confidence intervals, such as percentile intervals from the \hat{\theta}_b^* quantiles. This nonparametric approach is distribution-free and particularly effective for complex estimators, with consistency under mild smoothness assumptions.^[112] Approximate Bayesian computation (ABC) facilitates inference when the likelihood is unavailable but simulations are feasible, by generating parameters \theta' from the prior, simulating data y' \sim p(y | \theta'), and accepting \theta' if summary statistics s(y') are sufficiently close to observed s(y) under a distance metric, approximating the posterior via accepted samples. ABC is invaluable for stochastic models in fields like population genetics, with rejection sampling as its basic form. These techniques underpin applications in high-dimensional Bayesian models, where MCMC and VI enable posterior exploration in scenarios like sparse regression with thousands of predictors, as in genomic variable selection, by incorporating priors that induce sparsity and scaling via parallel chains or stochastic gradients. For big data scalability, variants such as mini-batch VI and distributed MCMC reduce per-iteration costs from O(n) to O(m) where m \ll n is a subsample size, allowing inference on datasets exceeding memory limits while preserving asymptotic validity through bias corrections or aggregation schemes.

Contemporary Extensions

Robust and nonparametric inference

Robust statistical inference focuses on methods that maintain reliable performance even when underlying assumptions, such as normality or independence, are violated due to outliers or model misspecification. A key measure of robustness is the breakdown point, defined as the smallest fraction of contaminated data that can cause an estimator to produce arbitrarily large values; for instance, the sample median has a breakdown point of 50%, far superior to the sample mean's 0% breakdown point, making the median more resilient to outliers. This concept was formalized by Hampel, who emphasized its role in assessing global reliability against adversarial contamination.^[113]^[114] M-estimators form a cornerstone of robust estimation, minimizing an objective function of the form \sum \rho(r_i / s), where r_i are residuals, s is a scale estimate, and \rho is a bounded, redescending loss function that downweights outliers. Huber's seminal work introduced these estimators, with the Huber loss function \rho(u) = \frac{1}{2}u^2 for |u| \leq c and \rho(u) = c(|u| - \frac{1}{2}c) otherwise, balancing efficiency under normality (about 95% of the maximum likelihood estimator) and robustness via the tuning constant c.^[114] These estimators achieve high breakdown points when combined with appropriate scale estimation, outperforming least squares in contaminated settings. Nonparametric inference avoids strong distributional assumptions, relying instead on data-driven approaches for estimation and testing. Kernel estimators, such as the Nadaraya-Watson regression estimator \hat{y}(x) = \frac{\sum K((x - x_i)/h) y_i}{\sum K((x - x_i)/h)}, where K is a kernel function and h is the bandwidth, provide smooth, distribution-free approximations to conditional expectations by locally weighting observations. Rank-based tests, like the Wilcoxon signed-rank test, assess location shifts by ranking the absolute differences from the hypothesized median and summing ranks for positive differences, offering robustness to non-normality with efficiency near 95% of the t-test under symmetric distributions.^[115] Semiparametric methods bridge parametric efficiency and nonparametric flexibility by specifying only partial structure, such as covariate effects while leaving the baseline unspecified. The Cox proportional hazards model exemplifies this, estimating hazard ratios \exp(\beta^T x) via partial likelihood without assuming a baseline hazard form, achieving root-n consistency and asymptotic normality under mild conditions. Practical examples illustrate these approaches: the bootstrap resamples data with replacement to estimate variance or confidence intervals distribution-freely, as introduced by Efron, providing robust approximations even for complex statistics where analytic forms are unavailable.^[112] The sign test for location counts positive differences from the median, yielding a binomial test robust to arbitrary distributions with a 50% breakdown point.^[116] Robust and nonparametric methods trade efficiency for validity; under ideal conditions, they may achieve only 60-95% of parametric efficiency, but in contaminated data, they preserve validity where parametric methods fail, as quantified by influence functions and gross-error sensitivities. This compromise ensures broader applicability in real-world scenarios with uncertain assumptions. Recent extensions as of 2025 include the Difference-in-Differences Bayesian Causal Forest (DiD-BCF), a nonparametric model that robustly estimates heterogeneous treatment effects in staggered adoption settings under parallel trends assumptions.^[117]^[114]

Causal inference integration

Causal inference extends statistical inference by addressing questions of cause and effect, rather than mere correlations, through frameworks that formalize counterfactual reasoning. The potential outcomes model, foundational to this integration, defines the causal effect of a treatment for a unit as the difference between its outcome under treatment, Y(1), and under [control, Y](/page/Control-Y)(0), though only one is observed. This framework, originally developed by Neyman for randomized experiments, was generalized by Rubin to observational settings under assumptions like stable unit treatment value assumption (SUTVA) and unconfoundedness (ignorability), enabling estimation of population-level effects. A key estimand is the average treatment effect (ATE), defined as the expected difference \text{ATE} = E[Y(1) - Y(0)], representing the mean causal impact across the population. In randomized experiments, the ATE is directly estimable as the difference in sample means, serving as the gold standard due to randomization ensuring exchangeability. For observational data, methods like propensity score weighting address confounding; the propensity score is the probability of treatment given covariates, and inverse probability weighting (IPW) estimates the ATE via weighted averages of observed outcomes, balancing treated and control groups. Propensity scores also support matching, pairing units with similar scores to mimic randomization. Identification of causal effects relies on graphical models such as directed acyclic graphs (DAGs) to map confounders and interventions, with Pearl's do-calculus providing rules to express interventional distributions from observational data, such as replacing joint probabilities with post-intervention terms via the do-operator. For cases with unmeasured confounding, instrumental variables (IV) offer identification; an instrument affects the outcome only through the treatment, and the two-stage least squares (2SLS) estimator recovers local average treatment effects (LATE) for compliers—those whose treatment status changes with the instrument. Challenges in causal inference stem from the unconfoundedness assumption, which posits no unobserved confounders, often violated in observational studies. Sensitivity analysis quantifies robustness to this violation; Rosenbaum's bounds assess how much confounding would be needed to overturn conclusions, using odds ratios of differential assignment to treatment. For inference on causal estimates, standard errors account for design-based or model-based variance, as in randomized settings. Heterogeneity is captured by the conditional average treatment effect (CATE), \text{CATE}(x) = E[Y(1) - Y(0) \mid X = x], varying effects across covariates, estimated via methods like regression trees under unconfoundedness. Randomization-based approaches from the potential outcomes framework extend naturally to causal estimands in experiments. As of October 2025, recent advances in causal machine learning have further integrated these methods, including meta-learners and double machine learning for precise CATE estimation, as well as causal forests for personalized decision-making in static and dynamic settings.^[118]

Machine learning intersections

Statistical inference plays a pivotal role in machine learning by providing tools for uncertainty quantification in model predictions, enabling more reliable decision-making beyond point estimates. In Gaussian processes (GPs), a nonparametric Bayesian approach, predictions consist of a posterior mean for the expected output and a posterior variance that captures epistemic and aleatoric uncertainty, allowing practitioners to assess prediction confidence in regression tasks. This dual output facilitates applications in fields like robotics and climate modeling, where quantifying uncertainty is essential for risk assessment. GPs achieve this through kernel-based covariance modeling, where the posterior distribution over functions is derived from observed data, ensuring that uncertainty decreases with more evidence. Statistical foundations of inference address key challenges in machine learning, such as overfitting, through criteria like the Akaike Information Criterion (AIC) and Bayesian Information Criterion (BIC). The AIC balances model fit and complexity via the formula

\text{AIC} = -2 \log L + 2k,

where L is the maximized likelihood and k is the number of parameters, penalizing overly complex models to favor those with better out-of-sample performance. Similarly, the BIC imposes a stronger penalty, \text{BIC} = -2 \log L + k \log n, where n is the sample size, making it consistent for model selection under certain conditions. Cross-validation serves as a resampling-based inference method to estimate predictive error, partitioning data into training and validation sets iteratively to mimic unseen data performance and mitigate overfitting in empirical risk minimization.^[119] Hybrid methods integrate classical inference with machine learning to enable valid statistical guarantees after model training or selection. For instance, the de-biased lasso corrects for the bias introduced by regularization in high-dimensional sparse regression, yielding an estimator \hat{\beta} such that \sqrt{n} (\hat{\beta} - \beta) \overset{d}{\to} N(0, \Sigma), where \Sigma is the asymptotic covariance, allowing construction of confidence intervals for selected coefficients. Conformal prediction provides distribution-free prediction sets for arbitrary machine learning models, ensuring that the coverage probability matches a user-specified level (e.g., 90%) with finite-sample guarantees, by leveraging nonconformity scores from calibration data.^[120] These techniques bridge the gap between predictive accuracy and inferential validity, particularly in black-box models like random forests or neural networks. Despite these advances, challenges persist in applying inference to machine learning, especially in high-dimensional settings where the number of features p greatly exceeds the sample size n (p \gg n). Traditional asymptotic assumptions fail, necessitating specialized methods like desparsified estimators to achieve honest uncertainty estimates amid sparsity and collinearity.^[121] Reproducibility in automated pipelines further complicates inference, as nondeterministic elements like random seeds, hyperparameter tuning, and data preprocessing can lead to inconsistent results across runs, undermining the reliability of p-values and confidence intervals.^[122] Prominent examples illustrate these intersections. Bayesian neural networks treat weights as random variables with priors, approximating the posterior via Markov chain Monte Carlo or variational methods to yield predictive distributions that incorporate parameter uncertainty, enhancing robustness over frequentist counterparts.^[123] Selective inference frameworks enable valid post-hoc hypothesis tests after variable selection, conditioning on the selection event to control the type I error rate, as in lasso-based procedures where truncated Gaussian distributions characterize test statistics for selected features. Recent work as of 2025 has advanced trustworthy scientific inference by leveraging machine learning models, such as regression and generative approaches, to construct confidence sets with improved guarantees.^[124] These approaches underscore how inference principles fortify machine learning against overconfidence and selection bias.

References

[1]
Statistical Inference and Estimation | STAT 504
It has mathematical formulations that describe relationships between random variables and parameters. · It makes assumptions about the random variables, and ...
[2]
[PDF] Statistical Inference - Kosuke Imai
What is Statistical Inference? READING: FPP Chapter 19. Guessing what you do not observe from what you do observe. Start with the probability model with ...
[3]
Statistical inference through estimation: Recommendations from the ...
Statistical inference is the process of making inferences about populations using data from samples. Imagine, for example, that some researchers want to ...
[4]
Statistical inference: Hypothesis testing | Allergologia et ... - Elsevier
The aim of statistical inference is to predict the parameters of a population, based on a sample of data. Inferential statistics encompasses the estimation ...<|control11|><|separator|>
[5]
Full article: Statistical Inference Enables Bad Science
Statistical inferences are claims made using probability models of data generating processes, intended to characterize unknown features of the population(s) or ...
[6]
[PDF] 9. SAMPLING AND STATISTICAL INFERENCE - NYU Stern
Statistical Inference: A body of techniques which use probability theory to help us to draw conclusions about a population on the basis of a random sample. Our ...
[7]
Inferential Reasoning in Data Analysis - 1 What this class is about
Statistical inferences are rarely deductive. Inductive reasoning: justifying a claim on the grounds that it is consistent with all observations. For instance, ...
[8]
Foundations of Inference - Statistics & Data Science
Statistical inference uses mathematics to draw conclusions in the presence of uncertainty. This generalizes deterministic reasoning, with the absence of ...
[9]
Statistical Inference - SpringerLink
Mar 2, 2023 · The objective of inferential statistics is to make inferences –with some degree of confidence– about a population based on available sample ...
[10]
1.4 - Random Sampling | STAT 462
Recall that the population is the entire collection of objects under consideration, while the sample is a (random) subset of the population. We are particularly ...
[11]
Sampling in Statistical Inference - Yale Statistics and Data Science
Sampling in Statistical Inference. The use of randomization in sampling allows for the analysis of results using the methods of statistical inference.
[12]
statistical inference, n. meanings, etymology and more
The earliest known use of the noun statistical inference is in the 1840s. OED's earliest evidence for statistical inference is from 1843, in J. G. Kohl's ...
[13]
A brief history (Appendix A) - Principles of Statistical Inference
Laplace (1749–1827) made extensive use of flat priors and what was then called the method of inverse probability, now usually called Bayesian methods. Gauss ( ...
[14]
Statistical Inference: The Big Picture - PMC - PubMed Central
The "big picture" of statistical inference shows a link between data and models, emphasizing the connection between data and its description using statistical ...
[15]
Statistical Inference: The Big Picture - Project Euclid
Abstract. Statistics has moved beyond the frequentist-Bayesian controver- sies of the past. Where does this leave our ability to interpret results?
[16]
1.1 - What is the role of statistics in clinical research? | STAT 509
The use of statistics allows clinical researchers to draw reasonable and accurate inferences from collected information and to make sound decisions in the ...
[17]
Guidance for the Use of Bayesian Statistics in Medical Device Clinical
Jun 28, 2018 · This document provides guidance on statistical aspects of the design and analysis of clinical trials for medical devices that use Bayesian statistical methods.
[18]
[PDF] Econometric Methods for Program Evaluation - MIT Economics
Multiple modes of statistical inference are available for treatment effects (see Rubin 1990), and our discussion mainly focuses on two of them: (a) sampling- ...
[19]
[PDF] Basic Concepts of Statistical Quality Control - Purdue e-Pubs
In the example that we have mentioned, statistical quality control would be concerned with sampling techniques, measurement procedures, and with converting the.
[20]
Chapter 6.1: Statistical Analysis and Inference – Introduction to Data ...
Statistical inference provides the methodological framework for drawing conclusions that extend beyond available data while quantifying the uncertainty inherent ...
[21]
The Role of Expert Judgment in Statistical Inference and Evidence ...
Elicitation of expert judgments to produce probability distributions that represent uncertainty about model parameters can be conducted informally, but such ...
[22]
[PDF] Bayesian Inference for Social Policy Research
Bayesian statistical inference represents a useful and increasingly common tool for creating and updating knowledge relevant to social policy research.
[23]
[PDF] Credible Causal Inference for Empirical Legal Studies - Daniel E. Ho
Dec 1, 2017 · Abstract. We review advances toward credible causal inference that have wide application for empirical legal studies.
[24]
The Extent and Consequences of P-Hacking in Science - PMC - NIH
Mar 13, 2015 · One type of bias, known as “p-hacking,” occurs when researchers collect or select data or statistical analyses until nonsignificant results become significant.
[25]
An Overview of Scientific Reproducibility: Consideration of Relevant ...
This article examines reproducibility, definitions, concerns, factors for failures, validity, and threats, and suggests ways to improve scientific practices.
[26]
2 Overview and Case Studies - The National Academies Press
The main goal of the workshop is to address statistical challenges in assessing and fostering the reproducibility of scientific results.
[27]
July 1654: Pascal's Letters to Fermat on the "Problem of Points"
Jul 1, 2009 · In the mid-17th century, an exchange of letters between two prominent mathematicians–Blaise Pascal and Pierre de Fermat–laid the foundation for ...
[28]
[PDF] Pascal and the Invention of Probability Theory - Mathematics
However, Pascal's letters on probability to Pierre de Fermat (1601-1665), the learned jurist in Toulouse, throw light on the subject. In reply to an earlier.
[29]
Mathematical Demography: A Bibliographical Essay - jstor
Graunt, John. 1662 (republished 1964). Natural and political observations mentioned in a following index, and made upon the bills of mortality, with ...
[30]
[PDF] Epidemiology is … - Assets - Cambridge University Press
in 1662 (Graunt, 1662). Graunt studied parish registers of christenings and the 'Bills of Mortality', and noted many features of birth and death data ...
[31]
LII. An essay towards solving a problem in the doctrine of chances ...
An essay towards solving a problem in the doctrine of chances. By the late Rev. Mr. Bayes, FRS communicated by Mr. Price, in a letter to John Canton, AMFR S.
[32]
[PDF] LII. An Essay towards solving a Problem in the Doctrine of Chances ...
Mr. Bayes has thought fit to begin his work with a brief demonstration of the general laws of chance. His reason for doing this, as he says ...
[33]
Laplace's 1774 Memoir on Inverse Probability - jstor
Abstract. Laplace's first major article on mathematical statistics was pub- lished in 1774. It is arguably the most influential article in this field to.
[34]
Gauss and the Invention of Least Squares - jstor
The most famous priority dispute in the history of statistics is that between Gauss and Legendre, over the discovery of the method of least squares.
[35]
Science on the Farther Shore | American Scientist
Both Gauss and Legendre introduced the method of least squares in works on astronomy. Legendre was first to publish; he presented the technique (and also coined ...
[36]
"Co-relations and their Measurement" by Francis Galton
Co-relations and their Measurement, chiefly from Anthropometric Data. By FRANCIS GALTON, F.R.S.. Received December 5, 1888.
[37]
Galton on Examinations - The University of Chicago Press: Journals
Francis Galton (1822-1911) introduced the modern statistical technique of corre- lation in his 1888 paper "Co-relations and Their Measurement," a work ...
[38]
Guinnessometrics: The Economic Foundation of "Student's" t
“Student” is the pseudonym used in 19 of 21 published articles by William Sealy. Gosset, who was a chemist, brewer, inventor, and self-trained statistician, ...
[39]
The strange origins of the Student's t-test - The Physiological Society
However, the t distribution allowed Gosset to proceed with his work for Guiness, and he was promoted to head experimental brewer and head of statistics, and ...
[40]
Philosophy of Statistics
Aug 19, 2014 · The philosophy of statistics concerns the foundations and the proper interpretation of statistical methods, their input, and their results.Missing: shift | Show results with:shift
[41]
[PDF] Probability and Statistics: The Science of Uncertainty
2 Random Variables and Distributions. 33. 2.1 Random Variables . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34. 2.2 Distributions of Random ...
[42]
[PDF] Regular Parametric Models and Likelihood Based Inference
Dec 6, 2006 · A parametric model is a family of probability distributions P, such that there exists some. (open) subset of a finite dimensional Euclidean ...
[43]
[PDF] Statistical Inference
the basics of probability, we develop the theory of statistical inference using tech- niques, definitions, and concepts that are statistical and are natural ...
[44]
[PDF] Lecture Notes on Nonparametrics
Non-parametric methods are infinite-dimensional, distinguish between true and fitted models, and make model complexity depend on the sample.
[45]
[PDF] Parametric and Nonparametric: Demystifying the Terms
Parametric statistical procedures rely on assumptions about the shape of the distribution. (i.e., assume a normal distribution) in the underlying population and ...
[46]
[PDF] 24 Classical Nonparametrics - Purdue Department of Statistics
Nonparametric procedures provide a certain amount of robustness to de- parture from a narrow parametric model, at the cost of a suboptimal performance at the ...
[47]
[PDF] Basics of Statistical Machine Learning 1 Parametric vs ... - cs.wisc.edu
A parametric model is one that can be parametrized by a finite number of parameters. We write the. PDF f(x) = f(x; θ) to emphasize the parameter θ ∈ Rd.
[48]
Violating the normality assumption may be the lesser of two evils
Violating this assumption may result in more notable increases of type I errors (compared to what we examined here) at least when the violations are drastic.
[49]
Should I Always Transform My Variables to Make Them Normal?
Sep 14, 2015 · In short, if the normality assumption of the errors is not met, we cannot draw a valid conclusion based on statistical inference in linear ...<|control11|><|separator|>
[50]
Assumption-checking rather than (just) testing: The importance ... - NIH
Motivation for this paper. As discussed above, checking assumptions is crucial to ensuring the validity of statistical analyses.
[51]
Testing the assumptions of linear regression - Duke People
There are four principal assumptions which justify the use of linear regression models for purposes of inference or prediction.
[52]
Understanding QQ Plots - UVA Library - The University of Virginia
The QQ plot, or quantile-quantile plot, is a graphical tool to help us assess if a set of data plausibly came from some theoretical distribution.Missing: goodness- | Show results with:goodness-
[53]
4.6 - Normal Probability Plot of Residuals | STAT 462
The normal probability plot of the residuals is approximately linear supporting the condition that the error terms are normally distributed. qq plot. Normal ...Missing: goodness- | Show results with:goodness-
[54]
https://online.stat.psu.edu/stat462/node/122/
[55]
11.2 - Goodness of Fit Test - STAT ONLINE
Degrees of freedom for a chi-square goodness-of-fit test are equal to the number of groups minus 1. The distribution plot below compares the chi-square ...Missing: model | Show results with:model
[56]
[PDF] A short note on Inference and Asymptotic Normality 1 Introduction
In this case, the central limit theorem implies that. √. nLn(θ?) converges in distribution to a Gaussian. Even more the law of the iterated logarithm gives ...
[57]
[PDF] Misspecification, estimands, and over-identification - MIT Economics
Aug 23, 2025 · Abstract. In over-identified models, misspecification—the norm rather than ex- ception—fundamentally changes what estimators estimate.
[58]
[PDF] Sensitivity Analysis in Semiparametric Likelihood Models
Nov 13, 2011 · This allows practitioners to examine the sensitivity of their estimates of θ to specification of g in a likelihood setup. To construct these ...
[59]
[PDF] Lecture 12 Heteroscedasticity
- In cases where the White test statistic is statistically significant, heteroscedasticity may not necessarily be the cause, but model specification errors. - ...
[60]
[2406.09521] Randomization Inference: Theory and Applications
Jun 13, 2024 · We review approaches to statistical inference based on randomization. Permutation tests are treated as an important special case.
[61]
[PDF] Chapter 4: Fisher's Exact Test in Completely Randomized Experiments
Fisher (1925, 1926) was concerned with testing hypotheses regarding the effect of treat- ments. Specifically, he focused on testing sharp null hypotheses, ...
[62]
Full article: What is a Randomization Test? - Taylor & Francis Online
Randomization is one of the oldest and most important ideas in statistics, playing several roles in experimental designs and inference (Cox Citation2009).
[63]
The permutation testing approach: a review - ResearchGate
Permutation tests are a class of tests for comparing a given test statistic to a distribution of these test statistics obtained from a random ordering of the ...
[64]
Analysis of covariance in randomized trials: More precision and ...
We focus on the analysis of covariance (ANCOVA) estimator, which involves fitting a linear model for the outcome given the treatment arm and baseline variables.
[65]
A roadmap to using randomization in clinical trials
Aug 16, 2021 · A randomization-based test can be a useful supportive analysis, free of assumptions of parametric tests and protective against spurious ...
[66]
Randomization Inference | Dime Wiki
Jun 5, 2019 · Randomization inference is a method of calculating regression p-values that take into account any variations in RCT data that arise from randomization itself.
[67]
Statistical Paradigms: Frequentist, Bayesian, Likelihood & Fiducial
Core Idea: Probability represents long-run frequencies in repeated experiments. Parameters are fixed but unknown constants. Inference is based on the sampling ...
[68]
[PDF] Frequentist Probability and Frequentist Statistics
Jul 9, 2024 · Pearson, University of California Press,. Berkeley, 1967. [18] Neyman, J., Lectures and Conferences on Mathematical Statistics and Probability,.
[69]
[PDF] Review on Statistical Inference 5.1 Introduction 5.2 Frequentist ...
The Frequentists and the Bayesian use different ways to measure the evidence. The Frequentist approach is the p-value whereas the Bayesian approach is the Bayes ...
[70]
Frequentist statistics as a theory of inductive inference - Project Euclid
Neyman developed the theory of confidence intervals ab initio i.e. relying only implicitly rather than explicitly on his earlier work with E.S. Pearson on the ...
[71]
Wald's Decision Theory - Johnstone - Major Reference Works ...
4 Complete Class Theorems. A class of decision rules is called complete if for any rule δ not in C, there exists a strictly better rule δ* belonging to C. C ...
[72]
[PDF] Frequentist Statistics and Hypothesis Testing - MIT Mathematics
(i) The rejection region is |z| > 1.96, i.e. 1.96 or more standard deviations from the mean. (ii) Standardizing z =x − 5. 5/4. = 1.25. 1.25. = 1.
[73]
A Gentle Introduction to Bayesian Analysis - PubMed Central - NIH
The key difference between Bayesian statistical inference and frequentist (e.g., ML estimation) statistical methods concerns the nature of the unknown ...
[74]
[PDF] The Fisher, Neyman-Pearson Theories of Testing Hypotheses
Such inferences we recognize to be uncertain inferences. He continued in the next paragraph: Although some uncertain inferences can be rigorously expressed in ...
[75]
Frequentist versus Bayesian approaches to multiple testing - PMC
May 13, 2019 · We have criticized the frequentist framework for leading to logical difficulties, and for being unable to distinguish between relevant and ...
[76]
[2406.18905] Bayesian inference: More than Bayes's theorem - arXiv
Jun 27, 2024 · Bayesian inference gets its name from *Bayes's theorem*, expressing posterior probabilities for hypotheses about a data generating process as ...
[77]
Bayesian Interval Estimation - Probability Course
The interval [a,b] is said to be a (1−α)100% credible interval for X, if the posterior probability of X being in [a,b] is equal to 1−α.<|control11|><|separator|>
[78]
[PDF] Conjugate priors: Beta and normal Class 15, 18.05
With a conjugate prior the posterior is of the same type, e.g. for binomial likelihood the beta prior becomes a beta posterior.
[79]
Chapter 3 The Beta-Binomial Bayesian Model - Bayes Rules!
Via Bayes' Rule, the conjugate Beta prior combined with the Binomial data model produce a Beta posterior model for π π . The updated Beta posterior ...
[80]
Uninformative prior - StatLect
We will briefly describe below the following classes of non-informative priors: Bayes-Laplace uniform prior;. Jeffreys' prior;. Jaynes' maximum entropy prior.Objective Bayesian statistics · Uniform prior · The problem of re... · Jeffreys' prior
[81]
Home page for the book, "Data Analysis Using Regression and ...
Gelman and Hill have written a much needed book that ... Hierarchical Models provides useful guidance into the process of building and evaluating models.
[82]
Bayesian Analysis: Advantages and Disadvantages - SAS Help Center
Sep 29, 2025 · It provides inferences that are conditional on the data and are exact, without reliance on asymptotic approximation. Small sample inference ...
[83]
Bayesian inference for psychology. Part I: Theoretical advantages ...
Bayes factors have many practical advantages; for instance, they allow researchers to quantify evidence, and they allow this evidence to be monitored ...
[84]
History and nature of the Jeffreys–Lindley paradox
Aug 26, 2022 · The Jeffreys–Lindley paradox exposes a rift between Bayesian and frequentist hypothesis testing that strikes at the heart of statistical inference.
[85]
[PDF] On the Mathematical Foundations of Theoretical Statistics
Apr 18, 2021 · On the illathematical Foundations of Theoretical Statistics. 1By R. A. FISHER, M.A., Fellow of Gonville and Caims College, Cambridge, Chief.
[86]
Maximum Likelihood, Profile Likelihood, and Penalized Likelihood
Here we provide a primer on maximum likelihood and some important extensions which have proven useful in epidemiologic research.
[87]
The Large-Sample Distribution of the Likelihood Ratio for Testing ...
March, 1938 The Large-Sample Distribution of the Likelihood Ratio for Testing Composite Hypotheses. S. S. Wilks · DOWNLOAD PDF + SAVE TO MY LIBRARY.
[88]
[PDF] Maximum Likelihood Estimation - Arizona Math
Maximum likelihood estimation chooses the parameter value that makes the observed data most probable, using the likelihood function.
[89]
[PDF] Information and the Accuracy Attainable in the Estimation of ...
The object of the paper is to derive certain inequality relations connecting the elements of the Information Matrix as defined by Fisher (1921) and the.
[90]
The Regression Analysis of Binary Sequences - jstor
Cox's paper seems likely to result in a much wider acceptance of the logistic function as a regression model. I have never been a partisan in the probit v ...
[91]
[PDF] Contributions to the Mathematical Theory of Evolution
The paper discusses the mathematical theory of evolution, focusing on the dissection of frequency curves, both symmetrical and asymmetrical, into normal curves.
[92]
Outline of a Theory of Statistical Estimation Based on the Classical ...
Outline of a Theory of Statistical Estimation Based on the Classical Theory of Probability. J. Neyman.Missing: Jerzy | Show results with:Jerzy
[93]
The Probable Error of a Mean - Biometrika - jstor
The aim of the present paper is to determine the point at which we may use the tables of the probability integral in judging of the sig,nificance of the mean of.
[94]
Robust misinterpretation of confidence intervals
Jan 14, 2014 · Confidence intervals (CIs) have frequently been proposed as a more useful alternative to NHST, and their use is strongly encouraged in the APA ...
[95]
Statistical methods for research workers - Internet Archive
Mar 15, 2012 · Statistical methods for research workers. by: Fisher, Ronald Aylmer, Sir, 1890-1962. Publication date: 1938. Topics: Statistics, Biometry.
[96]
IX. On the problem of the most efficient tests of statistical hypotheses
On the problem of the most efficient tests of statistical hypotheses. Jerzy Neyman ... Lio W and Liu B (2018) Residual and confidence interval for uncertain ...
[97]
[PDF] Some Tests of Significance, Treated by the Theory of Probability
BY HAROLD JEFFREYS, M.A., St John's College. [Received 1 January, read 11 March 1935]. It often happens that when two sets of data obtained by observation ...
[98]
Carlo Bonferroni (1892 - 1960) - Biography - MacTutor
In the 1936 paper Bonferroni sets up his inequalities. Suppose we have a set of m m m elements and each of these elements can have any number of the n n n ...
[99]
[PDF] Controlling the False Discovery Rate: A Practical and Powerful ...
Dec 20, 2004 · The two FWER controlling methods, the Bonferroni (dotted curves) and Hochberg's (1988) method. (broken curves), are compared with the new FDR ...
[100]
[PDF] Non-Inferiority Clinical Trials to Establish Effectiveness - FDA
This FDA guidance covers non-inferiority clinical trials, including the non-inferiority hypothesis, reasons for using this design, and the non-inferiority ...
[101]
Predictive Inference - 1st Edition - Seymour Geisser - Routledge Book
In stock Free deliveryIn this book, he brings together his views on predictive or observable inference and its advantages over parametric inference.
[102]
3.3 - Prediction Interval for a New Response | STAT 501
Observe that the prediction interval (95% PI, in purple) is always wider than the confidence interval (95% CI, in green). Furthermore, both intervals are ...
[103]
[PDF] Conjugate Bayesian analysis of the Gaussian distribution
Oct 3, 2007 · Conjugate Bayesian analysis of Gaussian distribution uses conjugate priors, allowing closed-form results. A natural conjugate prior has the ...
[104]
Why every statistician should know about cross-validation
Oct 4, 2010 · Cross-validation is primarily a way of measuring the predictive performance of a statistical model. Every statistician knows that the model fit statistics are ...
[105]
A Gentle Introduction to Conformal Prediction and Distribution-Free ...
Jul 15, 2021 · Critically, the sets are valid in a distribution-free sense: they possess explicit, non-asymptotic guarantees even without distributional ...
[106]
[PDF] Understanding predictive information criteria for Bayesian models
May 11, 2013 · A more general summary of predictive fit is the log predictive density, log p(y|θ), which is proportional to the mean squared error if the ...
[107]
Statistical Decision Theory and Bayesian Analysis - SpringerLink
In this new edition the author has added substantial material on Bayesian analysis, including lengthy new sections on such important topics as empirical and ...
[108]
[PDF] Statistical Decision Functions - Gwern
The Late ABRAHAM WALD. Professor of Mathematical Statistics. Columbia ... Wald, A., “Statistical Decision Functions,” Ann. Math. Stat., 20 (1949). 71 ...
[109]
[PDF] Estimation with quadratic loss
This paper discusses estimation with quadratic loss, where risk is measured by a quadratic function. It also addresses the admissibility of estimators with ...
[110]
[PDF] metropolis-et-al-1953.pdf - aliquote.org
INTRODUCTION. THE of. HE purpose of this paper is to describe a general method, suitable for fast electronic computing machines, of calculating the properties ...
[111]
[PDF] Variational Inference: A Review for Statisticians - Columbia CS
Feb 27, 2017 · Modern research on variational inference focuses on sev- eral aspects: tackling Bayesian inference problems that involve massive data; using ...
[112]
Bootstrap Methods: Another Look at the Jackknife - Project Euclid
The jackknife is shown to be a linear approximation method for the bootstrap. The exposition proceeds by a series of examples.
[113]
The Influence Curve and Its Role in Robust Estimation - jstor
Hampel is professor, Department of Statistics, Abt. 9, Swiss Federal ... robustness and positive breakdown point are closely connected (they were ...<|separator|>
[114]
Robust Estimation of a Location Parameter - Project Euclid
This paper contains a new approach toward a theory of robust estimation; it treats in detail the asymptotic theory of estimating a location parameter for ...
[115]
Individual Comparisons by Ranking Methods - jstor
The appropriate methods for testing the sig? nificance of the differences of the means in these two cases are described in most of the textbooks on statistical ...
[116]
Breakdown Robustness of Tests - Taylor & Francis Online
Feb 28, 2012 · For testing location, the breakdown functions of the sign test uniformly dominate those of the Wilcoxon test, and the sign test is the ...
[117]
[PDF] Cross-Validatory Choice and Assessment of Statistical Predictions M ...
Apr 6, 2007 · A generalized form of the cross-validation criterion is applied to the choice and assessment of prediction using the data-analytic concept of a ...
[118]
[PDF] A Tutorial on Conformal Prediction
Conformal prediction is studied in detail in Algorithmic Learning in a Random World, by Vovk,. Gammerman, and Shafer (2005). A recent exposition by Gammerman ...
[119]
High-Dimensional Inference: Confidence Intervals, p-Values and R ...
This paper reviews high-dimensional inference methods for p-values and confidence intervals, introduces the R package 'hdi', and presents a comparative study.
[120]
Reproducibility in machine‐learning‐based research: Overview ...
Apr 14, 2025 · The main reproducibility barrier associated with R3 Data is that data is simply not shared or made publicly available most of the time (Hutson ...
[121]
Bayesian Learning for Neural Networks - SpringerLink
Free delivery 14-day returnsThis book demonstrates how Bayesian methods allow complex neural network models to be used without fear of overfitting, and describes practical implementation ...