Fact-checked by Grok 2 weeks ago

Identifiability

Identifiability is a core property of statistical models that guarantees the unique recovery of model parameters from the distribution of observed data, ensuring that different parameter values produce distinct observable probability distributions.^[1] This concept emerged in econometrics during the 1930s, with Ragnar Frisch's pioneering work on "statistical confluence analysis," which addressed the challenges of estimating linear relations amid measurement errors and multicollinearity in economic data.^[2] By the mid-20th century, it became integral to structural equation modeling and maximum likelihood estimation, where non-identifiability leads to inconsistent or multiple possible parameter estimates even with infinite data.^[3] In broader statistical theory, identifiability underpins the validity of inference, distinguishing it from estimability by focusing on theoretical uniqueness rather than finite-sample precision.^[4] In causal inference, identifiability extends to determining whether causal effects—such as average treatment effects—can be expressed solely in terms of observable data distributions, relying on assumptions like exchangeability, positivity, and consistency to link counterfactual outcomes to empirical measures.^[5] Applications span fields including epidemiology, where it aids in assessing intervention impacts from observational studies; systems biology, for parameterizing dynamic models of biological processes;^[6] and machine learning, where it informs the reliability of inferred relationships in complex algorithms.^[7] Lack of identifiability often necessitates additional constraints, such as regularization or instrumental variables, to achieve practical inference.^[8]

Fundamentals

Definition

Identifiability is a core property of statistical models that ensures different values of the model parameters generate distinct probability distributions or likelihood functions, thereby permitting the unique determination of those parameters from observed data. This property is essential for reliable parameter estimation and inference, as without it, multiple parameter sets could explain the same data equally well, leading to ambiguity in model interpretation.^[9]^[10] The concept of identifiability emerged in the 20th century as part of the development of modern statistical theory, building on earlier work such as Ragnar Frisch's 1930s contributions to identification issues in econometrics, with the term itself coined by economist Tjalling C. Koopmans in 1949 to address challenges in econometric modeling.^[11] It built on the foundational principles of likelihood-based inference established by Ronald A. Fisher in his 1922 paper on the mathematical foundations of theoretical statistics, which introduced maximum likelihood estimation. Intuitively, identifiability parallels the requirement for a unique solution in solving equations; non-identifiability manifests when distinct parameter configurations yield identical outcomes, akin to label switching in mixture models where interchangeable components produce the same overall distribution. This foundational notion underpins more precise formal conditions for identifiability explored elsewhere.^[9]^[10]

Formal Conditions

In parametric statistical models, identifiability requires that the mapping from the parameter space \Theta to the corresponding family of probability distributions \{[P_\theta](/page/P′′) : \theta \in \Theta\} is injective. Formally, the model is identifiable if \theta_1 \neq \theta_2 implies P_{\theta_1} \neq P_{\theta_2}, where inequality denotes that the measures differ (i.e., they are not equal).^[12]

\theta_1 \neq \theta_2 \implies P_{\theta_1} \neq P_{\theta_2}

This injectivity condition guarantees that distinct parameters generate distinct distributions, providing the theoretical foundation for parameter recovery from observed data.^[12] In the context of likelihood-based inference for parametric models, for independent and identically distributed observations, identifiability holds when the mapping from \theta to the induced likelihood is injective almost surely with respect to the data-generating measure, ensuring that the true parameter can be distinguished from alternatives based on the observed likelihood.^[13] Finite-order identifiability extends this framework by requiring that parameters can be distinguished using only moments up to a finite order or from finite samples, rather than the full distribution. For instance, in homoscedastic Gaussian mixture models with k components in dimension n \geq k-1, moments up to order 4 suffice for algebraic identifiability when k = 2, 3, 4, while order 3 suffices when k \geq 5.^[14] This property is particularly useful in models where full distributional knowledge is impractical, allowing identifiability checks via low-order statistics.^[14]

Types of Identifiability

Global Identifiability

Global identifiability in statistical models refers to the property where each distinct parameter value \theta in the full parameter space \Theta uniquely determines the probability distribution P_{\theta} of the observed data, meaning that if P_{\theta} = P_{\theta'} for \theta, \theta' \in \Theta, then \theta = \theta'.^[15] This ensures that parameters can be recovered without ambiguity across the entire space, distinguishing it from weaker forms of identifiability that may hold only locally.^[16] The key condition for global identifiability is that the mapping from parameters to distributions, \theta \mapsto P_{\theta}, is injective (one-to-one) over all of \Theta, implying a bijective correspondence in identifiable cases and the absence of any equivalence classes where multiple parameters produce identical distributions.^[16] This injectivity prevents scenarios where distinct parameter sets yield the same likelihood, such as through compensatory adjustments among parameters.^[15] Achieving global identifiability is challenging, particularly in complex models, where symmetries in the model structure often lead to multiple parameter configurations generating equivalent outputs, resulting in non-uniqueness.^[17] These symmetries frequently necessitate reparameterization to eliminate redundancies and reduce the dimensionality of \Theta, transforming the model into an equivalent form where parameters are uniquely recoverable.^[17] Such issues are prevalent in high-dimensional or nonlinear systems, making global identifiability rare without careful model design.^[16]

Local Identifiability

Local identifiability refers to the property of a model parameter \theta_0 where, in a sufficiently small open neighborhood around \theta_0, distinct parameter values produce distinct probability distributions. This means the mapping from the parameter space to the space of probability measures is injective locally at \theta_0, ensuring that small perturbations in the parameter lead to uniquely observable changes in the model's output distribution.^[18] A key condition for local identifiability is that the Jacobian matrix of the mapping from parameters to the model's probability law has full column rank equal to the dimension of the parameter vector at \theta_0. Equivalently, in likelihood-based frameworks, local identifiability holds if the Fisher information matrix I(\theta_0), defined as the expected negative Hessian of the log-likelihood,

I(\theta_0) = -\mathbb{E}\left[ \frac{\partial^2}{\partial \theta \partial \theta^\top} \log L(\theta_0) \right],

has full rank equal to \dim(\theta). This nonsingularity condition ensures the parameter is recoverable up to first-order approximations via derivatives. If the first-order Jacobian is rank-deficient, higher-order conditions involving Taylor expansions of the mapping may be checked to establish local injectivity.^[19]^[20] In practice, local identifiability is sufficient to guarantee asymptotic consistency and normality of maximum likelihood estimators at the true parameter value under standard regularity conditions, as it supports the quadratic approximation of the likelihood near \theta_0. However, it does not ensure a unique estimator in finite samples, where multiple local maxima may arise outside the neighborhood.^[19]^[21]

Structural Identifiability

Structural identifiability refers to the property of a mathematical model where its parameters can be uniquely determined from the model's functional form and the relationships between inputs and outputs, assuming ideal, noise-free data. This concept is particularly relevant for dynamical systems described by ordinary differential equations (ODEs) or partial differential equations (PDEs), where the identifiability depends solely on the deterministic mapping from parameters to observable outputs, independent of experimental noise or data limitations. In essence, a model is structurally identifiable if distinct parameter sets do not produce identical input-output behaviors, ensuring that the parameter-to-output map is injective. This a priori assessment is crucial in fields like systems biology and control engineering to verify whether a model's architecture allows unique parameter recovery before conducting experiments.^[22] Key conditions for structural identifiability often involve checking the uniqueness of representations such as transfer functions for linear systems or employing differential algebra methods for nonlinear dynamical systems. For linear time-invariant systems, structural identifiability is established if the transfer function's coefficients uniquely correspond to the model parameters, preventing ambiguities in the Markov parameters or state-space realizations. In nonlinear cases, differential algebra techniques, which treat the model equations as a differential ideal, generate elimination ideals to test whether parameters can be expressed uniquely in terms of inputs, outputs, and their derivatives; this approach has been formalized for rational polynomial models common in biological systems. These methods apply to ODE models of the form \dot{x} = f(x, p, u), y = g(x, p, t), where x is the state, p the parameters, u the input, and y the output, and extend to PDEs in spatio-temporal contexts by analyzing generating series or Laplace transforms to confirm output uniqueness. Seminal work by Godfrey and DiStefano formalized these concepts, emphasizing structural invariants in compartmental models.^[23]^[24] Unlike statistical identifiability, which incorporates noise, finite data, and probabilistic inference to assess practical parameter estimation, structural identifiability focuses exclusively on the invertibility of the deterministic parameter-to-output map, providing a foundational check before data-driven analysis. For instance, in pharmacokinetic models, structural identifiability ensures that drug absorption and elimination rates can be uniquely inferred from concentration-time profiles based solely on the model's compartmental structure, without considering measurement errors; this is vital for physiologically based pharmacokinetic (PBPK) models where non-identifiable parameters might lead to ambiguous dosing predictions. Tools like the DAISY software implement differential algebra to automate these checks for such applications.^[22]^[25]

Importance and Implications

Role in Parameter Estimation

Identifiability plays a crucial role in maximum likelihood estimation (MLE) by ensuring that the likelihood function possesses a unique maximum corresponding to the true parameter values. In identifiable models, the likelihood surface is well-behaved, allowing MLE to reliably locate the parameter vector that maximizes the probability of observing the data. Conversely, non-identifiability results in flat or degenerate likelihood surfaces, where multiple parameter values yield the same likelihood, leading to ridges or plateaus that complicate optimization and render point estimates unreliable.^[26] This flatness often manifests as multiple global maxima or extended regions of near-equivalent likelihood, preventing convergence to a single optimum and increasing sensitivity to initial conditions in numerical algorithms.^[27] For identifiable models, MLE estimators are consistent, meaning they converge in probability to the true parameter θ as the sample size increases, provided regularity conditions such as differentiability hold.^[28] This convergence relies on the injectivity of the mapping from parameters to distributions, ensuring that distinct θ values produce distinct data distributions. In non-identifiable cases, however, estimators fail to pinpoint a unique θ and instead converge to a set or manifold of equivalent parameters, undermining the precision of inference.^[29] Moreover, identifiability supports the asymptotic efficiency of MLE, where the estimators achieve the Cramér-Rao lower bound variance, optimizing the trade-off between bias and variance in large samples. Without it, efficiency breaks down, as the information matrix may become singular, inflating estimation uncertainty. To address non-identifiability, reparameterization strategies impose constraints that restore uniqueness, such as fixing scales or ordering components in mixture models. For instance, in Gaussian mixture models, non-identifiability arises from label switching and scale ambiguities, but fixing the sum of mixing proportions to 1 and ordering means by magnitude, or using relative reparameterizations, enforces a identifiable parameterization that stabilizes MLE.^[30] These approaches transform the parameter space to eliminate redundancies while preserving the model's generative process, enabling reliable estimation without altering the underlying distribution. The foundational link between identifiability and MLE was recognized in Ronald A. Fisher's seminal 1922 paper, where he established the principles of likelihood-based estimation and implicitly highlighted the need for unique parameter recovery to ensure method validity.^[31]

Relation to Other Statistical Properties

Identifiability plays a foundational role in ensuring the consistency of parameter estimators in statistical models. Specifically, for an estimator to be consistent—meaning it converges in probability to the true parameter value as the sample size increases—identifiability of the parameter is a necessary condition, though not sufficient on its own, as additional regularity conditions on the model and data-generating process are required.^[32] This necessity arises because non-identifiable parameters lead to multiple values that fit the observed data equally well, preventing convergence to a unique true value. For instance, in maximum likelihood estimation, identifiability ensures the likelihood function has a unique maximum corresponding to the true parameter, but without further assumptions like boundedness or differentiability, consistency may fail even if identifiability holds.^[33] Identifiability should be distinguished from estimability, which concerns the practical feasibility of estimating parameters from finite samples with noise and measurement error, focusing on precision and reliability in real-world data scenarios rather than purely theoretical uniqueness.^[34] In causal inference frameworks, identifiability is crucial for recovering causal effects from observational data. Within structural equation models (SEMs), identifiability guarantees that the causal parameters, representing direct and indirect effects among latent and observed variables, can be uniquely estimated from the covariance structure, enabling inferences about underlying causal mechanisms.^[35] Similarly, in instrumental variables (IV) estimation, identifiability ensures that the causal effect of an endogenous regressor on the outcome can be isolated using exogenous instruments, provided the instruments satisfy relevance and exclusion restrictions, thus allowing unbiased recovery of local average treatment effects. Without identifiability in these models, causal effects remain unrecoverable, leading to ambiguous interpretations of associations as causation. Identifiability extends beyond point identification—where parameters are uniquely pinned down—to partial identification in incomplete or underdetermined models. In such cases, the data only bounds the parameter within a set rather than identifying a single value, which is common in econometric models with selection bias or missing data mechanisms.^[36] This partial approach, pioneered in works on bounds analysis, acknowledges that full point identification may be unattainable due to inherent data limitations, yet still permits meaningful inference through set estimation and sensitivity analysis. A key distinction exists between identifiability and overidentification, particularly in simultaneous equations models. Identifiability concerns the uniqueness of parameter recovery from the data, ensuring a one-to-one mapping between parameters and observable moments, whereas overidentification occurs when more instruments or restrictions are available than minimally required, facilitating specification tests like the Sargan-Hansen test without affecting the uniqueness of the identified parameters.^[2] This overabundance of information enhances model validation but does not resolve underidentification issues where parameters remain non-unique.

Examples

Identifiable Models

In linear regression, the model is typically expressed as Y = X\beta + \epsilon, where Y is the response vector, X is the design matrix, \beta is the parameter vector, and \epsilon is the error term with mean zero and finite variance. The parameters \beta are identifiable under the standard assumption that X has full column rank, which precludes perfect multicollinearity among the predictors and ensures a unique solution for \beta via the ordinary least squares estimator.^[37] This condition guarantees that different values of \beta produce distinct conditional expectations E[Y|X] = X\beta, allowing reliable parameter estimation from observed data.^[38] Exponential families provide another class of identifiable models through their canonical form, f(y|\eta) = h(y) \exp(\eta T(y) - A(\eta)), where \eta is the natural (canonical) parameter, T(y) is the sufficient statistic, h(y) is the base measure, and A(\eta) is the log-partition function. In a minimal exponential family—where the components of T(y) are linearly independent—the canonical parameters \eta are globally identifiable, meaning distinct \eta values yield distinct distributions, as the mapping from \eta to the probability measure is one-to-one.^[39] This identifiability stems from the strict convexity of A(\eta) and the full dimensionality of the natural parameter space, facilitating unique recovery of \eta from the moments E[T(Y)] = \nabla A(\eta).^[40] A concrete illustration is the normal distribution Y \sim N(\mu, \sigma^2), where the parameters \mu and \sigma^2 are identifiable from the first two population moments.

\begin{align*} \mu &= E[Y], \\ \sigma^2 &= \operatorname{Var}(Y) = E[Y^2] - (E[Y])^2. \end{align*}

These moments uniquely determine \mu and \sigma^2 > 0, as the moment-generating function or characteristic function of the normal distribution is injective with respect to these parameters, ensuring no other distribution in the family matches the same mean and variance.^[41]

Non-Identifiable Models

Non-identifiable models arise when multiple distinct parameter sets yield the same observed data distribution, resulting in ambiguity during parameter estimation and inference. A classic example occurs in mixture models without label constraints, where the components are interchangeable due to the symmetry of the mixture density, leading to the label switching problem and non-uniqueness of the maximum likelihood estimates.^[42] This non-identifiability implies that the posterior distribution over parameters is multimodal, with modes corresponding to permutations of the component labels, which complicates Bayesian inference and clustering tasks. Consider a two-component Gaussian mixture model, where the density is given by f(y|\theta) = \pi_1 \phi(y; \mu_1, \sigma_1^2) + \pi_2 \phi(y; \mu_2, \sigma_2^2) with \pi_2 = 1 - \pi_1 and \phi denoting the Gaussian density. Here, the parameter vector [\theta](/page/Theta) = (\mu_1, \sigma_1, \pi_1, \mu_2, \sigma_2) is non-identifiable because swapping the components—replacing (\mu_1, \sigma_1, \pi_1) with (\mu_2, \sigma_2, \pi_2) and vice versa—produces an equivalent density f(y|\theta') = f(y|\theta), yet \theta' \neq \theta. The consequences include unstable estimates across different optimization runs and challenges in assigning probabilistic labels to data points for downstream applications like classification.^[42] Another prominent case is factor analysis, where the model assumes observed variables are linear combinations of latent factors plus noise, but the factor loadings exhibit rotational invariance. Without additional constraints, such as fixing certain loadings or imposing orthogonality, the parameters are non-identifiable because any orthogonal rotation of the factors preserves the covariance structure of the data.^[43] Specifically, if \theta represents the loading matrix, the likelihood satisfies

L(\theta Q) = L(\theta)

for any orthogonal matrix Q, meaning infinitely many loading matrices \theta Q are equivalent and yield identical model fits.^[43] This invariance leads to identifiability failure, rendering unique recovery of the underlying factor structure impossible and affecting the interpretability of the latent dimensions.^[43]

Methods for Assessing Identifiability

Analytical Methods

Analytical methods for assessing identifiability rely on algebraic and symbolic techniques to determine whether model parameters can be uniquely recovered from the input-output map without relying on numerical approximations or simulations. These approaches provide exact conditions for structural identifiability by examining the model's equations directly, often transforming the problem into solving systems of polynomial equations or checking equivalence classes of parameterizations. Developed primarily in the 1970s and 1980s within control theory, with subsequent applications in systems biology from the early 2000s onward, these methods laid the foundation for verifying identifiability in linear and nonlinear dynamical systems.^[44] In state-space models, similarity transformation checks assess identifiability by determining if distinct parameter sets produce equivalent observable behaviors through coordinate changes in the state space. Specifically, a model is identifiable if there exists no non-trivial invertible matrix T such that the transformed system matrices A' = T^{-1} A T, B' = T^{-1} B, and C' = C T yield the same input-output response for all inputs, ensuring parameters are not confounded by state reparameterization. This technique, originally applied to linear compartmental models, verifies global identifiability by enumerating possible transformations and checking their impact on the transfer function or Markov parameters.^[45] Moment-based criteria evaluate identifiability by confirming that the statistical moments or cumulants of the output uniquely determine the parameters, particularly in stochastic or linear systems where higher-order statistics eliminate ambiguities from lower moments. For instance, in non-Gaussian processes, cumulants beyond the second order can distinguish parameter values that produce identical covariance structures, as the cumulant-generating function provides a one-to-one mapping under certain rank conditions. This approach is effective for models where the output distribution's moments suffice to invert for parameters, avoiding reliance on full trajectory data.^[46] For nonlinear ordinary differential equation (ODE) models, differential algebra techniques compute identifiable parameter combinations by eliminating latent state variables from the input-output equations, forming an elimination ideal in the differential polynomial ring. The process involves generating differential extensions of the model equations and solving for whether the parameters appear in a rank-deficient manner within the ideal; if the ideal contains a polynomial solely in the parameters with finite roots, the model is locally identifiable. This method extends classical algebraic geometry to dynamical systems, enabling the derivation of identifiable functions even for complex nonlinear structures.^[47]

Numerical Methods

Numerical methods for assessing identifiability are essential when analytical approaches become computationally infeasible for high-dimensional or nonlinear models, providing empirical evaluations through optimization and sampling techniques. These methods focus on practical identifiability, examining how well parameters can be recovered from data under realistic noise and experimental conditions. One prominent numerical technique is the profile likelihood method, which involves fixing a parameter of interest at various values across its plausible range and maximizing the likelihood over the remaining parameters for each fixed value. The resulting profile likelihood curve reveals non-identifiability if it exhibits flat regions where the likelihood remains nearly constant, indicating multiple parameter sets yield similar data fits. This approach is particularly useful for detecting practical non-identifiability in systems biology models, as demonstrated in workflows that propagate confidence sets to predictions.^[48]^[49] Bayesian methods offer another computational framework for identifiability assessment by analyzing the posterior distribution of parameters given the data and prior. Posterior profiles or marginal posteriors are computed to evaluate parameter recovery; well-identified parameters show concentrated posteriors, while non-identifiable ones result in diffuse or degenerate distributions. Markov chain Monte Carlo (MCMC) sampling is commonly employed to explore these posteriors, enabling checks on identifiability even in complex hierarchical models.^[50]^[51] Sensitivity analysis complements these by perturbing individual parameters and quantifying their impact on model outputs, often using local derivatives from the sensitivity matrix or global exploration via MCMC to identify locally non-identifiable parameters near the maximum likelihood estimate. This perturbation-based approach highlights parameters with minimal influence on observables, signaling potential identifiability issues.^[52]^[53] Several software tools facilitate these numerical assessments. DAISY employs differential algebra for initial structural checks that guide numerical profiling in dynamic systems.^[54] The Identifiability Toolbox in MATLAB supports profile likelihood and sensitivity computations for ordinary differential equation models. Additionally, COPASI provides built-in functions for profile likelihood scans and Bayesian estimation to evaluate practical identifiability in biochemical networks.^[55]^[56]

Applications

In Econometrics

In econometrics, identifiability has been central since the 1940s, particularly through the work of the Cowles Commission, which developed foundational concepts for structural estimation in simultaneous equation models. Researchers at the Commission, including Tjalling Koopmans, addressed the challenges of recovering causal parameters from reduced-form data, emphasizing that identifiability requires the structural parameters to be uniquely recoverable from observable distributions. This historical effort culminated in key monographs that formalized identification as a prerequisite for reliable inference in economic models, influencing subsequent advancements in causal analysis.^[57] A cornerstone of identifiability in econometrics is the use of instrumental variables (IV) in simultaneous equations systems, where rank and order conditions ensure parameter recovery. The order condition, first articulated by Olav Reiersøl, is a necessary criterion stating that for an equation with G included endogenous variables and K exogenous variables, the number of excluded exogenous instruments must be at least G - 1 to achieve exact identification. The rank condition, developed by Theodore W. Anderson and Herman Rubin, is sufficient and requires that the G-1 \times G-1 submatrix of the coefficient matrix on excluded instruments has full rank, ensuring the instruments provide linearly independent variation orthogonal to the error term. These conditions underpin IV estimation by guaranteeing that the instruments correlate with the endogenous regressors but not with the disturbances, allowing consistent recovery of structural parameters.^[58] A classic illustration is the supply-demand model, where price and quantity are simultaneously determined, leading to endogeneity if estimated via ordinary least squares. Identifiability is achieved through exclusion restrictions: a demand shifter (e.g., income) excluded from the supply equation serves as an instrument for price in demand estimation, while a supply shifter (e.g., production costs) does the same for supply estimation. These restrictions ensure the instruments affect quantity only through price, enabling unique recovery of the demand elasticity (typically negative) and supply elasticity (positive). When point identification fails due to insufficient instruments or model restrictions, partial identification provides bounds on parameters rather than point estimates, a framework advanced by Charles Manski. In matching models, such as those for labor market selection or two-sided matching, partial identification arises from unobservables like ability or preferences; for instance, bounds on average treatment effects can be derived using observed covariates and monotonicity assumptions, narrowing the range without full recovery. This approach is particularly useful in policy evaluation where data limitations prevent exact identifiability but allow credible interval estimates. In modern econometrics, randomized controlled trials (RCTs) ensure identifiability through randomization, which exogenously assigns treatment and eliminates selection bias, directly identifying causal effects as in the difference-in-means estimator. This builds on Cowles foundations by providing a gold standard for causal inference in economic policy contexts, such as development interventions.^[59]

In Systems Biology and Other Fields

In systems biology, identifiability plays a crucial role in modeling complex biological processes, particularly in pharmacokinetics where compartmental models describe drug dynamics within the body. These models divide the body into compartments representing different physiological spaces, such as plasma and tissues, with parameters governing transfer rates, absorption, and elimination. Structural identifiability analysis ensures that these parameters can be uniquely determined from observable data, like plasma concentration over time, preventing ambiguities in model interpretation and improving predictions for drug dosing and efficacy. For instance, in physiologically based pharmacokinetic (PBPK) models, identifiability assessments help evaluate whether tissue-specific parameters are recoverable, influencing model reduction strategies to enhance computational efficiency without loss of predictive power.^[60] A prominent example is the two-compartment pharmacokinetic model, commonly used to capture biphasic drug elimination where an initial rapid distribution phase is followed by slower clearance. In this setup, the central compartment represents plasma, and the peripheral compartment accounts for tissue distribution, with rate constants for intercompartmental transfer and elimination needing to be estimated from concentration-time profiles. Structural checks, such as those using transfer function analysis or similarity transformations, reveal that under ideal conditions with continuous measurements, parameters like the elimination rate constant and volume of distribution are locally identifiable, though indistinguishability can arise if inputs or outputs are restricted, such as bolus dosing without peripheral sampling. This model's identifiability has been pivotal in applications like positron emission tomography (PET) imaging, where exact parameter recovery supports quantitative assessment of drug binding in tissues. Recent advancements, including 2025 analyses of compartmental frameworks, emphasize integrating these checks early to avoid non-identifiable configurations in personalized medicine.^[61]^[62]^[63]^[64] In machine learning, particularly within latent variable models, identifiability addresses challenges in disentangling underlying factors from high-dimensional data, ensuring that learned representations correspond uniquely to generative processes. Variational autoencoders (VAEs) exemplify this, as standard formulations suffer from non-identifiability due to rotational ambiguities in the latent space, leading to inconsistent factor interpretations across training runs. Identifiable VAEs (iVAEs) mitigate this by incorporating constraints like non-factorized priors or auxiliary variables, enabling linear disentanglement up to permutation and scaling, which is essential for tasks such as causal inference and data generation in biological datasets. For example, double iVAEs extend this to hierarchical structures, providing theoretical guarantees for recovering independent latent components in nonlinear settings, with applications in genomics for modeling gene expression variability. Seminal works from 2021 onward have demonstrated the impact of these methods on reliable feature discovery without auxiliary supervision.^[65]^[66]^[67] As of 2025, identifiability concepts are extending to emerging interdisciplinary fields, including quantum physics and climate science, where parameter recovery from noisy or sparse observations is paramount. In quantum systems, identifiability analysis for open quantum dynamics unifies autonomous and controlled models, showing that Hamiltonian and dissipator parameters can be uniquely estimated from measurement trajectories under minimal assumptions, facilitating robust quantum control in devices like superconducting qubits. This has implications for quantum sensing and error correction, with recent experimental graybox approaches achieving high-fidelity identification in noisy environments. Similarly, in climate modeling, partial identifiability arises due to equifinality in parameter sets yielding similar projections, prompting methods like sensitivity-based profiling to constrain uncertainties in Earth system models for better policy-relevant forecasts. For instance, analyses of global circulation models reveal that parameters for cloud feedback and ocean mixing are often weakly identifiable from historical data, driving the adoption of ensemble techniques to quantify structural ambiguities.^[68]^[69]^[70]^[71]

References

[1]
https://www.hbs.edu/ris/download.aspx?name=20-086%20A%20general%20theory%20of%20identification%2002182020.pdf
[2]
[PDF] The Identification Zoo - Meanings of Identification in Econometrics
Before discussing identification in detail, consider some historical context. ... identification in frequentist statistics from its role in Bayesian statistics.
[3]
On structural and practical identifiability - ScienceDirect.com
The concept of identifiability is strongly linked to the transition from bad models to good models. Identifiability analysis is necessary to create good models ...Missing: history | Show results with:history
[4]
Statistical Identification and Estimability - ResearchGate
Following a brief history of statistical identification, the concept of 'identifiability' is examined and explained from both Bayesian and non-Bayesian ...
[5]
Causal inference and effect estimation using observational data - PMC
Sep 6, 2022 · A causal effect is identifiable if it can be estimated using observable data, given certain assumptions about the data and the underlying causal ...
[6]
Identifiability - an overview | ScienceDirect Topics
Identifiability is defined as an important property of a statistical model that determines whether the model parameters can be recovered from the observed data, ...
[7]
[PDF] Identification and Causal Inference (Part I) - Kosuke Imai
Identification: How much can we learn about parameters from infinite amount of data? Ambiguity vs. Uncertainty. Identification assumptions vs. Statistical ...
[8]
Parameter Identifiability in Statistical Machine Learning: A Review
May 1, 2017 · In this review, identifiability means theoretical uniqueness. Identifiability analysis is important not only for models whose parameters have ...Missing: RA | Show results with:RA
[9]
[PDF] Identification in Parametric Models - Semantic Scholar
May 1, 1971 · A theory of identification is developed for a general stochastic model whose probability law is determined by a finite number of parameters.
[10]
None
### Formal Definition of Identifiability
[11]
(PDF) On identifiability of parametric statistical models - ResearchGate
Aug 6, 2025 · In statistical inference, the concept of identifiability [53] is concerned with whether the quantities of interest can be uniquely determined ...
[12]
Moment Identifiability of Homoscedastic Gaussian Mixtures
Jul 6, 2020 · We consider the problem of identifying a mixture of Gaussian distributions with the same unknown covariance matrix by their sequence of moments up to certain ...<|separator|>
[13]
Global identifiability of latent class models with applications to ... - NIH
Summary: Identifiability of statistical models is a fundamental regularity condition that is required for valid statistical inference.
[14]
Parameter identifiability analysis and visualization in large-scale ...
May 5, 2017 · It is globally identifiable if the relationship holds in all the range of values of the parameter. If there is some region with non-zero measure ...Sensitivity Analysis · Collinearity Of Parameters · Tgf- β Signalling Pathway
[15]
AutoRepar: A method to obtain identifiable and observable ...
Nov 18, 2021 · Reduce the dimension of the model, reparameterizing it to remove the redundant parameters. By eliminating the redundancies, the symmetries in ...
[16]
https://bmcsystbiol.biomedcentral.com/articles/10.1186/s12918-017-0428-y
[17]
Identification in Parametric Models | The Econometric Society
May 1, 1971 · A theory of identification is developed for a general stochastic model whose probability law is determined by a finite number of parameters.
[18]
6.7 Local Identifiability | Handout for Cognitive Diagnosis Modeling
Local identifiability means that in a parameter's neighborhood, every parameter generates a unique distribution, but it's not globally unique.
[19]
[PDF] 14.385 Nonlinear Econometrics Lecture 3. Theory: Consistency ...
For other extremum problems, it is often harder to give such simple sufficient condition for identifiability. Proof of MLE consistency: It suffices to check ...
[20]
[PDF] On structural and practical identifiability - arXiv
Feb 9, 2021 · Two basic approaches exist to assess structural identifiability of non-linear dynamic models. A priori methods only use the model definition, ...
[21]
Analysis of unique structural identifiability via submodels
The paper presents a sufficient and necessary condition for unique structural identifiability of linear compartmental models. By virtue of this result unique ...
[22]
Differential algebra methods for the study of the structural ...
In this paper methods from differential algebra are used to study the structural identifiability of biological and pharmacokinetics models expressed in state- ...
[23]
https://www.sciencedirect.com/science/article/pii/0025556484900233
[24]
[PDF] One family, six distributions – A flexible model for insurance claim ...
May 28, 2018 · A flat likelihood function means that many alternative ... Identifiability A stochastic model is identifiable if different parameter vec-.
[25]
[PDF] Maximum Likelihood Estimation in Latent Class Models For ...
Having determined that the non-identifiable space is 2-dimensional and that there are multiple maxima, we proceed with some plots of the profile log-likelihood ...
[26]
[PDF] Maximum Likelihood Estimation (MLE)
That is, MLE is a consistent estimator. log f (y; θ)f (y; θ0) dy Now, note that the identifiability condition 3 ensures the convergence of θn to θ0.
[27]
Existence and consistency of the maximum likelihood estimators for ...
The maximum likelihood method offers a standard way to estimate the three parameters of a generalized extreme value (GEV) distribution.
[28]
(PDF) On the Influence of Enforcing Model Identifiability on Learning ...
In this work, we propose a relative reparameterization technique of the parameter space, which yields a general method for extracting regular submodels from ...
[29]
On the mathematical foundations of theoretical statistics - Journals
On the mathematical foundations of theoretical statistics. R. A. Fisher.
[30]
Consistency and identifiability - ScienceDirect.com
The paper explores by elementary methods the relation between the concepts of consistency and identifiability.
[31]
(PDF) Consistency and identifiability revisited - ResearchGate
Aug 6, 2025 · actually a necessary and suﬃcient condition for the consistency ... The identifiability of a statistical model is an essential and necessary ...
[32]
[PDF] Eight Myths About Causality and Structural Equation Models
The preoccupation of early SEM researchers with the identification problem testifies to the fact that they were well aware of the causal assumptions that enter ...
[33]
[PDF] Partial Identification in Econometrics
So, here Frisch covers the essential principles in a partial identification analysis: He derives the identified set, or, as he calls it, the possibility set, ...
[34]
Identifiability in Linear Models - jstor
The paper begins with a discussion of the problem of identifiability of linear parametric functions, which yields rather simple proofs of theorems on the ...<|control11|><|separator|>
[35]
(PDF) Regression Identifiability and Edge Interventions in Linear ...
May 26, 2022 · In this paper, we introduce a new identifiability criteria for linear structural equation models, which we call regression identifiability.
[36]
Stat 5421 Lecture Notes: Exponential Families
An exponential family is full if its canonical parameter space is (3.3) Θ = { θ : c ( θ ) < ∞ } (where the cumulant function is defined by (3.2)), and a full ...
[37]
[PDF] 18 The Exponential Family and Statistical Applications
For a distribution in the canonical one parameter Exponential family, the parameter η is called the natural parameter, and T is called the natural parameter ...
[38]
[PDF] Identification of distributions for risks based on the first moment and ...
normal distributions, knowing m immediately solves for one of the two distribution parameters. For the beta distribution, the relationship is m = α/(α + β).
[39]
Dealing with label switching in mixture models - Stephens - 2000
Jan 6, 2002 · We describe in detail one particularly simple and general relabelling algorithm and illustrate its success in dealing with the label switching problem on two ...
[40]
On the identifiability of Bayesian factor analytic models
Feb 27, 2022 · A well known identifiability issue in factor analytic models is the invariance with respect to orthogonal transformations.
[41]
System identifiability based on the power series expansion of the ...
The identifiability of systems in a state space representation is considered. The analysis is based on the assumption that the system equation can be ...
[42]
Parameter and Structural Identifiability Concepts and Ambiguities
The notion of identifiability addresses the question of whether it is at all possible to obtain unique solutions for unknown parameters of interest in a ...Missing: similarity transformation 1979
[43]
[PDF] USC-SIPI REPORT #140 - System Identification Using Cumulants
A cumulant-based algorithm for the estimation of the matrices of the state-space model is developed. By introducing an unconventional orthogonality condition, a ...Missing: criteria | Show results with:criteria<|control11|><|separator|>
[44]
Differential algebra methods for the study of the structural ... - PubMed
In this paper methods from differential algebra are used to study the structural identifiability of biological and pharmacokinetics models expressed in ...
[45]
A profile likelihood-based workflow for identifiability analysis ...
We present an efficient, unified workflow that addresses parameter identifiability, parameter estimation and model prediction from a likelihood-based ...
[46]
Profile-Wise Analysis: A profile likelihood-based workflow for ...
We present an efficient, unified workflow that addresses parameter identifiability, parameter estimation and model prediction from a likelihood-based ...
[47]
Determination of parameter identifiability in nonlinear biophysical ...
Feb 10, 2014 · A Bayesian approach can be used to determine the reliability of estimated parameters in biophysical models.Results · Bayesian Inference · Kinetic Models<|control11|><|separator|>
[48]
Identifiability and Sensitivity Analysis for Bayesian Parameter ...
Mar 14, 2023 · We recently developed a comprehensive framework for parameter estimation and uncertainty quantification of systems biology models.
[49]
Practical parameter identifiability and handling of censored data with ...
Aug 14, 2024 · Ways to improve identifiability generally include reducing the number of model parameters, collecting and using more data points or over an ...
[50]
The power of identifiability analysis for dynamic modeling in animal ...
Nov 22, 2023 · Structural identifiability analysis aims to assess the possibility of estimating a unique best value of the model parameters from available ...
[51]
DAISY
DAISY (Differential Algebra for Identifiability of SYstems) is a software tool to perform structural identifiability analysis for linear and nonlinear dynamic ...
[52]
Toolbox for structural identifiability analysis in non-stationary 13C ...
Mar 4, 2018 · It is a samll toolbox for structural identifiability analysis in non-stationary 13C labelling experiments. Files in Exe 2 fold need the ...
[53]
Easy parameter identifiability analysis with COPASI - PubMed
Here, we describe a hidden feature of the free modeling software COPASI, which can be exploited to easily and quickly conduct a parameter identifiability ...
[54]
[PDF] Econometric Methodology at the Cowles Commission: Rise and ...
The next ten years may witness a methodological development in this area comparable to the developments of the past decade in the analysis of economic time ...
[55]
[PDF] Reiersøl, Geary and the Idea of Instrumental Variables - CORE
Already in his 1941 paper Reiersøl had referred to results in Ledermann. (1937) which treated the identification of this model. The sequence of identification ...
[56]
[PDF] The Econometrics of Randomized Experiments
Randomized experiments have a long tradition in agricultural and biomedical settings. In eco- nomics they have a much shorter history.
[57]
Structural identifiability of physiologically based pharmacokinetic ...
More complex PBPK models can be considered to consist of subsystems, representing groups of tissues, which are connected in parallel to the central compartment.Missing: example | Show results with:example
[58]
Structural identifiability and indistinguishability of certain ... - PubMed
A two-compartment model is considered where both compartments are observed and where the transfer efflux from the peripheral compartment may take three ...
[59]
Local identifiability for two and three-compartment pharmacokinetic ...
For all two-compartment models we have investigated which kind of parameters or lags are identifiable from amount (Q) or concentration (C) measures.
[60]
Exact parameter identification in PET pharmacokinetic modeling ...
Jul 30, 2024 · Exact parameter identification in PET pharmacokinetic modeling using the irreversible two tissue compartment model
[61]
[2507.04496] Structural Identifiability of Compartmental Models - arXiv
Jul 6, 2025 · We summarize recent progress on the theory and applications of structural identifiability of compartmental models.
[62]
An Identifiable Double VAE For Disentangled Representations
This paper proposes a novel VAE-based generative model with theoretical guarantees on identifiability, using a conditional prior over latents.
[63]
Non-factorised identifiable variational autoencoders for causal ...
Feb 28, 2022 · However, a limitation of the VAE is that it is not identifiable, in the sense that two different sets of parameters may yield the same model.
[64]
[PDF] Identifiability of deep generative models without auxiliary information
We prove identifiability of a broad class of deep latent variable models that (a) have universal approximation capabilities and (b) are the decoders of ...
[65]
Identifiability of Autonomous and Controlled Open Quantum Systems
We unify multiple views of autonomous and controlled open quantum systems and, through considering their measurement dynamics, connect them to classical linear ...
[66]
Experimental graybox quantum system identification and control
Jan 13, 2024 · Here we experimentally demonstrate a 'graybox' approach to construct a physical model of a quantum system and use it to design optimal control.Missing: identifiability | Show results with:identifiability
[67]
Addressing partial identification in climate modeling and policy ...
Part focuses on identification of structural econometric models used to describe human behavior and interactions. Manski (15, 16), Tamer (17), and Molinari (18) ...
[68]
Climate change impacts model parameter sensitivity - HESS
Mar 18, 2021 · In this study we explore the change in parameter sensitivity for the mean discharge and the timing of the discharge, within a plausible climate change rate.<|control11|><|separator|>