Fact-checked by Grok 2 weeks ago

Polynomial chaos

Polynomial chaos expansion (PCE), also known as polynomial chaos, is a spectral method in uncertainty quantification that represents a random variable or stochastic process as an infinite series of orthogonal polynomials evaluated at one or more random variables, enabling the approximation of complex system responses under uncertainty.^[1] This approach leverages the completeness of polynomial bases in the L² space with respect to a probability measure, allowing for the decomposition of stochastic functions into deterministic coefficients and random basis functions.^[2] The concept originated in 1938 with Norbert Wiener's introduction of the homogeneous chaos using Hermite polynomials to model Gaussian stochastic processes, providing a foundational framework for representing random functions in Hilbert spaces.^[3] It gained renewed prominence in engineering applications through the work of Roger G. Ghanem and Pol D. Spanos in 1991, who applied PCE to stochastic finite element methods for analyzing systems with random parameters, such as structural mechanics under uncertain loads.^[4] A significant generalization came in 2002 from Dongbin Xiu and George Em Karniadakis, who extended the basis to the Wiener-Askey scheme, incorporating a family of orthogonal polynomials (e.g., Legendre for uniform distributions, Laguerre for gamma) tailored to various input probability distributions, enhancing flexibility for non-Gaussian uncertainties.^[5] In practice, PCE facilitates non-intrusive (sampling-based, treating models as black boxes) or intrusive (Galerkin projection modifying governing equations) implementations to propagate uncertainties efficiently, computing statistical moments like mean and variance without exhaustive Monte Carlo simulations.^[6] Key advantages include spectral convergence for smooth mappings and curse-of-dimensionality mitigation in low dimensions, though challenges arise with high nonlinearity or discontinuities.^[7] Applications span structural reliability, fluid dynamics, climate modeling, and other fields, where PCE enables surrogate modeling for design optimization.^[8]

Introduction and Fundamentals

Definition and Overview

Polynomial chaos expansion (PCE) represents a random variable or a stochastic process as a series expansion using a complete set of orthogonal polynomials, with the expansion weighted by deterministic coefficients that capture the variability. This approach is grounded in the theory of homogeneous chaos, where "chaos" denotes a mathematically complete orthogonal basis spanning the Hilbert space L^2(\Omega, \mathcal{F}, P) of square-integrable functions on a probability space (\Omega, \mathcal{F}, P), unrelated to the notion of chaotic dynamics in nonlinear systems. PCE builds on foundational concepts from probability theory, where a random variable is a measurable function from the sample space \Omega to the real numbers, and a stochastic process extends this to a parameterized family of random variables, often indexed by time or spatial coordinates. The canonical form of the PCE for a second-order random variable Y: \Omega \to \mathbb{R} is given by

Y(\omega) = \sum_{k=0}^\infty y_k \Psi_k(\xi(\omega)),

where \xi: \Omega \to \mathbb{R}^M is a vector of independent standard random variables serving as the input basis, the \Psi_k are multivariate orthogonal polynomials with respect to the joint probability measure of \xi, and the y_k are deterministic coefficients representing the projection of Y onto each basis function. In practice, the infinite series is truncated to a finite expansion of order P, yielding a polynomial approximant that converges in the L^2 sense as P \to \infty. PCE offers significant advantages in uncertainty quantification, particularly for propagating input uncertainties through complex models while handling high-dimensional parameter spaces more efficiently than traditional Monte Carlo sampling.^[9] By exploiting the orthogonality of the basis, statistical moments such as the mean and variance of the output can be computed directly from the coefficients y_k via simple algebraic formulas, bypassing the need for repeated model evaluations.^[9] This spectral representation also facilitates sensitivity analysis and surrogate modeling for stochastic systems.

Historical Development

The concept of polynomial chaos was first introduced by Norbert Wiener in 1938, who developed the framework of homogeneous chaos using Hermite polynomials to represent Gaussian random processes. In his seminal paper, Wiener expanded nonlinear functionals of Gaussian variables into orthogonal series of Hermite polynomials, laying the foundation for representing stochastic processes through polynomial bases.^[3] This early work was extended by Robert H. Cameron and William T. Martin in 1947, who proved the mean-square convergence of truncated Wiener-Hermite expansions for a broad class of square-integrable functionals of Gaussian processes. Their analysis established the mathematical rigor for practical approximations, demonstrating that the series converges in the L2 sense under suitable conditions. Following a period of limited application, polynomial chaos experienced a revival in the engineering community during the 1990s, notably through the work of Roger G. Ghanem and Pol D. Spanos, who integrated it with finite element methods in their 1991 book on spectral stochastic approaches for uncertainty quantification in structural mechanics. This application-oriented framework popularized polynomial chaos for simulating systems with random coefficients. Building on this momentum, George Em Karniadakis and Dongbin Xiu advanced the theory in the early 2000s by introducing generalized polynomial chaos expansions, which extended the basis beyond Hermite polynomials to other orthogonal families suitable for non-Gaussian distributions, drawing inspiration from the Askey scheme of hypergeometric orthogonal polynomials developed in the 1980s.^[4]^[5] Further evolution in 2012 led to the development of arbitrary polynomial chaos expansions by Sergey Oladyshkin and Wolfgang Nowak, which allow flexible selection of basis functions tailored to empirical data distributions without presupposing specific parametric forms, enhancing adaptability for complex uncertainty modeling.^[10]

Mathematical Foundations

Orthogonal Polynomials and Basis Functions

In polynomial chaos expansions (PCE), the basis functions are multivariate orthogonal polynomials \{\Psi_{\mathbf{\alpha}}(\boldsymbol{\xi})\}, where \boldsymbol{\xi} is a vector of random variables and \mathbf{\alpha} is a multi-index denoting the polynomial degrees. These polynomials are orthogonal with respect to the joint probability measure of \boldsymbol{\xi}, satisfying the condition

\int \Psi_{\mathbf{\alpha}}(\boldsymbol{\xi}) \Psi_{\mathbf{\beta}}(\boldsymbol{\xi}) \, w(\boldsymbol{\xi}) \, d\boldsymbol{\xi} = \gamma_{\mathbf{\alpha}} \delta_{\mathbf{\alpha}\mathbf{\beta}},

where w(\boldsymbol{\xi}) is the weight function corresponding to the probability density function of \boldsymbol{\xi}, \gamma_{\mathbf{\alpha}} > 0 is the normalization constant, and \delta_{\mathbf{\alpha}\mathbf{\beta}} is the Kronecker delta. This orthogonality ensures that the PCE coefficients can be computed efficiently via projections, as the basis functions are uncorrelated under the given measure.^[11] Key properties of these orthogonal polynomials include their satisfaction of three-term recurrence relations, which facilitate numerical generation and evaluation. For univariate polynomials \{\psi_n(\xi)\}, the recurrence typically takes the form \psi_{n+1}(\xi) = (\xi - b_n) \psi_n(\xi) - a_n \psi_{n-1}(\xi), with coefficients a_n, b_n determined by the moments of the distribution. Normalization is achieved such that \gamma_0 = 1 for the constant term, and higher \gamma_n scale with the polynomial degree. Moreover, the set of polynomials is complete in the L^2 space with respect to the measure, meaning any square-integrable function can be represented as a convergent series in this basis. These properties enable stable and accurate approximations in PCE applications.^[11]^[12] The selection of the polynomial family depends on the input random variable's distribution to ensure orthogonality with the appropriate weight function w(\xi). For instance, Hermite polynomials are used for Gaussian distributions with weight w(\xi) = (2\pi)^{-1/2} e^{-\xi^2/2}, while Legendre polynomials suit uniform distributions on [-1, 1] with weight w(\xi) = 1/2. This matching optimizes convergence and computational efficiency, as polynomials from the Askey scheme align well with common probability measures. An important computational feature for certain families, such as Hermite, is the triple product rule, which simplifies moment calculations: \mathbb{E}[\Psi_i \Psi_j \Psi_k] = \delta_{i+j,k} \gamma_k, allowing efficient evaluation of nonlinear terms in projections.^[11]^[12] For multi-dimensional inputs assuming independence across dimensions, the multivariate basis is constructed via the tensor product: \Psi_{\mathbf{\alpha}}(\boldsymbol{\xi}) = \prod_{d=1}^M \psi_{\alpha_d}(\xi_d), where \psi_{\alpha_d} are the univariate polynomials for each dimension d. The normalization then becomes \gamma_{\mathbf{\alpha}} = \prod_{d=1}^M \gamma_{\alpha_d}, preserving orthogonality in the joint space. This construction yields a total of \binom{P+M}{M} basis functions up to total degree P, scaling manageably for moderate dimensions.^[11]

Chaos Expansions and Convergence

Polynomial chaos expansion (PCE) provides a spectral representation for approximating a quantity of interest u(\mathbf{x}, \boldsymbol{\xi}), where \mathbf{x} denotes spatial or temporal variables and \boldsymbol{\xi} represents a vector of random variables, as a truncated series

u(\mathbf{x}, \boldsymbol{\xi}) \approx \sum_{k=0}^{P} u_k(\mathbf{x}) \Psi_k(\boldsymbol{\xi}),

with P+1 terms in the expansion, where the \Psi_k are multivariate orthogonal polynomials and the u_k(\mathbf{x}) are deterministic coefficients depending on the physical model.^[13] This formulation leverages the orthogonality of the basis functions to decompose the random response into modes that capture varying levels of uncertainty.^[13] The coefficients u_k(\mathbf{x}) are obtained via the L^2 projection onto the polynomial basis, given by

u_k(\mathbf{x}) = \frac{\mathbb{E}\left[u(\mathbf{x}, \boldsymbol{\xi}) \Psi_k(\boldsymbol{\xi})\right]}{\mathbb{E}\left[\Psi_k^2(\boldsymbol{\xi})\right]},

where \mathbb{E}[\cdot] denotes the expectation with respect to the joint probability measure of \boldsymbol{\xi}.^[13] This projection ensures that the expansion minimizes the mean-square error for the truncated series.^[13] Under suitable conditions, the PCE converges in the mean-square sense, i.e., \mathbb{E}\left[\left(u - \sum_{k=0}^{P} u_k \Psi_k\right)^2\right]^{1/2} \to 0 as P \to \infty, for square-integrable functions u when using an appropriate orthogonal basis. This result was originally established by Cameron and Martin for the Hermite chaos expansion applied to nonlinear functionals of Gaussian processes. For analytic response functions, the convergence is exponential in the polynomial order P, leading to rapid decay of higher-order coefficients.^[14] The truncation error in PCE decreases monotonically with increasing P, with the rate accelerating for smoother or more regular functions, such that low-order expansions often suffice for practical accuracy in well-behaved problems.^[14] In multi-dimensional settings with d random variables, the full tensor-product basis grows exponentially as (P+1)^d, exacerbating the curse of dimensionality; this is conceptually mitigated by anisotropic tensor products, which assign different orders to each dimension based on sensitivity, or sparse grid approximations that selectively include multi-index terms to reduce the expansion size while maintaining convergence for functions exhibiting low effective dimensionality.^[15]

Types of Polynomial Chaos Expansions

Classical Hermite Polynomial Chaos

The classical Hermite polynomial chaos, also known as the Wiener-Hermite expansion, was introduced by Norbert Wiener in 1938 as a means to represent homogeneous chaos—second-order random variables and processes—using orthogonal expansions tailored to Gaussian probability measures. Specifically, Wiener defined the expansion for functionals of a standard Gaussian random variable ξ distributed as N(0,1), employing probabilists' Hermite polynomials as the basis functions to capture the stochastic structure in L² sense.^[3] The explicit form of the classical expansion for a second-order random variable Y is given by

Y(\xi) = \sum_{n=0}^\infty y_n \mathrm{He}_n(\xi),

where the coefficients y_n are deterministic and computed via projection onto the basis, and the probabilists' Hermite polynomials \mathrm{He}_n(\xi) satisfy the recursive relation \mathrm{He}_0(\xi) = 1, \mathrm{He}_1(\xi) = \xi, and \mathrm{He}_{n+1}(\xi) = \xi \mathrm{He}_n(\xi) - n \mathrm{He}_{n-1}(\xi) for n \geq 1. These polynomials form an orthogonal basis with respect to the Gaussian inner product, satisfying \mathbb{E}[\mathrm{He}_m(\xi) \mathrm{He}_n(\xi)] = n! \delta_{mn}, where the expectation is taken over the standard normal distribution of ξ. This orthogonality enables the coefficients to be isolated as y_n = \frac{\mathbb{E}[Y(\xi) \mathrm{He}_n(\xi)]}{n!}.^[13] In its original formulation, the classical Hermite expansion applies to solutions of Itô stochastic differential equations driven by Gaussian white noise, where the input processes are Gaussian, allowing the output to be represented as a chaos series in multiple integrals equivalent to the Hermite basis. It has also been employed to model Gaussian random fields, such as those encountered in stochastic finite element analyses of structural mechanics problems with uncertain material properties or loading conditions modeled as Gaussian processes.^[4] Despite its foundational role, the classical Hermite polynomial chaos is inherently limited to inputs following Gaussian distributions, as the Hermite basis is optimal only for such measures; for heavy-tailed or non-Gaussian distributions, the expansion exhibits slow convergence and numerical instability.^[13]

Generalized Polynomial Chaos

Generalized polynomial chaos (gPC) extends the classical polynomial chaos expansion by employing orthogonal polynomials from the Askey scheme, tailored to the probability density functions (PDFs) of non-Gaussian input random variables. Introduced by Xiu and Karniadakis in 2002, this framework allows for the selection of basis functions that match the statistical properties of the inputs, such as uniform, beta, or gamma distributions, thereby improving the representation of uncertainty in stochastic systems.^[13] Unlike the Hermite-based approach limited to Gaussian processes, gPC provides a unified hierarchy of expansions where the choice of polynomials ensures orthogonality with respect to the target measure, facilitating efficient Galerkin projections for solving stochastic differential equations.^[13] Specific polynomial families are chosen based on the input distributions: Legendre polynomials for uniform distributions over [-1, 1], Jacobi polynomials for beta distributions, and Laguerre polynomials for gamma distributions. This matching enhances convergence properties, particularly for bounded or positive variables, where classical Hermite expansions may require higher degrees for accuracy. Additionally, gPC offers explicit rules for computing statistical moments of the output, such as means and variances, directly from the expansion coefficients, simplifying uncertainty quantification.^[13] In multi-dimensional problems with M independent random variables, the gPC expansion up to polynomial degree p involves P = \frac{(p + M)!}{p! \, M!} basis terms, forming a complete orthogonal basis in the tensor product space. For the Legendre case, the univariate polynomials \Psi_n(\xi) are defined via the Rodrigues formula:

\Psi_n(\xi) = \frac{1}{2^n n!} \frac{d^n}{d\xi^n} \left[ (\xi^2 - 1)^n \right],

or equivalently through the three-term recurrence relation:

(n+1) \Psi_{n+1}(\xi) = (2n + 1) \xi \Psi_n(\xi) - n \Psi_{n-1}(\xi),

with \Psi_0(\xi) = 1 and \Psi_1(\xi) = \xi, ensuring normalization under the uniform measure. These constructions enable robust approximations for a wide range of stochastic models.^[13]

Arbitrary Polynomial Chaos

Arbitrary polynomial chaos (aPC) emerged in the 2000s as a flexible extension of polynomial chaos expansions, enabling the construction of orthogonal polynomial bases numerically for arbitrary probability distributions without relying on predefined analytical forms. This approach, particularly through Gram-Schmidt orthogonalization applied to samples drawn from the target distribution, allows for tailored bases that respect the underlying statistics, including higher-order moments up to the desired polynomial degree. A key advantage of aPC is its ability to handle complex input distributions—such as empirical data, discrete measures, or even dependent random variables—without requiring explicit weight functions or parametric assumptions about the probability density. For dependent inputs, joint samples can be used to compute the necessary inner products, accommodating correlations via the full multivariate measure.^[16] This makes aPC particularly suitable for real-world scenarios where inputs follow non-standard or data-driven distributions, such as those modeled with copulas to capture nonlinear dependencies. The procedure for constructing an aPC basis begins with generating a set of N samples \{\xi^{(l)}\}_{l=1}^N from the target distribution. These samples approximate the expectation operator through Monte Carlo integration, yielding inner products for orthogonalization as follows:

\mathbb{E}[\phi_i(\xi) \phi_j(\xi)] \approx \frac{1}{N} \sum_{l=1}^N \phi_i(\xi^{(l)}) \phi_j(\xi^{(l)})

Starting from a set of trial polynomials (e.g., monomials), the Gram-Schmidt process iteratively orthogonalizes them with respect to this empirical measure, producing an orthonormal basis \{\phi_k(\xi)\} up to the chosen degree. For example, in cases of empirical distributions derived from limited observations, the basis adapts directly to the sample statistics, while for copula-based joint distributions, samples from the copula-transformed marginals ensure the basis aligns with the induced dependence structure. Despite these benefits, aPC involves trade-offs, including elevated computational demands for basis generation due to the need for large sample sizes to accurately estimate moments and inner products. Additionally, the Gram-Schmidt procedure can lead to ill-conditioned bases, especially for high dimensions or sparse data, potentially amplifying numerical errors in subsequent expansions.^[17] Techniques like resampling (e.g., bootstrapping) can mitigate robustness issues from finite samples, but careful dimensioning of N relative to the polynomial order remains essential.

Computational Implementation

Intrusive Methods

Intrusive methods for polynomial chaos expansions (PCE) involve directly incorporating the uncertainty representation into the governing equations by projecting them onto the chosen orthogonal polynomial basis, typically requiring modifications to the model's source code. These techniques derive PCE coefficients by enforcing orthogonality conditions on the residual of the equations, enabling the solution of a coupled system that captures stochastic dependencies. Unlike sampling-based approaches, intrusive methods leverage the structure of the basis functions to compute expectations analytically or via quadrature, leading to augmented deterministic systems.^[18] The primary intrusive approach is the Galerkin projection, where the residual of the governing equation is orthogonalized with respect to each basis function in the PCE. For a stochastic differential operator L applied to the solution u(\mathbf{x}, \boldsymbol{\xi}), expanded as u(\mathbf{x}, \boldsymbol{\xi}) = \sum_{k=0}^P u_k(\mathbf{x}) \Psi_k(\boldsymbol{\xi}), the projection yields a linear system A \mathbf{u} = \mathbf{f}, with entries A_{ij} = \mathbb{E}[\Psi_i L(\Psi_j)] and forcing terms involving expectations over the basis. This formulation, introduced for generalized PCE, results in a block system where each block corresponds to a deterministic solve coupled across stochastic modes.^[5] A variant, the pseudo-spectral method, approximates derivatives and nonlinear terms in the projected equations by evaluating at the roots of the orthogonal polynomials, facilitating efficient computation of the Galerkin integrals without full quadrature rules. This collocation-like strategy within the intrusive framework exploits the spectral properties of the basis for differentiation matrices, reducing computational overhead in moderate dimensions while maintaining projection accuracy.^[19] In the stochastic finite element method (SFEM), intrusive PCE integrates with deterministic finite element discretizations by expanding both spatial and stochastic dimensions, yielding a Kronecker product structure for the stiffness and mass matrices. Originating from spectral representations in random media, SFEM projects the weak form onto the chaos basis, solving an enlarged deterministic system that propagates uncertainties through the mesh. Intrusive methods offer high accuracy for linear problems, where the PCE exactly represents polynomial responses up to the basis degree, and provide exponential convergence in smooth cases due to the spectral nature of the projection. However, they face challenges such as the curse of dimensionality from tensor-product bases in high stochastic dimensions, leading to exponential growth in system size, and necessitate intrusive access to the model equations for reformulation.^[18]

Non-Intrusive Methods

Non-intrusive methods for polynomial chaos expansions (PCE) treat the underlying computational model as a black box, avoiding any modification to the model's governing equations. Instead, they rely on repeated evaluations of the model at selected points in the random space to estimate the PCE coefficients, making them particularly suitable for integration with existing simulation codes. These approaches contrast with intrusive methods, such as Galerkin projection, by using sampling-based techniques like regression or collocation to approximate the chaos expansion without deriving new equations.^[20] The regression or least-squares method formulates the PCE coefficient estimation as an optimization problem that minimizes the squared error between the model output and its polynomial approximation over a set of samples. Consider a quantity of interest u(\boldsymbol{\xi}) expanded as \hat{u}(\boldsymbol{\xi}) = \sum_{k=0}^{P} c_k \Psi_k(\boldsymbol{\xi}), where \{\Psi_k\} are orthogonal basis polynomials and P+1 is the number of terms in the truncated expansion. Given N samples \{\boldsymbol{\xi}^{(i)}, u^{(i)}\}_{i=1}^N, the problem is to solve \min_{\mathbf{c}} \|\mathbf{u} - \boldsymbol{\Psi} \mathbf{c}\|_2^2, where \mathbf{u} = [u^{(1)}, \dots, u^{(N)}]^T and \boldsymbol{\Psi} is the N \times (P+1) matrix with entries \Psi_{ij} = \Psi_j(\boldsymbol{\xi}^{(i)}). The solution is obtained via the normal equations: \hat{\mathbf{c}} = (\boldsymbol{\Psi}^T \boldsymbol{\Psi})^{-1} \boldsymbol{\Psi}^T \mathbf{u}, assuming \boldsymbol{\Psi}^T \boldsymbol{\Psi} is invertible. For weighted least squares, a diagonal weight matrix incorporating the joint probability density can improve stability. This method requires an oversampling ratio N / (P+1) \gtrsim 2 to ensure numerical stability and reduce ill-conditioning, particularly in high dimensions. Collocation methods in non-intrusive PCE evaluate the model at specific collocation points to directly interpolate or project onto the polynomial basis. In point-collocation non-intrusive PCE (NIPC), the coefficients are found by solving the linear system \boldsymbol{\Psi} \boldsymbol{\alpha} = \mathbf{u}^* at M = P+1 or more collocation points \boldsymbol{\xi}^{(i)}, where \mathbf{u}^* contains the model evaluations and \boldsymbol{\alpha} are the coefficients; oversampling (M > P+1) enhances accuracy. Collocation points are often chosen as roots of orthogonal polynomials or via Latin hypercube sampling. Alternatively, non-intrusive spectral projection approximates the projection integrals c_k = \frac{\langle u, \Psi_k \rangle}{\langle \Psi_k^2 \rangle} = \int u(\boldsymbol{\xi}) \Psi_k(\boldsymbol{\xi}) \rho(\boldsymbol{\xi}) \, d\boldsymbol{\xi} using quadrature rules, such as tensor-product Gauss quadrature with (p+1)^n points for polynomial order p and n dimensions, or sparse grids like Smolyak constructions to mitigate the curse of dimensionality by requiring approximately O(m^n (\log m)^{n-1}) evaluations for level m. These methods yield analytic expressions for statistical moments, such as the mean \mathbb{E} = c_0 and variance \mathrm{Var} = \sum_{k=1}^P c_k^2 \langle \Psi_k^2 \rangle.^[20] Monte Carlo sampling supports non-intrusive PCE by providing unbiased estimates of the projection coefficients through empirical quadrature: c_k \approx \frac{1}{N} \sum_{i=1}^N u(\boldsymbol{\xi}^{(i)}) \Psi_k(\boldsymbol{\xi}^{(i)}) / \langle \Psi_k^2 \rangle, where \boldsymbol{\xi}^{(i)} are drawn from the input distribution. This approach is straightforward for moment computation post-expansion, with \mathbb{E} \approx \frac{1}{N} \sum_{i=1}^N u(\boldsymbol{\xi}^{(i)}) and higher moments derived similarly, but it converges slowly (O(1/\sqrt{N})) compared to quadrature-based methods. It is often combined with variance reduction techniques like Latin hypercube sampling for efficiency in high-variance problems.^[15]^[15] Non-intrusive methods offer significant advantages, including seamless integration with legacy or proprietary simulation codes that cannot be altered, and applicability to non-polynomial or complex models where intrusive projection is infeasible. They enable rapid uncertainty quantification with computational costs scaling favorably for moderate dimensions, typically requiring hundreds to thousands of model evaluations depending on the expansion order and sampling strategy. However, they can suffer from instability in high dimensions without proper oversampling or regularization.^[21]

Applications and Extensions

Uncertainty Quantification in Engineering

Polynomial chaos expansions (PCE) are widely applied in engineering to quantify and propagate uncertainties in physical systems governed by partial differential equations (PDEs), such as those modeling fluid dynamics, structural mechanics, and heat transfer, where parameters like material properties or external loads exhibit randomness.^[22] By representing solution quantities as series expansions in terms of orthogonal polynomials adapted to the input probability distributions, PCE enables efficient forward uncertainty propagation without requiring repeated full simulations for each realization.^[23] This approach is particularly valuable in engineering contexts where computational resources are limited, allowing for the assessment of how uncertainties in inputs affect outputs like stress distributions or flow velocities.^[24] In the context of stochastic PDEs, PCE is employed to solve equations with random coefficients, such as diffusion equations where the diffusivity represents uncertain material properties. For instance, the steady-state diffusion equation \nabla \cdot (k(\mathbf{x}, \xi) \nabla u(\mathbf{x}, \xi)) = f(\mathbf{x}), with random field k(\mathbf{x}, \xi) expanded via Karhunen-Loève decomposition, is approximated by a PCE of the solution u(\mathbf{x}, \xi) \approx \sum_{i=0}^{P} u_i(\mathbf{x}) \Psi_i(\xi), where \Psi_i are orthogonal basis functions.^[22] This Galerkin projection yields a system of deterministic PDEs for the coefficients u_i, facilitating the quantification of output statistics like mean temperature fields under uncertain conductivity.^[25] Such applications are common in thermal engineering, where random boundary conditions or source terms further complicate the problem.^[26] Sensitivity analysis in engineering PCE applications often leverages Sobol indices derived directly from expansion coefficients to identify dominant uncertainty sources. The first-order Sobol index for input variable \xi_i is given by S_i = \frac{\mathrm{Var}[ \mathbb{E}(u | \xi_i) ]}{\mathrm{Var}} , computed as the sum of squared coefficients corresponding to basis terms involving only \xi_i, normalized by the total variance from Parseval's identity.^[23] This post-processing step, requiring no additional simulations, has been applied to rank parameters in structural reliability studies. For reliability assessment, PCE supports the estimation of failure probabilities in engineering systems by approximating the tail of the output distribution. The expansion allows Monte Carlo integration over the surrogate model to compute P(g(u) < 0), where g defines the failure event, often using adaptive sampling to refine low-probability tails.^[27] In structural engineering, this has enabled efficient evaluation of collapse risks under uncertain loads, outperforming direct Monte Carlo by orders of magnitude in computational cost.^[28] Representative case studies highlight PCE's engineering impact in areas such as aeroelasticity, heat transfer, and wind turbine reliability. To enhance efficiency in high-fidelity engineering simulations, PCE is often combined with multi-fidelity models, where low-fidelity data corrects high-fidelity expansions via regression-based corrections. Non-intrusive PCE implementations, as detailed in computational sections, facilitate this integration by sampling existing simulation ensembles.^[29]

Financial and Physical Modeling

In financial modeling, polynomial chaos expansions (PCE) provide a spectral method for uncertainty quantification in option pricing under stochastic volatility, offering computational efficiency over Monte Carlo simulations in Black-Scholes variants. By expanding the solution in terms of orthogonal polynomials adapted to the input uncertainties, PCE enables surrogate models that approximate price distributions rapidly, particularly for high-dimensional stochastic volatility processes like those in Heston models. For example, generalized PCE has been used to compute European option prices under additive and multiplicative uncertainties, achieving accuracy comparable to Monte Carlo while reducing variance through post-processing of chaos coefficients.^[30] This approach facilitates the evaluation of Greeks and path-dependent options by propagating volatility randomness via non-intrusive projection.^[31] PCE also supports risk metrics such as Value-at-Risk (VaR) in finance by deriving quantile approximations from the expanded probability density, allowing for efficient estimation of tail risks in portfolios with uncertain returns. In portfolio optimization, PCE quantifies market uncertainties by constructing surrogate models for objective functions, enabling robust optimization under stochastic constraints like correlated asset volatilities; for instance, it has been applied to minimize variance while maximizing expected returns in multi-asset settings.^[32] Recent extensions incorporate bi-fidelity PCE for conditional VaR, combining low- and high-fidelity simulations to handle limited data in dynamic risk assessment.^[33] In physical modeling, PCE addresses uncertainties in quantum mechanics by expanding wave functions for the Schrödinger equation with random potentials, capturing non-Gaussian features of disordered systems through generalized bases. This method simulates stochastic quantum trajectories efficiently, as demonstrated in applications to driven quantum systems where classical noise affects coherence.^[34] For climate modeling, PCE propagates uncertain parameters in general circulation models (GCMs) via sparse adaptive expansions that reduce computational cost while preserving sensitivity to key variables. Beyond these, PCE integrates with machine learning for dimension reduction in high-dimensional physical and financial systems, where manifold learning identifies low-dimensional embeddings of stochastic inputs before chaos expansion, enhancing scalability for turbulent flows under non-Gaussian noise. In such flows, PCE models the evolution of non-Gaussian random fields over long times, approximating invariant measures for quantities like velocity variances without assuming Gaussianity.^[35] This hybrid approach, combining PCE with deep adaptive techniques, has improved uncertainty propagation in complex simulations by adaptively selecting polynomial bases from data-driven subspaces.^[36]

Advanced Topics

Handling Incomplete Statistical Information

In polynomial chaos expansions (PCE), full knowledge of the underlying probability distributions is often assumed for constructing orthogonal bases, but real-world applications frequently encounter incomplete statistical information, such as only moments (e.g., mean and variance) or sparse data samples being available. Adaptations address this by deriving bases from partial knowledge or employing robust techniques to propagate uncertainties without assuming complete distributions. These methods ensure reliable uncertainty quantification (UQ) in scenarios like engineering systems where data collection is costly or limited.^[37] Moment-based PCE constructs orthogonal polynomial bases using the maximum entropy principle to infer the least-informative probability distribution consistent with known moments, such as the first two (mean and variance), thereby enabling expansion even without explicit density functions.^[38] This approach maximizes the entropy subject to moment constraints, yielding distributions like Gaussian for second-order moments, which then define the chaos polynomials orthogonal with respect to that measure. Seminal work in structural reliability formalized the use of maximum entropy for incomplete probability information, providing bounds on failure probabilities by optimizing over all distributions matching the given moments.^[37] For partial samples, polynomial surrogate models in PCE are fitted using non-intrusive regression or interpolation on limited data, effectively handling "bounded rationality" scenarios where decision-makers or models operate with incomplete observations, as seen in heterogeneous agent economic simulations.^[39] Recent data-driven extensions mitigate issues in sparse regimes by regularizing high-order expansions to avoid overfitting, improving accuracy in UQ for systems with scarce measurements, such as reliability analysis under data limitations.^[40] These techniques prioritize low-order terms or ensemble methods to capture essential variability without requiring full distributional knowledge.^[40] Robust propagation addresses epistemic uncertainties by treating PCE coefficients as intervals and applying interval arithmetic to compute worst-case bounds on outputs, avoiding probabilistic assumptions altogether.^[41] This method extends standard PCE by enclosing the expansion within interval bounds, enabling conservative uncertainty estimates for nonlinear systems like multibody dynamics, where input parameters have known ranges but unknown distributions.^[42] In structural reliability examples with partial information, such as loads with only variance known, moment-based bounds via maximum entropy demonstrate how partial information suffices for practical risk assessment without over-reliance on unverified assumptions.^[37]

Bayesian Polynomial Chaos

Bayesian polynomial chaos expansion (BPCE) extends the standard polynomial chaos framework by treating the expansion coefficients as random variables with specified prior distributions, enabling probabilistic inference over the surrogate model parameters. This approach leverages Bayes' theorem to update the priors into posteriors based on observed data, such as model evaluations or measurements, thereby quantifying uncertainty in the coefficients themselves. Typically, independent Gaussian priors are assigned to each coefficient u_k \sim \mathcal{N}(0, \sigma_k^2), where the variance \sigma_k^2 can be tuned based on the polynomial degree or interaction level to encourage sparsity. The likelihood p(\mathbf{y} | \mathbf{u}) is derived from the squared residuals between observed outputs \mathbf{y} and the PCE predictions, assuming additive Gaussian noise.^[43]^[44] The posterior distribution is given by

p(\mathbf{u} | \mathbf{y}) \propto p(\mathbf{y} | \mathbf{u}) \, p(\mathbf{u}),

which is often analytically intractable and approximated using sampling or optimization methods. Markov chain Monte Carlo (MCMC) techniques, such as adaptive Hamiltonian Monte Carlo implemented in tools like Stan, are commonly employed for posterior sampling, providing credible intervals for coefficients and predictions even in high-dimensional settings. Alternatively, variational Bayesian methods or Laplace approximations can be used for faster inference, though they may sacrifice some accuracy in uncertainty quantification. Shrinkage priors, like the R2D2 prior, further enhance sparsity by combining global shrinkage (via a Beta-distributed R^2) with local adaptation through a Dirichlet-distributed scale parameter, allowing effective modeling with limited data points. Recent advancements as of 2024 integrate BPCE with deep learning for scalable high-dimensional UQ.^[43]^[44]^[45]^[46] Hierarchical Bayesian models in BPCE extend this framework by incorporating uncertainty in both input parameters and output quantities jointly, treating the input distribution as part of the inference process. For instance, hyperpriors on the input variances or coefficient covariances enable the model to adapt to incomplete knowledge of the input statistics, with the joint posterior sampled via MCMC to propagate uncertainties through the hierarchy. This is particularly useful in scenarios where inputs and outputs are interdependent, such as in dynamic systems.^[45]^[47] BPCE offers key advantages over deterministic coefficient estimation methods, such as least-squares regression, by explicitly quantifying epistemic uncertainty in the coefficients and handling noisy or sparse data without overfitting. For example, MCMC-based BPCE has demonstrated robustness to observation noise levels up to 50% of the signal variance on benchmark functions like Ishigami, yielding lower root-mean-square errors than non-Bayesian sparse PCE while providing full posterior distributions. Post-2015 developments, including integrated MCMC for high-dimensional problems, have improved scalability, with applications showing sparsity indices as low as 0.06 using only 100 training points.^[44]^[43]

Non-Linear Prediction Frameworks

Polynomial chaos expansions (PCE) serve as effective surrogate models for non-linear prediction tasks by constructing high-order polynomial approximations that map uncertain inputs to output predictions, enabling efficient evaluation of complex stochastic systems without repeated simulations of the underlying model.^[48] This approach leverages orthogonal polynomial bases to represent non-linear functionals, capturing dependencies that linear approximations cannot, and is particularly valuable in scenarios where computational cost limits direct Monte Carlo sampling.^[39] In non-linear uncertainty propagation, higher-order terms in PCE expansions are crucial for modeling interactions among random variables that linear methods overlook, allowing accurate quantification of variance and higher moments in systems exhibiting strong non-linearities, such as orbital mechanics or fluid dynamics.^[49] For instance, these terms enable the propagation of non-Gaussian uncertainties through non-linear dynamics, providing more reliable predictions of tail risks compared to perturbation-based techniques.^[50] For time-series prediction, PCE integrates with autoregressive (AR) models to handle uncertain parameters, forming polynomial chaos ARX (PC-ARX) frameworks that predict future states while propagating parameter uncertainties through the series.^[51] This is extended to ensemble forecasting, where PCE generates diverse prediction ensembles from random initial conditions, improving reliability in dynamic systems.^[52] Recent advancements in the 2020s have applied PCE to chaotic systems prediction, enhancing uncertainty quantification for time-averaged quantities in highly sensitive environments like turbulent flows, where sensitivity-enhanced generalized PCE outperforms traditional methods in capturing chaotic variability.^[53] A representative example is weather forecasting, where PCE quantifies the growth of uncertainty from random initial conditions in ensemble prediction systems, aiding in probabilistic nowcasting and reducing forecast errors in atmospheric models.^[52]

References

[1]
Polynomial Chaos Expansion - Uncertainty Quantification
Polynomial chaos expansion (PCE) is a statistical method for approximating the output of a complex system as a sum of orthogonal polynomials with random ...
[2]
https://ethz.ch/content/dam/ethz/special-interest/baug/ibk/risk-safety-and-uncertainty-dam/news/Documents/PCE_Sudret(ncmdao).pdf
[3]
[PDF] The Homogeneous Chaos Author(s): Norbert Wiener Source
The Homogeneous Chaos. Author(s): Norbert Wiener. Source: American Journal of Mathematics, Vol. 60, No. 4 (Oct., 1938), pp. 897-936. Published by: The Johns ...
[4]
Stochastic Finite Elements: A Spectral Approach - SpringerLink
This monograph considers engineering systems with random parame ters. Its context, format, and timing are correlated with the intention of accelerating the ...
[5]
Polynomial Chaos Methods
INTRODUCTION. Polynomial Chaos (PC) expansions [Weiner38] have risen as efficient means of representing stochastic processes with the intention of quantifying ...
[6]
[PDF] Polynomial chaos expansions part I: Method Introduction - SINTEF
Polynomial chaos expansions part I: Method. Introduction. Jonathan Feinberg and Simen Tennøe. Kalkulo AS. January 27, 2015. Page 2. Lectures will include ...
[7]
[PDF] Polynomial Chaos - ISRL
What is polynomial chaos theory? It provides a non-sampling based method to determine evolution of uncertainty in dynamical system, when there is ...<|control11|><|separator|>
[8]
[PDF] Uncertainty propagation using polynomial chaos expansions
Computational models are used: • Together with experimental data for calibration purposes. • To explore the design space (“virtual prototypes”).
[9]
The Wiener--Askey Polynomial Chaos for Stochastic Differential ...
We present a new method for solving stochastic differential equations based on Galerkin projections and extensions of Wiener's polynomial chaos.
[10]
[PDF] Modeling Uncertainty in Steady State Diffusion Problems via ... - DTIC
Jul 25, 2002 · Modeling Uncertainty in Steady State Diffusion Problems via Generalized Polynomial Chaos. Dongbin Xiu and George Em Karniadakis ∗. Division ...
[11]
https://sites.brown.edu/crunch-group/files/2022/05/Modeling-Uncertainty-in-Steady-State-Diffusion.pdf
[12]
[PDF] the wiener–askey polynomial chaos for stochastic differential ...
We propose an Askey scheme-based polynomial chaos expansion for stochastic processes, which includes all the orthogonal polynomials in the above list. We ...<|control11|><|separator|>
[13]
[PDF] Modeling uncertainty in flow simulations via generalized polynomial ...
Cameron, W.T. Martin, The orthogonal development of nonlinear functionals in series of Fourier– Hermite functionals,. Ann. Math. 48 (1947) 385. [24] R.G. ...<|control11|><|separator|>
[14]
[PDF] Recent Advances in Non-Intrusive Polynomial Chaos and Stochastic ...
Whereas an isotropic tensor-product quadrature scales as mn, an isotropic sparse grid scales as mlog n, significantly mitigating the curse of dimensionality.
[15]
Arbitrary Polynomial Chaos for Uncertainty Propagation of ...
Aug 10, 2025 · A third approach for PCE construction, first introduced in Oladyshkin and Nowak (2012) ... polynomial chaos expansions. Conference Paper. Dec 2012.
[16]
Modeling Arbitrary Uncertainties Using Gram-Schmidt Polynomial ...
Modeling Arbitrary Uncertainties Using Gram-Schmidt Polynomial Chaos ... However, this procedure is known to produce quite ill-conditioned matrices ...
[17]
Review of Polynomial Chaos-Based Methods for Uncertainty ... - MDPI
In general, there are two possible strategies to compute the PC coefficients for a specific application at hand: intrusive or nonintrusive approaches. The first ...
[18]
[PDF] Intrusive Polynomial Chaos for CFD using OpenFOAM
There are two methods to determine the expansion coefficients, namely, the Intrusive Polynomial Chaos (IPC) and the. Non-intrusive Polynomial Chaos (NIPC).
[19]
https://www.iccs-meeting.org/archive/iccs2020/papers/121430649.pdf
[20]
https://doi.org/10.1137/070680540
[21]
[PDF] Polynomial Chaos Expansion of random coefficients and the ... - arXiv
Mar 11, 2015 · Keywords: uncertainty quantification, polynomial chaos expansion, Karhunen-Loève ex- pansion, stochastic Galerkin, tensor product methods ...
[22]
Review Global sensitivity analysis using polynomial chaos expansions
The paper introduces generalized polynomial chaos expansions (PCE) to build surrogate models that allow one to compute the Sobol' indices analytically.
[23]
[PDF] solving stochastic pdes using fenics and uqtk - arXiv
Sep 19, 2022 · ... uncertainty quantification (UQ) of stochastic partial differential equations (PDEs) [2, 3]. The SSFEM is based on polynomial chaos expansion ...<|separator|>
[24]
[PDF] Modeling uncertainty in three-dimensional heat transfer problems
We present a generalized polynomial chaos method to solve the steady and unsteady heat transfer problems with uncertainty in boundary con- ditions, diffusivity ...
[25]
A new stochastic approach to transient heat conduction modeling ...
We present a generalized polynomial chaos algorithm for the solution of transient heat conduction subject to uncertain inputs, i.e. random heat conductivity ...Introduction · The Karhunen--Loeve... · Governing Equations And...<|separator|>
[26]
Sensitivity Analysis Based on Polynomial Chaos Expansions and Its ...
Jan 23, 2019 · In this paper, polynomial chaos expansions (PCE) with less computational cost are chosen to directly obtain Sobol′ global sensitivity indices ...
[27]
Polynomial chaos in evaluating failure probability: A comparative study
Dec 3, 2018 · The aim of this paper is to review and compare available techniques for both the construction of polynomial chaos and its use in computing ...
[28]
Active learning polynomial chaos expansion for reliability analysis ...
Mar 25, 2020 · In this paper, active learning polynomial chaos expansion (PCE) is developed for reliability analysis. The proposed method firstly assigns a ...
[29]
[PDF] Uncertainty Quantification of a Nonlinear Aeroelastic System Using ...
Jul 9, 2013 · In the present study, we have performed a Gauss–Hermite quad- rature based polynomial chaos expansion for two-random variable cases. The ...
[30]
[PDF] Polynomial Chaos-Kriging metamodel for quantification of the ... - HAL
May 13, 2021 · use of a metamodel obtained from the Polynomial Chaos-Kriging method (PC-Kriging). The investigation seeks to quantify the severity of the ...Missing: post- | Show results with:post-
[31]
Multi-fidelity non-intrusive polynomial chaos based on regression
We present a multi-fidelity (MF) extension of non-intrusive polynomial chaos based on regression for uncertainty quantification purposes. •. The proposed method ...
[32]
Multifidelity Uncertainty Quantification Using Non-Intrusive ...
Efficient aerodynamic analysis and optimization under uncertainty using multi-fidelity polynomial chaos-Kriging surrogate model. 1 Oct 2022 | Computers ...
[33]
[PDF] arXiv:2202.07378v1 [q-fin.MF] 15 Feb 2022
Feb 15, 2022 · The outline of the article is as follows: After introducing gPC to finitely many random variables, a method of fitting the stochastic volatility ...
[34]
[PDF] Asymptotic expansion for some local volatility models arising in ...
with stochastic volatility and general jumps terms. ... Polynomial Chaos Expansion approach. We would ... applied to option pricing, Stat. Inference ...
[35]
[PDF] Stochastic Optimization using Polynomial Chaos Expansions
Sep 18, 2020 · Polynomial chaos methods involve the expansion of the stochastic variable of interest using an orthogonal basis associated with the underlying ...
[36]
[PDF] Title of paper - arXiv
Keywords: Risk measures, conditional value-at-risk, generalized polynomial chaos expansion, ... (CVaR) reflects the mean or average size of losses exceeding the ...
[37]
[PDF] arXiv:1209.3289v2 [quant-ph] 13 Dec 2013
Dec 13, 2013 · grating the Schrödinger equation for each trajectory, and av- ... Known as the polynomial chaos expansion (PCE) [7, 8], this method ...
[38]
[PDF] Sensitivity-enhanced generalized polynomial chaos for efficient ...
Jun 30, 2022 · Iskandarani, A priori testing of sparse adaptive polyno- mial chaos expansions using an ocean general circulation model database,. Computational ...
[39]
[PDF] Improving the quasi-biennial oscillation via a surrogate-accelerated ...
Mar 11, 2025 · Exploring alternative predictive models, such as polynomial chaos expansion (Sargsyan et al., 2014) or neural networks (Diaz-Ibarra et al.,.
[40]
[PDF] A dynamical polynomial chaos approach for long-time evolution of ...
Dec 14, 2016 · Compute the indices used in the triple-product formula (3.14). Compute moments of ξ0 for each time-step tj do apply the KL expansion to uj ...
[41]
[PDF] Manifold learning-based polynomial chaos expansions for high ...
Jul 21, 2021 · Nonlinear dimension reduction, also known as manifold learning is ... Uncertainty propagation in CFD using polynomial chaos decomposition.
[42]
Page not found | ScienceDirect
**Summary:**
[43]
Structural Reliability under Incomplete Probability Information | Journal of Engineering Mechanics | Vol 112, No 1
### Summary of Structural Reliability under Incomplete Probability Information
[44]
[PDF] UC Berkeley - eScholarship
Structural reliability under incomplete probability information. Permalink https://escholarship.org/uc/item/3739w8d3. Authors. Der Kiureghian, Armen. Liu, Pei- ...
[45]
Polynomial Chaos Expansion: Efficient Evaluation and Estimation of ...
Jan 23, 2025 · We apply Polynomial chaos expansion (PCE) to surrogate time-consuming repeated model evaluations for different parameter values.<|control11|><|separator|>
[46]
[PDF] Consistency regularization-based Deep Polynomial Chaos Neural ...
Incomplete statistical information limits the utility of high-order polynomial chaos expansions. Reliability Engineering & System Safety. 2018;169:137-48 ...
[47]
An interval uncertainty propagation method using polynomial chaos ...
This paper is devoted to the construction of a nonintrusive interval uncertainty propagation approach for the response bounds evaluation of multibody ...
[48]
[PDF] Approximate Interval Method for Epistemic Uncertainty Propagation ...
Abstract—The paper builds upon a recent approach to find the approximate bounds of a real function using Polynomial. Chaos expansions.
[49]
[PDF] Bayesian sparse polynomial chaos expansion for global sensitivity ...
Feb 25, 2017 · In the present article, sparse polynomial chaos expansions are in- vestigated for global sensitivity analysis of computer model responses. A new.
[50]
[PDF] A fully Bayesian sparse polynomial chaos expansion approach with ...
May 15, 2023 · In these benchmarks, we employ the arbitrary polynomial chaos (aPC) generalization of the conventional PCE. The aPC satisfies orthonormality in ...
[51]
Sequential Bayesian Polynomial Chaos Model Selection for ...
This paper proposes a sequential Bayesian approach that incorporates the effect sparsity and hierarchy principles to identify sparse polynomial chaos metamodels ...
[52]
[PDF] Polynomial-Chaos-Based Bayesian Approach for State and ...
The main principle of the PC approach is to expand random variables using polynomial basis functions that are orthogonal with respect to the PDF of the ...
[53]
Physics-constrained polynomial chaos expansion for scientific ...
We present a novel physics-constrained polynomial chaos expansion as a surrogate modeling method capable of performing both scientific machine learning (SciML)
[54]
Nonlinear Propagation of Orbit Uncertainty Using Non-Intrusive ...
This paper demonstrates the use of polynomial chaos expansions for the nonlinear, non-Gaussian propagation of orbit state uncertainty.
[55]
Stochastic Solution for Uncertainty Propagation in Nonlinear ...
This paper presents a stochastic approach to describe input uncertainties and their propagation through the nonlinear shallow-water equations.<|control11|><|separator|>
[56]
[PDF] Metamodeling of structural systems through polynomial chaos ARX ...
The random ARX model parameters are expanded onto a Polynomial Chaos (PC) basis and thus the resulting PC-ARX model is fully described through deterministic ...
[57]
Polynomial Chaos Quantification of the Growth of Uncertainty ...
Cameron, R., and Martin W. , 1947: The orthogonal development of nonlinear functionals in series of Fourier–Hermite functionals. Ann. Math., 48 , 385–392 ...<|control11|><|separator|>
[58]
Uncertainty quantification of time-average quantities of chaotic ...
We employ the recently proposed sensitivity-enhanced generalized polynomial chaos expansion, se-gPC, to quantify efficiently this effect.