Fact-checked by Grok 2 weeks ago

Activation

Activation is the process of making a substance, system, or entity active, functional, or reactive, typically by applying energy, a stimulus, or specific conditions to initiate a change or response. This concept spans multiple disciplines, encompassing the excitation of molecules for reactions, the stimulation of biological processes, the arousal of mental states, and the enabling of computational elements in artificial intelligence.^[1]^[2] In chemistry, activation primarily denotes the overcoming of an energy barrier known as activation energy, which is the minimum amount of energy required to convert reactants into products by reaching a transition state. This threshold determines the rate of chemical reactions, with higher activation energies leading to slower reactions unless lowered by catalysts such as enzymes.^[3]^[4] In biology and immunology, activation refers to the initiation of cellular or molecular functions, such as the conversion of inactive enzymes into active forms through modifications like phosphorylation, or the triggering of immune responses where T cells become activated upon recognizing antigens presented by antigen-presenting cells. This process is crucial for immune defense, enabling clonal expansion and effector functions against pathogens.^[5]^[6]^[7] In physics, activation often refers to nuclear processes, such as neutron activation, where atomic nuclei capture neutrons to become radioactive isotopes, or activation analysis, a technique used to determine the elemental composition of materials by measuring induced radioactivity. These methods are applied in nuclear science, materials testing, and trace element analysis.^[8] In psychology, activation describes the level of arousal or stimulation in the brain, particularly the cerebral cortex, that contributes to wakefulness, attention, and behavioral engagement, as seen in theories of motivation where optimal activation levels enhance performance. Behavioral activation, a therapeutic technique, involves scheduling activities to counteract depression by increasing contact with rewarding experiences.^[9]^[10] In computer science and machine learning, activation pertains to functions applied to neurons in artificial neural networks, introducing non-linearity to model complex patterns; common examples include ReLU (Rectified Linear Unit), which outputs the input if positive and zero otherwise, and sigmoid, which maps values to a range between 0 and 1. These functions are essential for enabling deep learning models to approximate intricate functions.^[11]^[12]

Chemistry

Activation Energy

Activation energy is defined as the minimum energy barrier that reactant molecules must overcome to reach the transition state, enabling the formation of products in a chemical reaction. This energy threshold arises in chemical kinetics due to the need for molecules to achieve a specific configuration and sufficient kinetic energy during collisions, distinguishing reactive from non-reactive encounters.^[13]^[14] The concept was first quantitatively formulated by Swedish chemist Svante Arrhenius in 1889, based on studies of the acid-catalyzed inversion of sucrose, where he observed that reaction rates increase exponentially with temperature. Arrhenius proposed that only a fraction of molecular collisions possess the necessary energy to surmount this barrier, linking it to the temperature dependence of reaction velocities. His seminal work laid the foundation for modern chemical kinetics, earning him the Nobel Prize in Chemistry in 1903.^[15]^[16] The relationship between the reaction rate constant k and temperature is described by the Arrhenius equation:

k = A e^{-E_a / RT}

Here, A is the pre-exponential factor representing the frequency of collisions and the probability of proper orientation, E_a is the activation energy, R is the gas constant (8.314 J/mol·K), and T is the absolute temperature in Kelvin. This empirical equation can be derived from collision theory, which posits that the reaction rate depends on the collision frequency between molecules and the proportion of those collisions with energy exceeding E_a. In collision theory, the total number of collisions per unit volume per unit time, Z, for a bimolecular reaction is given by Z = N_A^2 [A][B] \sigma \sqrt{\frac{8 R T}{\pi \mu}}, where \mu is the reduced molar mass, \sigma is the collision cross-section, and [A], [B] are reactant concentrations. However, only collisions with kinetic energy along the line of centers greater than E_a lead to reaction. The fraction of molecules with such energy follows the Maxwell-Boltzmann distribution, approximated for the high-energy tail as e^{-E_a / RT}. Incorporating a steric factor p (0 < p ≤ 1) for favorable orientations, the rate law becomes rate = p Z e^{-E_a / RT} [A][B], yielding k = p Z' e^{-E_a / RT}, where Z' is the concentration-independent part of the collision frequency; thus, A = p Z'. This derivation connects the exponential term directly to the Boltzmann probability of sufficient energy.^[17] Experimentally, activation energy is determined by measuring the rate constant k at several temperatures and constructing an Arrhenius plot of \ln k versus $1/T. The plot yields a straight line with slope -E_a / R, allowing E_a to be calculated from the slope and A from the intercept \ln A. This method relies on the temperature dependence of reaction rates, often using spectrophotometric or titrimetric monitoring of product formation, as in the iodide-persulfate reaction where E_a values around 50-60 kJ/mol are typical.^[18]^[19] Activation energy plays a critical role in both endothermic and exothermic reactions, as every chemical transformation requires surmounting an energy barrier to form the unstable transition state, irrespective of the net enthalpy change. In exothermic reactions, where products have lower energy than reactants, the forward activation energy is typically lower than the reverse, but both directions retain a barrier. Endothermic reactions, with higher-energy products, exhibit a forward E_a that includes the endothermic \Delta H plus the reverse barrier. Catalysts accelerate reactions by providing an alternative pathway with reduced E_a, often 20-50% lower, without altering the overall thermodynamics; for instance, platinum lowers the E_a for ammonia oxidation from about 250 kJ/mol to 150 kJ/mol. This lowering increases the exponential term in the Arrhenius equation, dramatically boosting rates at given temperatures.^[20]

Molecular Activation

Molecular activation in organic chemistry refers to the reversible chemical modification of a molecule to enhance the reactivity of its functional groups, often by introducing leaving groups or altering electronic properties to facilitate subsequent bond-forming reactions. This approach contrasts with deprotection strategies by temporarily increasing electrophilicity or nucleophilicity, enabling efficient synthetic transformations under mild conditions.^[21] A prominent example is the activation of carboxylic acids for amide bond formation, a cornerstone of peptide and pharmaceutical synthesis. Carboxylic acids are typically converted to acyl chlorides using reagents like thionyl chloride (SOCl₂), which replaces the poor leaving group (OH) with chloride, dramatically increasing the carbonyl's electrophilicity. The resulting acyl chloride then undergoes nucleophilic acyl substitution with amines to yield amides in high yields, often at room temperature. Active esters, formed via coupling agents such as dicyclohexylcarbodiimide (DCC), provide an alternative activation method that offers greater stability and reduces side reactions.^[22]^[23] In organometallic chemistry, oxidative addition serves as a key activation mechanism in catalytic processes. Here, a low-valent transition metal center, such as Pd(0) or Rh(I), inserts into a substrate bond (e.g., C-H, C-X, or H-H), simultaneously increasing the metal's oxidation state by two units and its coordination number. This activates the substrate by weakening bonds and positioning groups for subsequent reductive elimination or migration steps, as seen in hydrogenation and cross-coupling reactions. The process is favored for early transition metals with d⁸ or d¹⁰ configurations and follows concerted or Sₙ2-like pathways depending on the substrate.^[24] Radical activation is central to free radical polymerization, where initiators generate reactive species to initiate chain reactions. Thermal initiators like azobisisobutyronitrile (AIBN) or peroxides decompose homolytically to produce radicals that add to the π-bond of vinyl monomers (e.g., styrene or methyl acrylate), forming a carbon-centered radical that propagates the polymer chain. This activation step controls the polymerization rate and molecular weight distribution, with initiator efficiency influenced by temperature and solvent; for instance, AIBN decomposes effectively above 60°C to afford cyanoisopropyl radicals.^[25] The activation of alkenes in olefin metathesis exemplifies advanced molecular activation in catalysis, particularly through the Grubbs ruthenium catalysts developed in the 1990s. These complexes, featuring a metal-carbene moiety, activate alkene substrates by coordinating the double bond and initiating a [2+2] cycloaddition to form a metallacyclobutane intermediate, which rearranges to exchange substituents. The first-generation Grubbs catalyst (RuCl₂(PCy₃)₂(=CHPh)) enabled tolerant, well-defined metathesis for ring-closing and cross applications, transforming synthetic efficiency for complex molecules like macrocycles and polymers. Its development, building on earlier molybdenum systems, earned the 2005 Nobel Prize in Chemistry.^[26]^[27]

Biology

Biochemical Activation

Biochemical activation refers to the processes by which inactive precursors or substrates in metabolic pathways are converted into active forms through enzymatic or chemical mechanisms, enabling key biological functions such as digestion, energy production, and protein synthesis. These activations often occur in response to specific physiological signals and are tightly regulated to prevent untimely activity that could lead to cellular damage. In metabolic contexts, activation bridges chemical reactivity with biological specificity, primarily involving enzymes that catalyze transformations under controlled conditions. One prominent example of biochemical activation is the bioactivation of prodrugs, where pharmacologically inactive compounds are metabolized into active therapeutic agents. Codeine, an opioid analgesic, is bioactivated in the liver by the cytochrome P450 2D6 (CYP2D6) enzyme to its active metabolite, morphine, which binds to μ-opioid receptors to produce analgesia. This O-demethylation reaction requires CYP2D6 activity, and genetic variations in CYP2D6 can lead to poor metabolizers who experience reduced pain relief or ultrarapid metabolizers at risk of morphine overdose. Similar bioactivation occurs with other prodrugs like tramadol, highlighting the role of hepatic enzymes in drug efficacy and safety. Zymogen activation represents another critical mechanism, involving the proteolytic cleavage of inactive enzyme precursors to generate active forms, typically in response to environmental cues. In the stomach, pepsinogen, secreted by chief cells, is activated to pepsin by hydrochloric acid (HCl) produced by parietal cells, which lowers the pH to around 2 and cleaves the inhibitory propeptide from pepsinogen. This irreversible process initiates protein digestion in the gastric lumen, with pepsin exhibiting optimal activity at acidic pH to break down dietary proteins into peptides. The zymogen form protects producing cells from autodigestion, ensuring activation only occurs extracellularly. Allosteric activation modulates enzyme activity through binding of regulatory molecules at sites distinct from the active site, fine-tuning metabolic flux. Phosphofructokinase-1 (PFK1), a rate-limiting enzyme in glycolysis, is allosterically activated by fructose-2,6-bisphosphate (Fru-2,6-BP), which increases its affinity for fructose-6-phosphate and overcomes inhibition by ATP. This activation promotes the committed step of glycolysis, converting fructose-6-phosphate to fructose-1,6-bisphosphate, thereby accelerating glucose breakdown during energy demand. Structural studies reveal that Fru-2,6-BP binding induces conformational changes in PFK1's regulatory domain, enhancing catalytic efficiency in response to hormonal signals like insulin. In protein synthesis, amino acid activation is the initial step where amino acids are esterified to their cognate transfer RNAs (tRNAs), forming aminoacyl-tRNAs essential for translation. Aminoacyl-tRNA synthetases (aaRSs) catalyze this two-step reaction: first, forming an aminoacyl-adenylate intermediate using ATP, followed by transfer of the amino acid to the tRNA's 3'-end hydroxyl group, releasing AMP. Each of the 20 aaRSs ensures specificity, recognizing both the amino acid and anticodon to prevent errors in polypeptide assembly. This high-fidelity process consumes two high-energy phosphate bonds per amino acid, underscoring its energetic cost in ribosomal protein synthesis. Bioactivation can also yield toxic metabolites, illustrating metabolic consequences when detoxification pathways are overwhelmed. Acetaminophen, a widely used analgesic, is bioactivated by cytochrome P450 enzymes (primarily CYP2E1) to N-acetyl-p-benzoquinone imine (NAPQI), a reactive quinone imine that depletes glutathione and forms protein adducts, leading to hepatotoxicity. This mechanism was discovered in the 1970s through studies showing covalent binding of acetaminophen-derived intermediates to hepatic proteins in overdose scenarios. NAPQI's toxicity highlights the dual role of activation in therapeutics, where excessive bioactivation without adequate conjugation (e.g., via glucuronidation or sulfation) results in oxidative stress and centrilobular necrosis.

Immunological Activation

Immunological activation refers to the processes by which immune cells are triggered to initiate protective responses against pathogens or abnormal cells, involving both innate and adaptive components. In adaptive immunity, activation ensures specificity and memory, while in innate immunity, it provides rapid but non-specific defense. This activation is tightly regulated to prevent excessive responses that could lead to tissue damage, with key mechanisms including receptor-ligand interactions and signaling cascades that amplify immune functions. Dysregulation of these processes underlies various immune-related disorders. T-cell activation, a cornerstone of adaptive immunity, requires two primary signals: the first from the T-cell receptor (TCR) binding to a peptide-major histocompatibility complex (MHC) on antigen-presenting cells, providing antigen specificity, and the second from co-stimulatory molecules such as CD28 interacting with B7 ligands on the presenting cell.^[28] This co-stimulation via CD28 enhances survival and proliferation signals, culminating in the production of interleukin-2 (IL-2), which acts in an autocrine manner to drive T-cell expansion and differentiation into effector cells.^[29] Without co-stimulation, TCR engagement alone can lead to T-cell anergy or apoptosis, ensuring activation only occurs in the context of genuine threats.^[30] B-cell activation similarly depends on antigen recognition but often requires T-cell assistance for full humoral responses. The B-cell receptor (BCR) binds soluble or membrane-bound antigens, initiating internalization and presentation on MHC class II to CD4+ T cells.^[31] Activated T cells then provide help through CD40 ligand (CD40L) binding to CD40 on B cells, promoting isotype switching, affinity maturation, and differentiation into plasma cells or memory B cells.^[32] This T-dependent pathway is essential for high-affinity antibody production against protein antigens. In innate immunity, macrophage activation polarizes these cells into distinct phenotypes: classical M1 activation, driven by interferon-gamma (IFN-γ) from T cells or natural killer cells often combined with lipopolysaccharide (LPS), promotes pro-inflammatory responses including nitric oxide production and phagocytosis to combat intracellular pathogens.^[33] In contrast, alternative M2 activation, induced by interleukin-4 (IL-4) or IL-13 from Th2 cells, supports tissue repair, anti-parasitic immunity, and anti-inflammatory functions through arginase expression and IL-10 secretion. These polarizations highlight the plasticity of macrophages in balancing inflammation and resolution. Cytokine regulation fine-tunes immunological activation, with tumor necrosis factor-alpha (TNF-α) playing a central role in amplifying inflammation by recruiting neutrophils and enhancing endothelial permeability at infection sites.^[34] Immune checkpoints like programmed death-1 (PD-1) on T cells, upon binding PD-L1 on target cells, deliver inhibitory signals to prevent overactivation and maintain tolerance, particularly in chronic infections or tumors.^[35] Dysfunctional regulation can lead to pathological states; in autoimmunity such as rheumatoid arthritis, aberrant T- and B-cell activation drives synovial inflammation and joint destruction, often involving elevated TNF-α.^[34] Similarly, overactivation in sepsis results in a "cytokine storm," first characterized in the 1980s through studies on TNF-α's role in endotoxic shock, causing systemic inflammation, organ failure, and high mortality.^[36]

Cellular Activation

Cellular activation refers to the processes by which non-immune cells detect and respond to environmental cues, initiating intracellular signaling cascades that drive physiological functions such as contraction, secretion, and proliferation. These mechanisms are fundamental to homeostasis and adaptation in tissues like neurons, muscle, and epithelia. Central to this is signal transduction, where extracellular ligands bind to receptors on the cell surface, triggering conformational changes that propagate signals inside the cell. In excitable cells, such as neurons and cardiomyocytes, activation often involves rapid electrophysiological changes, while in other cell types, it modulates gene expression for longer-term responses. A key pathway in cellular activation is mediated by G-protein-coupled receptors (GPCRs), which constitute the largest family of cell surface receptors and respond to diverse ligands including hormones, neurotransmitters, and sensory stimuli. Upon ligand binding, GPCRs activate heterotrimeric G proteins, leading to the exchange of GDP for GTP on the Gα subunit and subsequent dissociation into Gα and Gβγ components. This activates downstream effectors, such as adenylyl cyclase, which produces the second messenger cyclic AMP (cAMP) from ATP, amplifying the signal to modulate protein kinases and ion channels. For instance, β-adrenergic receptors in cardiac myocytes couple to Gs proteins to elevate cAMP levels, enhancing contractility. This paradigm was established through foundational work identifying G proteins as mediators of hormone action. In excitable cells, voltage-gated ion channels play a pivotal role in activation by converting membrane depolarization into action potentials. Voltage-gated sodium (Nav) channels open when the membrane potential reaches a threshold of approximately -55 mV, allowing rapid Na⁺ influx that further depolarizes the membrane in a positive feedback loop. This process, described in the Hodgkin-Huxley model, relies on voltage-dependent conformational changes in channel gates: activation m-gates open, while inactivation h-gates close shortly after to repolarize the membrane. The model mathematically quantifies these dynamics using differential equations for Na⁺ and K⁺ conductances, predicting action potential propagation in squid giant axons with high fidelity. Disruptions in these channels, known as channelopathies, underscore their importance; for example, mutations in the CFTR chloride channel, an ATP- and phosphorylation-regulated anion channel involved in epithelial ion transport, cause cystic fibrosis by impairing mucociliary clearance.^[37] Calcium signaling is another cornerstone of cellular activation, particularly in muscle contraction, where it links electrical excitation to mechanical response. In skeletal muscle, depolarization of the T-tubule membrane activates dihydropyridine receptors (DHPRs), which mechanically couple to ryanodine receptors (RyRs) in the sarcoplasmic reticulum (SR), triggering Ca²⁺ release into the cytosol. RyR1, the predominant isoform in skeletal muscle, forms large homotetrameric channels that selectively permeate Ca²⁺, elevating cytosolic concentrations from ~100 nM to ~10 μM to bind troponin and enable actin-myosin cross-bridging. This excitation-contraction coupling ensures synchronized force generation. Gene expression activation provides a sustained outcome of cellular signaling, often through transcription factors like NF-κB, which responds to stress, cytokines, and growth factors. In the canonical pathway, stimuli such as TNF-α lead to IκB kinase (IKK) activation, phosphorylating inhibitory IκB proteins for ubiquitination and degradation, freeing NF-κB dimers (e.g., p65/p50) to translocate to the nucleus and bind κB sites in promoter regions. This upregulates genes involved in inflammation, survival, and proliferation, such as those encoding cytokines and anti-apoptotic proteins. The pathway's inducibility was first demonstrated in studies of immunoglobulin enhancer regulation in B cells. Dysregulation of NF-κB contributes to pathologies like chronic inflammation, highlighting its regulatory precision.

Physics

Nuclear Activation

Nuclear activation encompasses processes in which atomic nuclei absorb particles, such as neutrons, leading to excited or radioactive states through nuclear reactions. This phenomenon occurs when a stable nucleus captures a neutron, often resulting in the emission of gamma radiation and the formation of an isotope that may be radioactive. A classic example is the thermal neutron capture by nitrogen, where ^{14}\mathrm{N} + \mathrm{n} \rightarrow ^{15}\mathrm{N}^{*} \rightarrow ^{15}\mathrm{N} + \gamma (10.8 MeV), producing a prompt gamma ray with a 13.7% probability, though ^{15}\mathrm{N} itself is stable.^[38] More commonly, neutron activation induces radioactivity in materials by converting stable isotopes into unstable ones that decay via beta emission or other modes.^[39] The discovery of induced nuclear activation is credited to Enrico Fermi and his collaborators in 1934, who demonstrated that neutron bombardment could produce artificial radioactivity in various elements, marking a pivotal advancement in nuclear physics. In their experiments at the University of Rome, they irradiated substances like aluminum and iodine with neutrons from a radon-beryllium source, observing delayed radioactivity with half-lives ranging from seconds to hours. This work, detailed in their seminal paper, laid the foundation for understanding neutron-induced reactions and earned Fermi the 1938 Nobel Prize in Physics.^[40] In nuclear fusion reactions, activation requires overcoming the Coulomb barrier, the electrostatic repulsion between positively charged nuclei that sets a threshold energy for reaction occurrence. For the deuterium-tritium (D-T) fusion reaction, this barrier necessitates kinetic energies on the order of 100 keV to achieve significant cross-sections, despite quantum tunneling allowing reactions at lower effective temperatures equivalent to about 10-100 keV.^[41] The process releases 17.6 MeV per reaction, powering concepts like thermonuclear devices.^[42] In astrophysics, nuclear activation plays a key role in stellar nucleosynthesis, where high temperatures and densities enable neutron capture processes to build heavier elements from lighter ones. The slow neutron capture process (s-process) in asymptotic giant branch stars, for instance, involves sequential neutron absorptions on seed nuclei, with beta decays in between, producing isotopes beyond iron; this activation pathway accounts for about half of elements heavier than iron in the solar system.^[43] Such processes occur in stellar envelopes enriched with free neutrons from reactions like ^{13}\mathrm{C}(\alpha, \mathrm{n})^{16}\mathrm{O}.^[44] Safety concerns in nuclear reactors arise from unwanted nuclear activation of structural materials and coolant, generating long-lived radioactive products that contribute to occupational exposure and complicate decommissioning. A prominent example is the production of cobalt-60 (^{60}\mathrm{Co}) via thermal neutron capture on abundant ^{59}\mathrm{Co} impurities in steel components: ^{59}\mathrm{Co}(\mathrm{n}, \gamma)^{60}\mathrm{Co}, yielding a high-energy gamma emitter (half-life 5.27 years) that dominates radiation fields during maintenance.^[45] Reactor designs mitigate this through material selection and shielding, but activated products like ^{60}\mathrm{Co} require careful management to limit doses below regulatory limits, such as those set by the IAEA.^[46]

Activation Analysis

Activation analysis, particularly neutron activation analysis (NAA), is a nuclear technique employed for the quantitative determination of elemental concentrations in various materials by inducing radioactivity through neutron irradiation and subsequently measuring the emitted gamma radiation. This method leverages the nuclear activation processes where stable isotopes capture neutrons to form radioactive nuclides that decay with characteristic gamma emissions, allowing identification and quantification of elements based on their nuclear properties. NAA has been instrumental in analytical physics since its development in the 1930s by George de Hevesy and Hilde Levi, who first applied it to detect rare earth elements.^[47] In NAA, a sample is irradiated with neutrons, typically thermal neutrons from a nuclear reactor, causing target nuclei to undergo the (n,γ) reaction and form radioactive isotopes. Following irradiation, the induced radioactivity decays, and the gamma rays are detected and analyzed using high-resolution gamma-ray spectroscopy, such as with high-purity germanium (HPGe) detectors, to identify specific elements through their unique gamma energy signatures. For instance, uranium-238 can be detected indirectly via the formation of uranium-239, which decays to neptunium-239 and emits a characteristic 74 keV gamma ray. This process enables precise measurement without destroying the sample in the instrumental variant.^[48]^[49]^[50] NAA variants include instrumental neutron activation analysis (INAA), which is non-destructive and relies on direct gamma spectrometry post-irradiation, and radiochemical neutron activation analysis (RNAA), which incorporates chemical separation of the activated elements prior to measurement to enhance sensitivity and reduce interferences. INAA is suitable for multi-element analysis in a single irradiation, while RNAA is used for ultra-trace detection. Both achieve sensitivities down to parts per billion (ppb) or lower for many elements, depending on the neutron flux and decay characteristics, making NAA one of the most sensitive analytical techniques available.^[47]^[51]^[52] In forensic science, NAA has been applied since the 1960s to compare trace element compositions in bullet lead specimens, aiding in linking bullets to crime scenes by identifying compositional matches indicative of common manufacturing sources, as pioneered in analyses by Vincent Guinn and the FBI. For archaeology, NAA excels in sourcing ancient pottery by determining the elemental profile of clays, enabling researchers to trace trade networks and production centers; for example, studies of Caribbean ceramics have used INAA to distinguish local from imported vessels based on rare earth element ratios. These applications highlight NAA's role in provenance determination where high precision is critical.^[53]^[54]^[55] Key advantages of NAA include its non-destructive nature for INAA, ability to analyze multiple elements simultaneously without matrix effects dominating, and superior sensitivity for elements like rare earths that are challenging for other methods. It requires no chemical reagents, minimizing contamination risks, and provides absolute quantification via comparator methods. However, limitations arise from the need for access to nuclear facilities like research reactors for neutron sources, potential radiation hazards during handling, and longer analysis times compared to alternatives. Particle-induced X-ray emission (PIXE) serves as a common alternative, offering faster analysis in non-nuclear settings but with shallower penetration and less suitability for bulk multi-element detection.^[56]^[8]^[49]

Computing

Activation Functions

Activation functions are non-linear mathematical mappings applied to the weighted sum of inputs in artificial neurons, introducing non-linearity that allows neural networks to approximate complex functions and learn intricate patterns from data. Without non-linearity, multi-layer networks would behave like a single linear transformation, limiting their expressive power. This capability is formalized by the universal approximation theorem, which states that networks with a single hidden layer containing non-linear activations can approximate any continuous function on a compact subset of \mathbb{R}^n.^[57] The origins of activation functions trace back to the McCulloch-Pitts neuron model of 1943, which employed a binary step function to simulate the all-or-nothing firing of biological neurons, laying foundational groundwork for computational models of neural activity. Early neural networks in the 1950s and 1960s, such as the perceptron, used similar threshold-based activations, but these were limited to linear separability. The advent of backpropagation in 1986 revolutionized training, favoring differentiable functions like the sigmoid, defined as

\sigma(x) = \frac{1}{1 + e^{-x}},

which compresses inputs to the range (0, 1) and was prominently featured in the seminal backpropagation algorithm for multi-layer networks. The hyperbolic tangent (tanh), given by

\tanh(x) = \frac{e^{x} - e^{-x}}{e^{x} + e^{-x}},

emerged as an improvement, outputting values in (-1, 1) for better gradient centering and convergence, though both sigmoid and tanh suffer from saturation issues. For output layers in multi-class classification, the softmax function normalizes a vector \mathbf{z} \in \mathbb{R}^K to probabilities via

\sigma(\mathbf{z})_i = \frac{e^{z_i}}{\sum_{j=1}^K e^{z_j}},

enabling probabilistic interpretations and cross-entropy loss optimization; it derives from statistical mechanics principles and became standard in neural networks by the early 1990s. The 2010s marked a shift with the rectified linear unit (ReLU),

f(x) = \max(0, x),

popularized by Nair and Hinton in 2010 for its sparsity and efficiency, which propelled deep architectures like AlexNet in 2012, achieving breakthrough performance on ImageNet by enabling faster training of networks with eight layers or more. More recent functions, such as GELU (Gaussian Error Linear Unit) introduced in 2016 and used in models like BERT, and Swish (2017), have shown improvements in transformer architectures, with ongoing research exploring adaptive activations as of 2025.^[58]^[57]^[59]^[60]^[61] In backpropagation, activation functions are pivotal as their derivatives facilitate error signal propagation and weight updates via the chain rule, with the total gradient depending on the product of these derivatives across layers. For instance, the sigmoid's derivative \sigma'(x) = \sigma(x)(1 - \sigma(x)) is bounded by 0.25 and approaches zero for large |x|, causing the vanishing gradient problem where signals weaken exponentially in deep networks, as first systematically analyzed by Hochreiter in 1991 for recurrent nets but applicable broadly. This saturation hinders learning in early layers, contrasting with ReLU's piecewise derivative (1 for x > 0, 0 otherwise), which preserves strong gradients and avoids vanishing, though it risks "dying" neurons if inputs are consistently negative. Tanh exhibits similar vanishing but with steeper slopes near zero. Softmax's Jacobian supports stable multi-class gradients when paired with appropriate losses. These dynamics underscore why early sigmoid-based networks struggled beyond a few layers until ReLU's adoption facilitated the deep learning era.^[58]^[62]^[57] Selection of activation functions hinges on several criteria to optimize training dynamics and performance. Differentiability is essential for gradient-based methods like backpropagation, excluding non-differentiable options like step functions for hidden layers. Computational efficiency favors simple operations, such as ReLU's max computation over sigmoid's exponential, reducing training time in large-scale models. Gradient flow is critical: functions avoiding saturation (e.g., ReLU over sigmoid) prevent vanishing or exploding gradients, with zero-centered outputs like tanh aiding bias correction. Monotonicity ensures consistent error propagation, while task-specific needs dictate choices—sigmoid or softmax for probabilistic outputs in classification, ReLU for hidden layers in regression or vision tasks due to its empirical superiority in deep convolutional networks. ReLU has been reported to enable up to six times faster training compared to traditional activations in various studies, though hybrids like Leaky ReLU address ReLU's dying neuron issue for negative inputs. Ultimately, the choice balances architecture depth, hardware constraints, and problem domain, with ReLU serving as the default for many modern deep learning applications since the 2010s.^[63]^[57]

Threshold Models

Threshold models in computing employ binary or step-function activations to simulate decision-making processes in simple and complex systems, where outputs are determined by whether an input exceeds a predefined threshold. These models represent a foundational approach in artificial intelligence and computational simulations, enabling discrete state transitions that mimic all-or-nothing responses observed in certain natural phenomena.^[64] The core of threshold models is the Heaviside step function, defined as \theta(x) = 0 if x < 0 and \theta(x) = 1 if x \geq 0, which produces a binary output based on the sign of the input. This function serves as the activation mechanism in early neural computing units, transforming a weighted sum of inputs into a crisp decision.^[65] In the perceptron, introduced by Frank Rosenblatt in 1958, the Heaviside step function acts as the activation to classify inputs by computing a linear combination and applying the threshold, enabling the model to learn binary decisions through weight adjustments. However, Marvin Minsky and Seymour Papert demonstrated in 1969 that single-layer perceptrons with step activations cannot solve non-linearly separable problems, such as the XOR function, due to their limited representational power.^[65]^[66] This analysis highlighted key limitations, contributing to a temporary decline in neural network research.^[66] Threshold models extend beyond neural units to cellular automata, where local rules based on neighbor counts determine cell states in a binary grid. John Conway's Game of Life, devised in 1970, exemplifies this: a live cell survives if it has exactly 2 or 3 live neighbors (threshold for persistence), while a dead cell becomes live only with exactly 3 live neighbors (birth threshold), leading to emergent complex patterns from simple discrete decisions.^[67] Similarly, in epidemic modeling, the SIR framework uses thresholds to predict disease spread; an epidemic occurs if the basic reproduction number R_0 > 1, representing the threshold where infections grow exponentially beyond containment.^[68]^[69] In modern computing, threshold models underpin spiking neural networks, which simulate neuron firing by integrating inputs until a threshold is reached, triggering discrete spikes for information transmission. Wolfgang Maass's 1997 work established that networks of such threshold-based spiking neurons can perform complex computations equivalent to sigmoidal networks, offering biologically plausible models for temporal processing in AI.^[70]^[71] Compared to continuous activation functions like the sigmoid, which provide smooth, differentiable mappings for gradient-based learning, threshold models prioritize computational simplicity and exact binary decisions but face challenges in optimization due to non-differentiability at the threshold.^[66]

References

[1]
Definition of ACTIVATION
### Definition of Activation
[2]
Activation Definition and Examples - Biology Online Dictionary
Jul 23, 2021 · noun (general) The state or the process of being active and/or effective (biochemistry) The process of making a molecule reactive, active, or effective in ...
[3]
Activation energy (article) | Khan Academy
The activation energy of a chemical reaction is closely related to its rate. Specifically, the higher the activation energy, the slower the chemical reaction ...
[4]
Activation Energy Definition in Chemistry - ThoughtCo
May 19, 2018 · Activation energy is the energy needed to start a chemical reaction. Catalysts lower the activation energy, helping reactions happen faster ...
[5]
Enzyme Activation - an overview | ScienceDirect Topics
Enzyme activation refers to the process by which the catalytic activity of an enzyme is increased through biochemical modifications, such as phosphorylation ...
[6]
T-cell activation | British Society for Immunology
T cells are generated in the Thymus and are programmed to be specific for one particular foreign particle (antigen).
[7]
Helper T Cells and Lymphocyte Activation - NCBI - NIH
They are activated on the surface of antigen-presenting cells, which mature during the innate immune responses triggered by an infection.
[8]
Activation - (AP Psychology) - Vocab, Definition, Explanations
Activation refers to the process of awakening or stimulating our senses, leading to an awareness and consciousness of external stimuli.
[9]
Behavioral Activation - an overview | ScienceDirect Topics
Behavioral activation is defined as an evidence-based intervention that improves mood by engaging individuals in meaningful activities, particularly for ...
[10]
Neural networks: Activation functions | Machine Learning
Aug 25, 2025 · Learn how activation functions enable neural networks to learn nonlinearities, and practice building your own neural network using the ...
[11]
Introduction to Activation Functions in Neural Networks - DataCamp
Activation functions transform input to output, enabling non-linear learning in neural networks, which is essential for complex data.Linear activation · Sigmoid activation · Tanh (hyperbolic tangent...
[12]
Activation Energy - Chemical Kinetics
The activation energy is the change in the internal energy of the system, which is not quite true. E a measures the change in the potential energy of a pair of ...
[13]
Chemical Reactivity - MSU chemistry
The energy needed to raise the reactants to the transition state energy level is called the activation energy, ΔE‡. An example of a single-step exothermic ...
[14]
[PDF] Über die Reaktionsgeschwindigkeit bei der Inversion von ... - Zenodo
Svante Arrhenius. Die Geschwindigkeit der Reaktionen, welche von Elektrolyten (Säuren und Basen) bewirkt werden, steht in einem sehr engen Zusammenhange.
[15]
[PDF] The origin and status of the Arrhenius equation
The classic paper (3) which is the main focus of attention here, appeared in 1889 under the title, "Uber die Reaktionsgeschwindigkeit bei der Inuersion uon ...
[16]
[PDF] Reaction Rates and Temperature; Arrhenius Theory
Arhenius discovered that most reaction-rate data obeyed an equation based on three factors: (1) The number of collisions per unit time.
[17]
[PDF] Experiment 5 - Kinetics The Oxidation of Iodide by Hydrogen Peroxide
The Temperature-Dependence of the Rate Constant Experimentally, we can determine the value of the activation energy by measuring the value of the rate constant ...<|control11|><|separator|>
[18]
Arrhenius Kinetics Analysis
The purpose of this analysis is to verify that the Arrhenius equation is an accurate way to quantify the dependence of reaction rates on temperature.
[19]
energy profiles - Chemguide
Once the activation energy barrier has been passed, you can also see that you get even more energy released, and so the reaction is overall exothermic. If you ...
[20]
[PDF] evolution-of-amide-bond-formation.pdf
Activation consists of the replacement of the hydroxyl group of the carboxylic acid with a leaving group as the acid would otherwise simply form salts with the ...
[21]
https://quod.lib.umich.edu/cgi/p/pod/dod-idx/evolution-of-amide-bond-formation.pdf?c=ark%3Bidno=5550190.0011.816
[22]
Amide synthesis by acylation - Organic Chemistry Portal
A palladium-catalyzed N-acylation of tertiary amines by carboxylic acids produces the corresponding amides in very good yields via cleavage of a C-N bond. Both ...
[23]
Origins and Development of Initiation of Free Radical Polymerization ...
Feb 11, 2010 · The radicals formed by initiator decomposition must be relatively long living and they can initiate the polymerization with rather slow rates. ...
[24]
[PDF] NOBEL LECTURES - Olefin-Metathesis Catalysts for the Preparation ...
This is a story of our exploration of the olefin-meta- thesis reaction, a reaction that has been the major emphasis of my independent research.
[25]
The Nobel Prize in Chemistry 2005 - Popular information
Grubbs' catalysts have become the ﬁrst well-deﬁned catalysts for general metathesis applications in ordinary laboratories. Catalyst 2 in ﬁg. 6 is generally ...Missing: paper | Show results with:paper
[26]
Molecular mechanisms of T cell co-stimulation and co-inhibition - PMC
Co-stimulatory and co-inhibitory receptors have a pivotal role in T cell biology, as they determine the functional outcome of T cell receptor (TCR) signalling.Missing: seminal | Show results with:seminal
[27]
T cell receptor (TCR) signaling in health and disease - Nature
Dec 13, 2021 · This review provides a comprehensive snapshot of the various molecules involved in regulating T cell receptor signaling, covering both enzymes and adaptors.Missing: seminal | Show results with:seminal
[28]
CD28 co-stimulation in T-cell homeostasis: a recent perspective - PMC
Here, we discuss recent insights into the molecular events underlying CD28-mediated co-stimulation, its impact on gene regulation, and the differential role of ...Missing: papers | Show results with:papers
[29]
B cell memory: building two walls of protection against pathogens
Dec 13, 2019 · Antigen binding to BCRs results in downstream BCR signalling and in the internalization, processing and presentation of the BCR-bound antigen on ...Missing: seminal | Show results with:seminal
[30]
Molecular mechanism and function of CD40/CD40L engagement in ...
Although T-cell priming and B-cell activation can occur in absence of CD40 signals, many cellular and immune functions are defective in the absence of this ...Missing: seminal | Show results with:seminal
[31]
Macrophage plasticity and polarization: in vivo veritas - JCI
In response to various signals, macrophages may undergo classical M1 activation (stimulated by TLR ligands and IFN-γ) or alternative M2 activation (stimulated ...Missing: seminal papers<|control11|><|separator|>
[32]
The Role of Tumor Necrosis Factor Alpha (TNF-α) in Autoimmune ...
Mar 8, 2021 · In this review, we briefly introduce the impact of TNF-α signaling on autoimmune diseases and its inhibitors, which are used as therapeutic agents against ...
[33]
Revisiting the PD-1 pathway | Science Advances
Gao, The FG loop of PD-1 serves as a “Hotspot” for therapeutic monoclonal antibodies in tumor immune checkpoint therapy. iScience 14, 113–124 (2019). GO TO ...Revisiting The Pd-1 Pathway · Expression Of Pd-1 And Its... · Pd-1:Shp-2 Interaction And...
[34]
Perspective How TNF was recognized as a key mechanism of disease
By the late 1980s excess TNF production was proposed to be central to acute systemic viral diseases. This family of cytokines is now at the centre of ...<|control11|><|separator|>
[35]
[PDF] Nuclear Techniques to Detect Explosives - OSTI.GOV
Mar 1, 2021 · thermal neutron capture by nitrogen: 1n + 14N → 15N* → 15N + γ (10.8 MeV). The 15N* decays by emitting a 10.8-MeV gamma ray with a 44% ...
[36]
Neutron Activation Analysis | Radiation Center
Neutron activation analysis of a sample begins with neutron bombardment of a target to convert stable isotopes in the sample to radioactive isotopes (e.g., ...Missing: IAEA | Show results with:IAEA<|separator|>
[37]
Artificial radioactivity produced by neutron bombardment - Journals
This paper aims at giving a fuller account of experiments made in the Physical Laboratory of the University of Rome, on new radio-elements produced by neutron ...
[38]
Nuclear Fusion Reaction - an overview | ScienceDirect Topics
... barrier. Thus the deuterium fusion reaction requires only 10 to 100 keV of kinetic temperature, which corresponds to 100 to 1000 million Kelvin [1]. This ...
[39]
https://radiationcenter.oregonstate.edu/neutron-activation-analysis
[40]
https://royalsocietypublishing.org/doi/10.1098/rspa.1934.0168
[41]
Nuclear processes in Astrophysics: Recent progress - V. Liccardo et al
There are three main processes by which nucleosynthesis of heavier elements happens: the s-, the r- and the p-process.
[42]
[PDF] Manual for reactor produced radioisotopes
activation cross-sections, such as production of cobalt-60. 8. Page 15. In such cases the net rate of growth of the product nucleus could be written as: dN dt.
[43]
[PDF] Long-Lived Activation Products in )Reactor Materials - INIS-IAEA
This program assessed problems posed by long-lived activation products in reactor materials, analyzing samples and evaluating nuclear reactions.
[44]
[PDF] PRACTICAL ASPECTS OF OPERATING A NEUTRON ACTIVATION ...
PRINCIPLES OF INSTRUMENTAL NEUTRON ACTIVATION ANALYSIS. 2.1. HISTORICAL BACKGROUND. Neutron activation analysis (NAA) can be dated to the time of Hevesy and ...
[45]
Neutron activation analysis | IAEA
The technique of neutron activation analysis is based on the measurement of radiation released by the decay of radioactive nuclei formed by neutron irradiation ...
[46]
[PDF] Use of research reactors for neutron activation analysis
FOREWORD. Neutron activation analysis (NAA) is an analytical technique based on the measurement of characteristic radiation from radionuclides formed ...
[47]
A generalized method for characterization of 235 U and 239 Pu ...
This allows for a simple quantification of 238U mass through neutron activation analysis via 239U gamma-ray measurements (at 74 keV). In addition, the NAA ...
[48]
[PDF] A Brief Overview of Neutron Activation Analyses Methodology and ...
The basic essentials required to carry out an analysis of samples by NAA are: • A source of neutrons,. • Suitable instrumentation for detecting gamma rays,. • A ...
[49]
[PDF] Neutron Activation Analysis - CHIMIA
It has the following advantages: (1) wide applicability, (2) sensitivities ranging from 10"6 to 10'14 g, (3) absence of reagent contamination,. (4) built-in ...
[50]
FORENSIC NEUTRON ACTIVATION ANALYSIS OF BULLET-LEAD ...
THE POSSIBILITY OF USING INSTRUMENTAL NEUTRON ACTIVATION ANALYSIS TO DETERMINE WHETHER TWO BULLET LEAD SPECIMENS HAVE COMMON OR DIFFERENT SOURCES HAS BEEN ...
[51]
Chemical and forensic analysis of JFK assassination bullet lots
1977 Neutron Activation Analysis (NAA) work of Guinn (1979). Variations in ... The bullet lead matrix poses special concerns during NAA due to its heavy mass.
[52]
[PDF] COMPOSITIONAL STUDIES OF CARIBBEAN CERAMICS
Instrumental neutron activation analysis is a powerful quantitative analytical technique that has been widely applied in archaeological studies for the last 50 ...
[53]
INAA Advantages
INAA Advantages · Many elements can be determined simultaneously. · INAA is highly sensitive to some trace elements. · High accuracy and precision can be obtained.
[54]
Neutron Activation Analysis | U.S. Geological Survey - USGS.gov
Neutron activation analysis (NAA) is an analytical technique that relies on the measurement of gamma rays emitted from a sample that was irradiated by neutrons.Missing: IAEA | Show results with:IAEA
[55]
[PDF] Evolution of Activation Functions: An Empirical Investigation - arXiv
The results are favorable and are obtained from averaging the performance of the activation functions found over 30 runs, with experiments being conducted on 10 ...
[56]
[PDF] Learning representations by back-propagating errors
We describe a new learning procedure, back-propagation, for networks of neurone-like units. The procedure repeatedly adjusts the weights of the connections in ...
[57]
[PDF] Rectified Linear Units Improve Restricted Boltzmann Machines
The discriminative models use the deterministic version of NReLUs that implement the function y = max(0,x). ... compute explicitly (Nair & Hinton, 2008). This is ...
[58]
[PDF] the vanishing gradient problem during learning recurrent neural nets ...
Recurrent nets are in principle capable to store past inputs to produce the currently desired output. Because of this property recurrent nets are used in ...
[59]
[PDF] Review and Comparison of Commonly Used Activation Functions for ...
The primary neural networks decision-making units are activation functions. ... This will enable us to formulate guidelines for choosing the best activation ...
[60]
[PDF] The perceptron: a probabilistic model for information storage ...
The perceptron: a probabilistic model for information storage and organization in the brain. · Frank Rosenblatt · Published in Psychology Review 1 November 1958 ...
[61]
The Perceptron: A Probabilistic Model for Information Storage and ...
No information is available for this page. · Learn why
[62]
[PDF] Minsky-and-Papert-Perceptrons.pdf - The semantics of electronics
This book is about perceptrons-the simplest learning machines. However ... changed since 1969, when the book was first published, we con- cluded that ...
[63]
[PDF] The fantastic combinations of John Conway's new solitaire game "life"
by Martin Gardner. Scientific American 223 (October 1970): 120-123. Most of the work of John Horton Conway, a mathematician at Gonville and Caius College of the.
[64]
A contribution to the mathematical theory of epidemics - Journals
Luckhaus S and Stevens A (2023) Kermack and McKendrick Models on a Two-Scale Network and Connections to the Boltzmann Equations Mathematics Going Forward ...
[65]
[PDF] A Contribution to the Mathematical Theory of Epidemics Author(s)
A Contribution to the Mathematical Theory of Epidemics. By W. 0. KERMACK and A. G. McKENDRICK. (Communicated by Sir Gilbert Walker, F.R.S.-Received May 13, 1927 ...Missing: model | Show results with:model
[66]
Networks of spiking neurons: The third generation of neural network ...
Maass, 1997. W. Maass. Fast sigmoidal networks via spiking neurons. Neural Computation, 9 (1997), pp. 279-304. Crossref View in Scopus Google Scholar. Maass and ...
[67]
[PDF] The third generation of neural network models - Gwern.net
In addition it is shown in Maass (1997) that the simu- lation of sigmoidal neural nets by SNNs can also be carried out with the biologically more realistic ...