Fact-checked by Grok 2 weeks ago

Programme for International Student Assessment

The Programme for International Student Assessment (PISA) is a triennial international survey administered by the Organisation for Economic Co-operation and Development (OECD) that measures the competency of 15-year-old students in applying knowledge of mathematics, reading, and science to authentic problems.^[1] Launched in 2000, PISA evaluates education systems' outputs rather than inputs, focusing on functional skills essential for participation in modern knowledge economies rather than rote memorization or curriculum coverage.^[2]^[3] PISA's methodology involves standardized, computer-based tests completed by representative samples of students from participating countries and economies, typically numbering over 80 entities, with results scaled to enable cross-national comparisons on a common metric where the OECD average approximates 500 points.^[4]^[5] The assessment rotates its primary focus domain—mathematics in 2022—while including secondary measures of the others, supplemented by questionnaires on student attitudes, school environments, and socioeconomic factors to contextualize performance variations.^[6]^[7] Results from cycles like 2022 reveal stark disparities, with East Asian systems such as Singapore achieving mean mathematics scores exceeding 560 while OECD averages declined by 15 points from 2018, equivalent to three-quarters of a school year of learning, amid broader post-pandemic setbacks in proficiency.^[8] These findings have informed policy reforms in high- and low-performers alike, underscoring causal links between instructional rigor and outcomes, yet PISA faces academic critiques for methodological limitations in inferring causation from correlational data and for potentially incentivizing test-oriented teaching over holistic development.^[8]^[9]^[10]

History and Development

Establishment by the OECD

The Organisation for Economic Co-operation and Development (OECD) created the Programme for International Student Assessment (PISA) in 1997 as a mechanism to gauge the extent to which education systems equip 15-year-old students with practical skills essential for thriving in knowledge-driven economies.^[11] This initiative arose amid accelerating globalization, where policymakers increasingly recognized the limitations of gross domestic product metrics in evaluating human capital formation and the need for standardized, cross-national benchmarks of cognitive abilities relevant to economic adaptability and innovation.^[1] PISA deliberately diverged from conventional curriculum-based examinations by prioritizing the application of knowledge in reading, mathematics, and science to authentic, non-routine problems, thereby highlighting systemic strengths in fostering problem-solving and critical thinking over rote memorization.^[12] The program's foundational design reflected a causal understanding that educational outcomes directly influence long-term productivity and competitiveness, prompting OECD member governments to commit resources for periodic, comparable data collection.^[1] By focusing on functional competencies at the cusp of compulsory schooling's end, PISA aimed to inform evidence-based reforms that align schooling with real-world demands, such as technological advancement and international labor mobility, without prescribing specific curricula.^[11] The inaugural PISA assessment occurred in 2000, encompassing 32 participating countries and economies—28 OECD members and four non-members—with reading designated as the principal evaluation domain to establish a baseline for literacy in contextualized scenarios.^[13] This initial cycle set the triennial rhythm for subsequent iterations, enabling longitudinal tracking of educational efficacy amid evolving global economic pressures.^[14]

Cycles and Key Evolutions

The Programme for International Student Assessment (PISA) commenced in 2000 as a triennial evaluation, with subsequent cycles occurring every three years thereafter, rotating the major assessment domain among reading, mathematics, and science.^[2] The inaugural 2000 cycle emphasized reading literacy, followed by mathematics as the primary focus in 2003 and science in 2006, establishing the pattern of domain rotation that prioritizes one core area for deeper evaluation while covering the others more broadly.^[3] This structure persisted through the 2009 reading-focused cycle, 2012 mathematics cycle, 2015 science cycle, and 2018 reading cycle, enabling longitudinal comparisons of student competencies across participating economies.^[15] Participation expanded markedly over these cycles, incorporating both OECD member countries and non-OECD economies, reflecting growing global interest in benchmarking educational outcomes.^[16] From 43 participants in the 2006 cycle, the number rose to 79 in 2018, encompassing diverse regions and economies beyond traditional OECD boundaries.^[17] This growth facilitated broader data collection, with cycles assessing hundreds of thousands of 15-year-old students via standardized tests and contextual questionnaires.^[2] Key evolutions included the introduction of optional innovative domains starting in 2012, aimed at measuring emerging 21st-century skills beyond the core triad.^[18] Financial literacy debuted as an optional assessment in the 2012 cycle, evaluating students' ability to apply mathematical knowledge to personal finance scenarios.^[19] Subsequent cycles featured domains such as global competence in 2018, which gauged students' capacity to understand and interact across cultural boundaries, and creative thinking in 2022.^[20] These additions allowed voluntary participation by subsets of countries, enriching the dataset without altering the mandatory core assessments.^[6] The planned 2021 cycle was postponed to 2022 due to disruptions from the COVID-19 pandemic, resulting in an exceptional four-year interval between the 2018 and 2022 assessments and adaptations to testing protocols in some jurisdictions.^[21] Despite the delay, the 2022 cycle proceeded with mathematics as the major domain and maintained participation at 81 economies, involving approximately 690,000 students.^[2] The forthcoming 2025 cycle will refocus on science as the primary domain, incorporating innovative elements on learning in the digital world to assess self-regulated learning and interaction with technologies.^[22] Following 2025, PISA will transition to a four-year cycle to align with evolving educational priorities and resource demands.^[3]

Objectives and Framework

Core Purposes and Design Principles

The Programme for International Student Assessment (PISA) seeks to gauge the extent to which 15-year-old students near the end of compulsory schooling can apply knowledge and skills in reading, mathematics, and science to real-life situations, prioritizing functional competencies over curriculum-specific content or rote learning.^[1] This approach evaluates education systems' effectiveness in fostering abilities critical for adult participation in society, such as problem-solving and critical thinking in authentic contexts, informed by cognitive science principles that emphasize transferable skills for lifelong learning and economic productivity.^[20] By design, PISA avoids alignment with any national curriculum, instead establishing international benchmarks to enable cross-country comparisons of systemic strengths in preparing students for societal and workforce demands. Central to PISA's framework is the rotation of a major assessment domain every three-year cycle—reading in 2000 and 2009, mathematics in 2003 and 2012, and science in 2006, 2015, and 2022—while allocating approximately two-thirds of testing time to that domain and the remainder to the other two core areas, ensuring comprehensive yet focused coverage without overburdening participants.^[23] Minor domains, such as creative thinking in 2022, receive limited attention in select cycles to explore emerging competencies, supplemented by optional innovative assessments.^[23] Background questionnaires on student attitudes, family socioeconomic status, school resources, and learning environments provide contextual data to analyze performance variations, linking individual and systemic factors to outcomes without compromising the core focus on measurable skills.^[20] Comparability across jurisdictions is maintained through rigorous, verifiable standards that prioritize universal metrics over culturally relative interpretations, utilizing item response theory for scaling scores on a stable international metric where the OECD average is set at 500 points with a standard deviation of 100.^[24] This design enables policymakers to track trends in educational equity and efficiency, informing reforms aimed at enhancing human capital development rather than enforcing prescriptive models.

Assessment Domains and Competencies Assessed

The Programme for International Student Assessment (PISA) primarily evaluates competencies in three core domains: reading literacy, mathematical literacy, and scientific literacy, focusing on students' ability to apply knowledge and skills to authentic, real-world situations rather than isolated academic content.^[1]^[6] These domains are defined through assessment frameworks developed by international panels of experts convened by the Organisation for Economic Co-operation and Development (OECD), which emphasize functional proficiency over procedural recall.^[6] For instance, the 2018 mathematical literacy framework prioritizes reasoning and problem-solving in contextual scenarios, building on prior cycles' evolutions.^[6] Reading literacy assesses the capacity to comprehend, interpret, and critically evaluate written texts across various formats and purposes, enabling students to achieve personal goals, engage in civic life, and navigate information-rich environments.^[3] This includes skills such as retrieving explicit information, making inferences, reflecting on authors' intentions, and evaluating arguments, as outlined in OECD frameworks that adapt to evolving digital and multimedia texts.^[6] Mathematical literacy measures the ability to formulate, employ, and interpret mathematics to address practical problems, including mathematical reasoning, modeling real phenomena, and using tools like formulas or data analysis.^[3] Frameworks stress competencies in content areas such as quantity, uncertainty, and change, with an emphasis on adaptive thinking rather than algorithmic repetition, as refined in cycles like 2022 where mathematics served as the major domain.^[6]^[25] Scientific literacy evaluates proficiency in recognizing scientific issues, explaining evidence-based phenomena, and applying scientific methods to evaluate claims and design inquiries.^[3] Key competencies involve knowledge of scientific concepts (e.g., systems, energy), epistemic understanding of evidence reliability, and skills in interpreting data or models, with frameworks updated periodically—such as for the 2025 cycle—to align with contemporary scientific practices.^[26] In addition to domain-specific tests, PISA incorporates student questionnaires that collect data on attitudes toward learning, study habits, perceived teacher support, and school resources, providing contextual variables to analyze performance influences without altering core competency assessments.^[27] While innovative domains like creative thinking (introduced in 2022, assessing idea generation and problem-solving across expression types) supplement the core framework, they do not supplant the emphasis on literacy-based skills.^[6]^[28]

Methodology

Sampling and Participant Selection

The Programme for International Student Assessment (PISA) targets a specific population of students aged 15 years and 3 complete months to 16 years and 2 complete months at the beginning of the testing period, who are enrolled in an educational institution and attending at least grade 7, to capture performance near the end of compulsory education in most systems.^[29]^[30] This age window ensures comparability across diverse education systems while excluding younger or older students to focus on a cohort with substantial exposure to secondary-level instruction.^[29] Exclusions are minimized, encompassing only very small categories such as students in specialized institutions for the disabled with low incidence or those not testable in the assessment format, but recent immigrants and students with special needs are generally included if they meet the criteria.^[30] PISA utilizes a two-stage stratified probability sampling design to achieve nationally or economically representative samples. In the first stage, schools are selected with probability proportional to size, stratified by factors including geographic region, urban-rural location, school type, and enrollment size to reflect the target population's diversity.^[31] Typically, 150 to 200 schools are drawn per participant, with replacement schools used if initial refusals occur. The second stage involves randomly selecting 25 to 40 eligible students per school, often from intact classes where feasible to facilitate logistics, yielding a target of 4,500 to 10,000 students per country or economy, scaled up for larger populations.^[31]^[30] This design prioritizes empirical representativeness over convenience sampling, with explicit stratification ensuring coverage of subpopulations without disproportionate oversampling unless specified for analysis.^[24] To uphold data quality, OECD mandates minimum weighted participation rates: at least 75% for schools (after accounting for replacements) and 80% for students within participating schools, with deviations requiring non-response bias analyses to confirm negligible impact on estimates.^[24] Adjustments for non-response include post-stratification weighting, raking, and imputation procedures to mitigate potential biases from differential participation, such as higher refusal rates among certain socioeconomic groups.^[31] Opt-out provisions, which vary by jurisdiction and may include parental consent requirements, can influence student response rates, particularly in countries with strong privacy laws or public skepticism toward assessments.^[32] Certain participants consist of subnational entities rather than full countries, sampled to represent specific regions or provinces for targeted insights. For instance, China's involvement has historically featured select provinces such as Beijing, Shanghai, Jiangsu, and Zhejiang, denoted in OECD reports to distinguish them from national samples.^[33] These entities adhere to the same sampling standards but cover only portions of the broader population, limiting extrapolations to the entire nation and highlighting variations in regional educational performance.^[29] Failure to meet participation thresholds or standards in some cases results in entities being excluded from main rankings or requiring caveats, ensuring transparency about data reliability.

Test Design and Administration

The PISA cognitive assessment consists of a two-hour main test for each participating student, featuring a mix of multiple-choice and constructed-response items across the core domains of reading, mathematics, and science.^[32] To ensure comprehensive coverage of the assessment framework without overburdening individual students, the test employs a rotated booklet design, where subsets of items (typically organized into clusters or units) are distributed across multiple test forms assigned randomly to students within schools.^[34] This matrix sampling approach allows the overall sample to address a broader pool of items than any single student encounters, promoting reliability and cross-cultural comparability by minimizing fatigue effects and enabling robust estimation of domain proficiencies.^[32] Since the 2015 cycle, PISA has primarily utilized computer-based testing (CBT) to facilitate efficient administration, interactive item formats, and innovative assessments such as problem-solving tasks that require digital navigation or simulation.^[32] Paper-based options remain available for jurisdictions lacking sufficient computer infrastructure or for students with disabilities, with accommodations like extended time, alternative input devices, or simplified interfaces provided to maintain equity while adhering to strict inclusion criteria (e.g., exclusions limited to under 5% of the target population).^[24] The CBT platform, such as the TAO system, records responses and interaction logs securely, supporting data validation for fairness across diverse linguistic and technological contexts.^[24] Prior to each main survey cycle, field trials involving representative samples (e.g., at least 200 students per item in major languages) calibrate item difficulty, refine wording for cultural neutrality, and verify administration procedures, ensuring items function equivalently across participating entities.^[24] These trials, conducted under controlled conditions mirroring the main test, help eliminate biased or ambiguous items that could distort cross-national comparisons.^[32] Testing is administered anonymously, with no individual or school-level scores reported back, which discourages selective coaching or gaming of the system and emphasizes aggregate system performance.^[32] Participating countries may incorporate national add-on assessments or questionnaires on the same day, but these yield separate results not integrated into core PISA domain scores to preserve international comparability.^[3]

Scoring, Scaling, and Data Analysis

PISA employs item response theory (IRT), specifically the Rasch partial credit model, to estimate student proficiency in each assessment domain, assuming unidimensionality of the underlying trait while accommodating polytomous item responses such as partial credit for constructed-response items.^[35] Item parameters, including difficulty and threshold discriminability fixed at 1 in the Rasch framework, are calibrated separately for each cycle using field trial and main survey data, with conditioning on student background variables like socioeconomic status to stabilize estimates across heterogeneous participant pools.^[36] This approach enables equating scores across countries and cycles by linking through common anchor items, which constitute a subset of previously calibrated items to maintain scale continuity.^[37] Scores are reported on a scale where the mean proficiency across OECD countries in the 2000 reading assessment is set at 500 points with a standard deviation of 100, serving as the anchor for subsequent domains and cycles; mathematics and science scales were similarly established in 2003 and 2006, respectively, through linkage to the reading scale via overlapping items and population conditioning.^[32] To account for measurement uncertainty arising from limited item exposure per student—due to the matrix sampling design where students complete only a fraction of the total item pool—plausible values are generated as multiple imputations (typically five sets) drawn from the posterior distribution of proficiency given observed responses and covariates, allowing population-level inferences while approximating individual estimates for subgroup analyses.^[38] Missing data, including item non-response and not-reached items (distinguished by time stamps to avoid biasing low proficiency downward), are handled through the IRT framework's expectation-maximization algorithms during calibration, with plausible values imputing latent traits under the missing-at-random assumption conditional on observed data.^[39] Cross-domain and cross-cycle linking relies on concurrent or rotated anchor sets, with separate scaling for each domain followed by transformations to align scales; for instance, in cycles emphasizing a minor domain, trend estimates incorporate both direct anchors and indirect population anchors via multilevel regression conditioning on stable covariates.^[40] The OECD publicly releases anonymized datasets, codebooks, and scaling software after each cycle, enabling independent replication and verification of results, as seen with the PISA 2022 database encompassing student cognitive responses, questionnaires, and derived indices.^[41] In equity analyses, scales are adjusted for socioeconomic controls like the PISA index of economic, social, and cultural status (ESCS), derived from principal component analysis of verified home possessions and parental education/occupation, to isolate performance variances.^[42] Criticisms of scaling assumptions, such as potential violations of unidimensionality or differential item functioning across expanding non-OECD participants inflating scale heterogeneity, have prompted sensitivity analyses in technical reports, including Monte Carlo simulations testing anchor set size and conditioning effects on trend stability, which generally affirm robustness but highlight minor variances in low-performing country estimates.^[43] ^[44] These evaluations, conducted via alternative model fits like generalized partial credit models, demonstrate that deviations from Rasch assumptions yield score shifts typically under 5 points, supporting the methodology's validity for comparative purposes while underscoring the need for ongoing empirical checks against raw data.^[39]

Results and Rankings

Overview of Cycles from 2000 to 2018

The Programme for International Student Assessment (PISA) conducted assessments every three years from 2000 to 2018, evaluating 15-year-old students' competencies in reading, mathematics, and science, with a primary focus rotating across domains: reading in 2000, mathematics in 2003 and 2012, and science in 2006. Participation expanded significantly, starting with 32 countries and economies in 2000 and reaching 79 by 2018, reflecting growing global interest in benchmarking educational outcomes.^[17]^[45] Across these cycles, OECD average scores remained stable at approximately 490–500 points per domain, establishing a consistent empirical baseline for international comparisons, though slight variations occurred due to scaling adjustments and evolving participant pools.^[46] East Asian education systems demonstrated persistent excellence, with Singapore, Hong Kong (China), Chinese Taipei, Japan, and the Republic of Korea regularly posting mean scores above 550 points across domains. For instance, Singapore achieved 573 in mathematics in 2012, while similar high performances recurred in subsequent cycles, including scores exceeding 550 in multiple domains for these systems in 2015 and 2018.^[45]) This consistency contrasted with broader variability among OECD members, where aggregate patterns highlighted domain-specific strengths, such as elevated science proficiency in select cycles. Performance trends revealed shifts, including Finland's early dominance in science (563 points in 2006) fading to 522 by 2018, alongside declines in reading from 546 in 2000 to 520 in 2018. Sweden's scores also trended downward post-2000, reaching lows by 2012 before stabilizing. In the United States, mean scores held steady (e.g., reading at 505 from 2000 to 2018) but displayed high variance, underscoring inequality in student outcomes compared to lower-variance peers.^[45]^[47]^[48] Increased participation did not uniformly correlate with score improvements, as newer entrants often scored below OECD averages while raising awareness of performance gaps.^[46]

PISA 2022 Results and Key Findings

The PISA 2022 assessment evaluated nearly 690,000 fifteen-year-old students across 81 countries and economies, with a primary focus on mathematics proficiency alongside reading and science. Results, released by the OECD on December 5, 2023, revealed Singapore as the top performer overall, scoring 575 in mathematics, 543 in reading, and 561 in science. Other high achievers included Macau (China) with 552 in mathematics, Taiwan with 547, Hong Kong (China) with 540, and Japan with 536.^[49]^[50] OECD average scores declined markedly from 2018 levels, with mathematics falling 15 points to 472—equivalent to roughly three-quarters of a year of schooling—reading dropping 10 points, and science decreasing 5 points. These shifts represented the largest recorded drops in PISA history, observed across most participating systems despite some exceptions like Singapore maintaining or improving performance. In Europe, countries such as Germany experienced a 25-point mathematics decline, while Asian participants generally fared better but still showed varied losses. The United States scored 465 in mathematics, below the OECD average and down 13 points from 2018, with reading at 504 and science at 499 exceeding OECD benchmarks but indicating overall stagnation amid global trends.^[49]^[51]^[7] Persistent gender disparities emerged, with girls outperforming boys by 27 score points in reading on average across OECD countries, while boys led by 15 points in mathematics. Equity metrics highlighted socioeconomic influences, as students from advantaged backgrounds scored 93 points higher in mathematics than disadvantaged peers, a gap unchanged from prior cycles and underscoring performance ties to family resources and school selectivity.^[49]^[52] The assessment, originally planned for 2021, was postponed to 2022 due to COVID-19 disruptions, incorporating data on school closures and remote learning effects; however, analyses indicated that pandemic impacts accounted for only part of the declines, with broader pre-existing trends in instructional time and student resilience also contributing.^[51]^[19]

Longitudinal Trends and Cross-Cycle Comparisons

Across PISA cycles from 2000 to 2022, international performance hierarchies in mathematics, science, and reading have exhibited strong stability, with East Asian education systems—including Singapore, Chinese Taipei, Hong Kong-China, Macau-China, Japan, and Korea—consistently outperforming the OECD average by 80 to 120 points in mathematics and science, a gap rooted in sustained high achievement rather than transient factors.^[33] ^[49] This lead, evident since the inaugural 2000 assessment, reflects resilience in systems emphasizing disciplined curricula and rigorous instruction, contrasting with greater volatility in Western OECD countries subject to frequent pedagogical reforms.^[53] OECD averages reveal secular declines, particularly in core domains: mathematics fell from a baseline of 500 in 2003 to 472 in 2022, a drop of 28 points, while science declined by approximately 15-20 points since its 2006 focus cycle.^[54] ^[8] These trends predate the COVID-19 disruptions, with negative trajectories already apparent by 2018, affecting both high- and low-achieving students uniformly across OECD systems.^[37] Reading saw milder erosion, averaging a 10-point loss from 2018 to 2022, but overall patterns underscore no convergence toward equity in outcomes; top performers maintain their edge, while laggards show no systematic catch-up, preserving wide inter-country variances.^[53] Subgroup analyses indicate persistent mathematics gaps between native and immigrant-background students, averaging 50-70 points in many OECD countries, with stability from 2018 to 2022 but widening in select migrant-intensive systems like Sweden and Germany over prior decades, where influxes of lower-performing cohorts amplified national declines.^[55] ^[56] Such disparities highlight structural challenges in assimilation, uncorrelated with overall hierarchy shifts but contributing to downward pressure in affected economies.^[57]

Factors Influencing Performance

Systemic and Educational Policy Factors

High-performing jurisdictions in PISA, such as Singapore, emphasize curricula centered on explicit knowledge transmission and mastery of foundational content, coupled with substantial homework loads and ability-based streaming from an early age. Singapore's mathematics curriculum, which prioritizes problem-solving through concrete-pictorial-abstract progression and rigorous content coverage, has contributed to its consistent top rankings, with scores exceeding 550 points across domains in multiple cycles.^[58]^[59] These systemic features align with econometric analyses indicating that increased instruction time correlates with higher achievement, yielding approximately 0.03 standard deviations gain per additional hour of structured teaching.^[60] Educational reforms introducing accountability mechanisms, such as standardized assessments and school autonomy in resource allocation, have demonstrated causal links to PISA gains in specific cases. Poland's 1999 reforms, which extended compulsory education to age 18, implemented national curricula focused on core skills, and enhanced teacher evaluation tied to performance metrics, propelled average scores from below OECD means in 2000 (e.g., 470 in reading) to above-average levels by 2018 (503 in reading), sustaining improvements across cycles.^[61]^[62] Conversely, reduced emphasis on content coverage and time on task has coincided with performance declines; cross-national studies confirm that systems allocating fewer instructional hours to mathematics and reading basics exhibit lower proficiency rates.^[63] Teacher training rigor also correlates strongly with outcomes, as seen in high performers' selective recruitment and extended preparation programs emphasizing subject mastery over pedagogical theory alone. Singapore mandates a one-year postgraduate diploma for teachers, focusing on content delivery techniques, which supports its systemic emphasis on direct instruction.^[64] Accountability structures, including performance-based pay and principal evaluations, further amplify these effects when paired with autonomy, per analyses of PISA-linked data across OECD countries.^[65] Finland provides a counterexample: its early PISA successes (e.g., top rankings in 2000-2006) stemmed from highly selective teacher training requiring master's degrees and a focus on equity in resource distribution, yet scores plummeted by 79 points in mathematics from 2003 to 2022 amid shifts toward less structured, inquiry-based approaches and reduced instructional intensity.^[66] This stagnation highlights that initial equity-driven policies may yield diminishing returns without sustained emphasis on content mastery and task engagement, as evidenced by broader PISA trends linking instructional quality to long-term proficiency.^[8]

Socioeconomic, Demographic, and Immigration Effects

Socioeconomic status (SES), as measured by PISA's Economic, Social and Cultural Status (ESCS) index—which combines parental education, occupation, and home possessions—explains approximately 10-15% of the variance in student performance within OECD countries, based on correlations typically ranging from 0.3 to 0.4 between ESCS and scores in reading, mathematics, and science.^[52]^[67] Across countries, higher average national SES correlates positively with aggregate PISA scores, yet this relationship is moderated by systemic factors; for instance, Vietnam achieved mathematics scores of 546 in PISA 2015 despite a low national ESCS, outperforming many wealthier economies and demonstrating that effective educational policies can mitigate SES disadvantages, as disadvantaged Vietnamese students still scored above the OECD average.^[68]^[69] Immigration patterns significantly influence national averages, with first-generation immigrant students scoring an average of 29 points lower in mathematics than native students across OECD countries in PISA 2022, a gap attributed primarily to language barriers, integration challenges, and differing pre-migration educational quality rather than innate ability.^[55] In selective immigration systems like Canada's, where points-based policies favor skilled migrants, immigrant students' performance matches or exceeds natives', contributing to Canada's overall ranking; for example, in PISA 2018, Canadian immigrants averaged scores comparable to third-generation students.^[70] Conversely, in European countries with less selective policies, such as Sweden, native-immigrant gaps widen to 40-50 points in mathematics, exacerbated by post-2015 influxes of low-skilled migrants, which dilute aggregates without corresponding integration gains.^[71]^[72] Beyond income, family structure and parental education serve as key SES proxies with independent effects on scores; students from intact two-parent households outperform those from single-parent families by 20-30 points in PISA assessments, linked to greater resource stability and supervision, while higher parental education levels correlate with 0.2-0.3 standard deviation gains in child performance, reflecting transmitted human capital and home learning environments.^[73]^[74] These factors persist after controlling for income, underscoring causal pathways through cognitive stimulation and expectations rather than material wealth alone.^[52]^[75]

Cultural, Familial, and Behavioral Elements

PISA questionnaire data reveal that students endorsing beliefs in the malleability of intelligence—termed a growth mindset—score approximately 20-30 points higher in mathematics, reading, and science across OECD countries, with stronger associations among disadvantaged and immigrant students.^[76] However, empirical replications of growth mindset interventions show modest or null effects on achievement when isolated from rigorous content instruction, indicating that attitudinal shifts alone insufficiently drive gains without foundational knowledge and skills.^[77] Positive orientations toward academic challenge and perseverance similarly predict higher performance, but these traits exhibit cultural variance, with East Asian students reporting greater endorsement of effort-based success.^[78] In Confucian-influenced East Asian systems like Singapore, Japan, and South Korea—top PISA performers—cultural norms prioritize disciplined study habits and familial transmission of diligence, yielding scores 50-100 points above OECD averages in 2018 and 2022 cycles.^[79] ^[80] Second-generation immigrants from these backgrounds in Western host countries, such as Australia, outperform native peers by about 100 mathematics points, attributable to retained values of perseverance over socioeconomic assimilation alone.^[79] This generational persistence underscores causal pathways where parental modeling of time management and homework oversight embeds behaviors more enduringly than school-based efforts.^[81] Familial structures further differentiate outcomes: students whose parents engage daily in discussing school or checking homework score 15-25 points higher on average, with effects amplified in high-expectation households common in East Asia.^[82] Conversely, excessive recreational screen time—reported by 65% of OECD students as distracting in math classes—correlates with 20-40 point deficits in performance, independent of socioeconomic status, due to fragmented attention and reduced deliberate practice.^[78] ^[83] In individualistic Western contexts, lower reported resilience to setbacks aligns with these patterns, where self-reported avoidance of challenging tasks predicts underperformance more than in collectivist settings.^[84] Immigrant assimilation trajectories reinforce this, as first-generation students lag natives by 40-60 points but second-generation gaps narrow primarily through familial reinforcement of behavioral discipline rather than full cultural dilution.^[55]

Policy Impact

Adoption and Reforms in National Education Systems

The release of PISA 2000 results prompted significant policy responses in several OECD countries, particularly where national self-perceptions of educational strength contrasted with middling or below-average scores. In Germany, the unexpectedly low rankings—29th in reading, 19th in math, and 21st in science—triggered the "PISA-Shock," sparking nationwide debate and federal-level initiatives to establish nationwide educational standards, enhance equity through targeted support for disadvantaged students, and prioritize core competencies in mathematics and reading over the subsequent decade.^[85]^[86] These reforms, coordinated via the Standing Conference of the Ministers of Education and Cultural Affairs, included binding competency-oriented frameworks introduced by 2004, aiming to reduce early tracking and improve minimum proficiency levels.^[87] Poland's education system underwent structural alignment with PISA-style assessments following the 2000 results, building on 1999 reforms that extended compulsory schooling and introduced lower secondary schools (gimnazjum) with national external exams in 2002 to mirror PISA's focus on functional skills rather than rote knowledge.^[61] Policymakers revised curricula in 2001–2002 to emphasize problem-solving and application in math, science, and reading, while decentralizing school management and professionalizing teacher evaluation to foster accountability.^[88] This shift sustained momentum into the 2010s, with further tweaks like core curriculum updates in 2009 aligning explicitly to international benchmarks.^[89] In the United Kingdom, PISA outcomes from 2000 onward influenced accountability mechanisms, including the expansion of the National Literacy and Numeracy Strategies in the early 2000s and the Academies Programme launched in 2002, which granted schools autonomy to adopt practices from high-performing systems identified via PISA data.^[90] By the 2010s, results contributed to the adoption of the English Baccalaureate in 2010, prioritizing PISA-assessed subjects like math and science in performance metrics for schools.^[91] Similar pressures shaped policy in the United States, where post-2000 PISA data informed the reauthorization of the Elementary and Secondary Education Act via No Child Left Behind extensions and, later, Race to the Top grants in 2009, emphasizing standardized testing aligned with international competencies and teacher evaluations tied to student outcomes.^[92]^[93] High-performing Asian economies such as Singapore and South Korea referenced PISA results primarily for validation rather than overhaul, incorporating data into ongoing refinements like Singapore's Thinking Schools, Learning Nation initiative updated in the 2000s to reinforce mastery in assessed domains.^[94] In developing and middle-income countries, OECD analyses of PISA informed conditionalities in international aid; for instance, World Bank programs in Latin America during the 2000s–2010s linked funding to reforms adopting PISA-derived metrics for curriculum standardization and equity monitoring, as seen in Brazil's post-2000 shifts toward competency-based assessments.^[95] The intensity of PISA-driven reforms peaked in the 2000s amid initial shocks but moderated by the mid-2010s, with growing policy fatigue and diversification toward national priorities evident in reduced explicit citations in legislative debates.^[96]^[97]

Empirical Evidence of Positive Outcomes

Poland's education reforms, initiated in 1999 and reinforced by responses to the inaugural 2000 PISA results, correlated with substantial gains in student performance across multiple cycles. Between 2000 and 2006, Polish students improved by 0.16 to 0.28 standard deviations in mathematics, science, and reading, placing the country above the OECD average by 2012 in science and reading.^[98] ^[88] These advancements were associated with policy changes including the extension of compulsory education, the introduction of a comprehensive lower secondary school (gymnasium) emphasizing core skills in mathematics and language, and the implementation of external standardized assessments to enhance accountability.^[61] ^[99] Longitudinal analyses attribute much of the score increases—exceeding 30 points in reading from 2000 onward—to these measures, particularly the external exams that aligned curricula more closely with assessed competencies.^[89] Beyond immediate test scores, PISA-informed benchmarking has shown links to broader economic indicators in reforming systems. In Poland, the 1999 reforms, which drew on international comparisons including early PISA insights, boosted labor market outcomes for affected cohorts, raising employment probabilities by approximately 3 percentage points and earnings by 4%.^[100] Cross-country studies indicate that PISA's role in facilitating policy diffusion—such as adopting high-performing practices in curriculum focus and teacher evaluation—has contributed to performance uplifts in mid-tier OECD nations, with regression models estimating positive returns from accountability mechanisms over resource-intensive inputs like class size reductions, which yield only marginal gains of 1-2 points per student.^[97] Empirical support for these outcomes remains correlational, with causal inference limited by confounding factors such as concurrent economic growth and selection effects in high-achieving samples; nonetheless, difference-in-differences analyses of Polish cohorts exposed to reforms versus prior ones confirm net positive effects on cognitive skills predictive of long-term human capital accumulation.^[101]^[61]

Criticisms and Unintended Policy Consequences

Critics argue that PISA's high-stakes nature incentivizes "teaching to the test," resulting in curriculum narrowing where educators prioritize PISA-assessed skills like specific problem-solving formats over broader knowledge acquisition, yielding inflated scores without commensurate gains in deeper competencies.^[102]^[103] Empirical analyses of high-stakes testing regimes, analogous to PISA-driven reforms, show this approach as one of the least effective for genuine improvement, often fostering rote memorization rather than causal understanding of subjects.^[104] Such practices have been documented in systems under PISA pressure, where alignment with test items displaces untested areas like history or arts, distorting educational priorities toward measurable outputs.^[105] Another unintended consequence involves gaming mechanisms, such as selective student exclusion to boost averages; in Norway, exclusion rates in PISA rose from 4% in 2000 to 11% in 2018, with evidence suggesting deliberate exemptions of lower-performing students to manipulate participation and enhance reported outcomes.^[106] This tactic, while improving headline rankings, masks underlying deficiencies and undermines the assessment's validity as a system-wide gauge, as excluded cohorts—often disadvantaged—receive no remedial focus.^[107] PISA-influenced policies have also correlated with resource misallocation, emphasizing interventions for 15-year-olds at the expense of early childhood education, where foundational skill-building yields higher long-term returns per investment.^[108] In the United States, per-pupil spending rose by over 30% (inflation-adjusted) from 2000 to 2019, yet PISA scores in reading and mathematics stagnated, with no significant progress despite billions allocated to close international gaps, indicating inefficiency in secondary-focused reforms.^[109]^[110] Rankings pressure has induced policy volatility, with governments enacting reactive overhauls—such as Germany's post-2000 PISA "PISA shock" reforms versus more stable U.S. responses—leading to frequent shifts without sustained evaluation, as short-term ranking gains overshadow evidence-based continuity.^[111] This churn diverts attention from root causes like behavioral or familial factors, fostering backlash that attributes failures to testing inequities rather than addressing causal drivers such as instructional quality or student effort.^[96] PISA's emphasis on national averages has obscured disparities at the performance tails, prompting equity-focused policies that prioritize mean elevation over targeted aid for low achievers, whose remediation could prevent broader societal costs; for instance, about 20% of U.S. 15-year-olds scored below basic reading proficiency in 2018, yet reforms driven by average declines often dilute rigor for the middle rather than intensifying basics for the bottom.^[109]^[112] Such distortions risk entrenching underperformance among vulnerable groups, as average-centric metrics incentivize superficial boosts via selection or exclusion over distributional equity.^[106]

Reception and Controversies

Responses from High- and Low-Performing Countries

High-performing East Asian jurisdictions, including Singapore and select Chinese regions, have generally validated PISA outcomes as confirmation of their merit-based, rigorous curricula while emphasizing ongoing internal refinements over complacency. Singapore's Ministry of Education, in response to the 2022 results released on December 5, 2023, stated that the country's top rankings in mathematics, science, and reading—scoring 575, 561, and 543 respectively—affirm the resilience and effectiveness of its education system, particularly in fostering competencies amid disruptions like the COVID-19 pandemic.^[113] Public and scholarly responses in China to Shanghai's leading scores in prior cycles, such as 2012, focused on leveraging results for domestic policy tweaks, like enhancing teacher training, rather than broad external celebration, amid skepticism from international observers about sampling representativeness.^[114] Low-performing OECD countries in the West have frequently responded with attributions to immigration, socioeconomic disparities, and calls for redistributive reforms, often downplaying cultural or behavioral contributors evident in subgroup data. Sweden's PISA scores declined sharply from 2000 to 2012, with research attributing much of the 40-50 point drop in mathematics and reading to rising immigrant shares, as first- and second-generation students underperform natives by 50-80 points after controls; the 2022 OECD data showed an 81-point immigrant-nonimmigrant gap in reading, prompting debates over integration policies rather than systemic overhauls.^[115]^[116] In the United Kingdom, reactions to stagnant or declining scores—such as England's 489 in mathematics in 2022, below the OECD average of 472—highlighted widening social inequalities, with low-socioeconomic students falling 20-30 points faster in reading from 2012-2022, leading to policy emphases on equity funding over meritocratic tracking.^[117] The United States' consistent mid-tier rankings, with 2022 mathematics scores at 465, have fueled analyses of racial-ethnic breakdowns revealing persistent gaps: Asian-Americans scored 554 (on par with Singapore's top performers), whites 492 (comparable to Canada), Hispanics 444, and Blacks 420, prompting right-leaning commentators to stress familial selection, study habits, and cultural emphases on achievement as causal drivers, contra left-leaning attributions to institutional inequities alone.^[118] Finland's slide from top rankings in 2000-2006 (e.g., 548 in science) to below-average 2022 scores (511 in science) has been linked to the erosion of its early equity model, with boys' underperformance and a doubling of socioeconomic impacts explaining 20-30 point declines; widening gaps—advantaged students outperforming disadvantaged by 80+ points—signal failures in uniform teacher quality and late differentiation, spurring targeted interventions like the 2022 Right to Learn Programme without abandoning core equity principles.^[119]^[120] Non-participating or low-scoring developing nations like India and Malaysia have critiqued PISA's relevance to local contexts. India opted out of the 2022 and 2025 cycles, following dismal 2009 results (e.g., 336 in mathematics) dismissed by officials as culturally mismatched, avoiding potential repeats amid domestic assessments showing similar rural-urban divides.^[121] Malaysia's 2022 scores (409 in mathematics, down from 440 in 2018) elicited responses framing declines as language proficiency issues rather than curricular flaws, with less than 50% reaching Level 2 proficiency, though analyses urge addressing income-adjusted underperformance without rejecting the framework outright.^[122]^[123] Media coverage amplifies these results for political ends, with causal-realist perspectives in high-performers and right-leaning outlets prioritizing empirical drivers like demographics and discipline, while systemic-bias-prone mainstream sources in low-performers favor inequality narratives, often understating immigrant selection effects documented in OECD data across countries.^[55]

Methodological and Technical Critiques

Critics have highlighted inconsistencies in PISA's sampling procedures, particularly student exclusions that may bias national averages upward. PISA permits exclusions for students with limited proficiency in the test language or severe functional disabilities, capped at 5% of the target population to ensure representativeness, but several countries exceed this threshold. In Norway, exclusion rates surpassed 5% after 2009, ranking third-highest among OECD nations, with decisions often driven by subjective school-level judgments prioritizing student welfare over sample integrity, potentially yielding a "slanted picture" of performance.^[106] Analyses of the United Kingdom indicate that selective exclusions and non-response, particularly affecting lower-performing or immigrant students, could inflate mathematics scores by up to 15 points in Wales.^[124] Such practices disproportionately impact countries with higher immigrant populations, as recent arrivals are more likely categorized under exclusion criteria, though high-performing economies like Singapore maintain coverage rates above 95% with minimal exclusions.^[125] Differential item functioning (DIF) analyses aim to detect and adjust for cultural or linguistic biases favoring certain groups, yet empirical evidence reveals residual effects on group-level estimates. In PISA 2018 data, countries with elevated DIF item proportions exhibited mean score discrepancies up to 16.85 points before adjustments, with reading literacy showing the highest DIF rates (up to 39% of items).^[126] Simulations confirm that DIF adjustments halve bias in means (from 8.43 to 3.52 points on average for negative DIF), but standard deviations remain underestimated by up to 8.19 points, implying incomplete mitigation of uncertainty in comparative rankings.^[126] PISA's scaling relies on item response theory and plausible values to estimate proficiencies, but this approach may understate overall uncertainty. Plausible values, drawn from posterior distributions, account for item sampling and measurement error, yet the fixed number (typically 10 per domain post-2015) introduces Monte Carlo approximation errors that inflate variance estimates if insufficiently replicated.^[127] Linking procedures across cycles quantify trend uncertainty via errors, but critiques note that model assumptions, such as conditioning on background variables, can propagate biases if not fully diversified.^[128] Background data from self-reported questionnaires further compounds imprecision, as student and principal responses are prone to social desirability or recall biases, lacking independent verification.^[129] Observed year-to-year score fluctuations often exceed sampling error predictions, challenging trend reliability. Reanalyses of German PISA data demonstrate that transitions from paper-based to computer-based formats introduce mode effects, distorting longitudinal comparisons by up to several scale points due to altered response behaviors.^[130] Response rates below PISA's 85% student threshold in some jurisdictions exacerbate this volatility, though technical reports affirm internal consistency (e.g., reliability coefficients >0.90 across domains).^[131] In counterpoint, stable systems exhibit high reproducibility, with top performers maintaining rank consistency over cycles when implementation adheres to protocols.^[132]

Broader Debates on Validity, Bias, and Educational Implications

PISA's validity as a measure of educational competence has been contested, with evidence showing moderate to strong correlations between its scores and those from other assessments like TIMSS at the country level (typically r = 0.7–0.8) and PIAAC for adult skills (r = 0.70 after controls), indicating some overlap in capturing cognitive abilities.^[133]^[134] However, these correlations do not extend to non-cognitive domains; PISA performance exhibits a negative association with student well-being metrics, suggesting it prioritizes testable skills over holistic development.^[102] Critics, including educational researchers, argue that PISA's emphasis on functional literacy—skills for real-world application—undermines assessments of classical knowledge or curriculum mastery, as seen in its divergence from TIMSS's school-based focus, potentially fostering an illusion of competence without depth in foundational content.^[135]^[136] Debates on bias highlight interpretive divides in equity gaps, where left-leaning academic narratives often frame disparities as evidence of systemic racism or institutional failure, yet empirical analyses point to cultural, familial, and behavioral factors as dominant drivers.^[137] For example, cross-national data link achievement differences to societal values like ambition emphasis, which correlates with gender gaps in performance, and cultural capital transmitted via family practices, rather than uniform structural inequities.^[138] PISA's own equity analyses, while documenting socioeconomic gradients, incorporate measures like the ESCS index that may understate selection effects in immigrant or high-ambition cohorts, leading to overstated bias claims without disaggregating causal mechanisms such as parental effort or study habits.^[139]^[52] Sources from peer-reviewed economics and sociology journals consistently prioritize these proximal causes over distal systemic ones, countering biases in mainstream educational discourse that privilege equity narratives absent rigorous controls.^[140] Educational implications of PISA extend to policy convergence, where rankings incentivize test-preparation regimes that narrow curricula toward PISA-style items, potentially stifling innovation by marginalizing untested skills like creative problem-solving.^[141] High-performing systems often achieve scores through intensive drilling, yet this does not guarantee broader outcomes, as evidenced by PISA's weak predictive power for economic growth; East Asian analyses show no robust link between scores and GDP trajectories when cultural mediation and alternative human capital channels are accounted for.^[142]^[143] As a correlational tool, PISA struggles to isolate causal policy effects, prompting calls for alternatives like national longitudinal studies (e.g., cohort tracking akin to NAEP trends) that capture individual trajectories and contextual variances, or experimental designs emphasizing causal inference over snapshot rankings.^[144]^[145] These approaches, rooted in domestic data, avoid PISA's cross-cultural comparability trade-offs and better inform localized reforms.^[146]

References

[1]
PISA: Programme for International Student Assessment - OECD
PISA is the OECD's Programme for International Student Assessment. PISA measures 15-year-olds' ability to use their reading, mathematics and science ...PISA 2022 Results (Volume I)PISA 2022 DatabasePISA data and methodologyPISA 2022 Results (Volume II)PISA Test
[2]
What is PISA?: PISA 2022 Results (Volume I) - OECD
Dec 5, 2023 · The OECD Programme for International Student Assessment (PISA) examines what students know in mathematics, reading and science, and what ...
[3]
Program for International Student Assessment (PISA)
The Program for International Student Assessment (PISA) is an international assessment that measures 15-year-old students' reading, mathematics, and science ...
[4]
PISA data and methodology - OECD
The theory underlying the PISA surveys – what they aim to achieve and how they are developed – including background questionnaires completed by students, school ...PISA 2012 Database · PISA 2018 Database · PISA 2000 Database · Read more
[5]
Methodology and Technical Notes
This section describes features of the Program for International Student Assessment (PISA) 2018 methodology,including sample design, test design, and scoring.International Requirements · Test Development · Scaling of Data · Proficiency Levels
[6]
PISA 2022 Assessment and Analytical Framework - OECD
Aug 31, 2023 · This publication includes the frameworks for assessing mathematics, financial literacy and creative thinking.<|separator|>
[7]
PISA 2022 U.S. Results, Mathematics Literacy, Achievement by ...
The PISA 2022 results represent outcomes from the 8th cycle of PISA since its inception in 2000 and provide a global view of US students' performance.Missing: key | Show results with:key
[8]
Full Report: PISA 2022 Results (Volume I) - OECD
Dec 5, 2023 · Compared to 2018, mean performance fell by ten score points in reading and by almost 15 score points in mathematics, which is equivalent to ...Executive Summary · PISA 2022 key results... · How did countries perform in...
[9]
Two decades of havoc: A synthesis of criticism against PISA
Jan 22, 2020 · PISA has been criticized for promoting myths or half-truths about education that can be harmful(Zhao 2016b). Thanks to its distorted view of ...Missing: controversies | Show results with:controversies
[10]
PISA: Mission Failure - Education Next
Feb 7, 2023 · Many critics have noted that PISA's quantitative analyses cannot be used to draw causal inferences, mainly because of the cross-sectional ...
[11]
[PDF] PISA 2009 Assessment Framework - Publications | OECD
PISA represents a commitment by governments to monitor the outcomes of education systems through measuring student achievement on a regular basis and within an ...
[12]
[PDF] Program for International Student Assessment (PISA)
PISA, first implemented in. 2000, was developed and is administered under the auspices of the Organization for. Economic Cooperation and Development (OECD), an ...
[13]
[PDF] Highlights From the 2000 Program for International Student ...
PISA will be implemented on a 3-year cycle that began in 2000. Each PISA assessment cycle focuses on one particular subject, although.
[14]
Programme for International Student Assessment 2000 - Data Catalog
Sep 5, 2014 · Thirty-two countries participated in the first PISA survey in 2000. It included 28 Member countries of the OECD, and four non-OECD countries.
[15]
How has Student Performance Evolved Over Time? - OECD
In fact, half of the countries and economies that have participated in at least three PISA cycles have improved significantly in reading performance since 2000, ...
[16]
[PDF] Origins, growth and why countries participate in PISA | OECD
This chapter describes the origins of international large-scale assessments, presents evidence regarding the worldwide growth in such assessments, ...
[17]
PISA Participants - OECD
Countries and economies that have participated in PISA (past and present) ; Algeria · (2015). Argentina · (2025, 2022, 2018, 2015, 2012, 2009, 2006, 2000+).
[18]
PISA RDI Programme - OECD
Since 2012, PISA has assessed students in an innovative domain in every cycle. The innovative domain assessments target interdisciplinary, 21st century ...Empowering Young People... · Platform For Innovative... · Create Customised Data...
[19]
[PDF] PISA 2022 Assessment and Analytical Framework - Amazon S3
Thus, there was an exceptional four-year cycle between PISA. 2018 and PISA 2022. This publication presents the theory underlying the PISA 2022 ...<|separator|>
[20]
[PDF] PISA 2018 Assessment and Analytical Framework | OECD
Students' proficiency in an innovative domain is also assessed; in 2018, this domain was global competence. This publication presents the theory underlying the ...
[21]
Reader's Guide: PISA 2022 Results (Volume I) - OECD
Dec 5, 2023 · The test was originally planned to take place in 2021 but was delayed by one year due to the COVID-19 pandemic. The exceptional ...Reader's Guide · Pisa In The Pandemic · Adjudicated Entities Not...
[22]
PISA 2025 Learning in the Digital World - OECD
The PISA 2025 Learning in the Digital World assessment focuses on two competencies that are essential to learning with technologies: self-regulated learning, ...
[23]
[PDF] PISA 2022 Assessment and Analytical Framework | OECD
The OECD Programme for International Student Assessment (PISA) assesses the extent to which 15-year-old students near the end of their compulsory ...
[24]
[PDF] pisa 2025 technical standards | oecd
PISA Technical Standards are the set of principles on which the OECD Programme for International Student Assessment (PISA) is based.
[25]
PISA 2022 Framework - ILSA-Gateway
The PISA 2022 framework includes an updated math framework, with mathematical literacy as the capacity to reason mathematically and solve real-world problems.
[26]
PISA 2025 Science Framework - OECD
The PISA 2025 assessment measures how well countries are preparing their students with an understanding of science and how science produces reliable knowledge.Pisa 2025 Science Framework · Research, Evaluate And Use... · Epistemic Knowledge
[27]
[PDF] Governing Board QUALITY STANDARDS FOR PISA - Login
Apr 19, 2024 · This document is about the Governing Board Quality Standards for PISA, and it is for official use.<|separator|>
[28]
PISA 2022 Creative Thinking | OECD
The assessment includes four domains: written expression, visual expression, social problem solving and scientific problem solving. In each of these domains, ...
[29]
The PISA target population, the PISA samples, and the definition of ...
Dec 5, 2023 · Further information on the target population and the implementation of PISA sampling standards can be found in the PISA 2022 Technical Report ( ...
[30]
[PDF] sampling in pisa | oecd
PISA sampling targets students aged 15 years 3 months to 16 years 2 months, in grade 7 or higher, with exclusions kept to a minimum.
[31]
[PDF] PISA 2022 Technical Report | OECD
This Technical Report aims to describe and provide clarity on the technical and methodological underpinnings of these findings. ... sampling. 112. Page 14. 12 |.
[32]
PISA Frequently Asked Questions (FAQs) - OECD
Dec 5, 2023 · Find out what is PISA, how it is done and what are its goals.Missing: core | Show results with:core<|separator|>
[33]
How did countries perform in PISA?: PISA 2022 Results (Volume I)
Dec 5, 2023 · Provinces, regions, states or other subnational entities are shown in black italics (OECD countries) or blue italics (partner countries).
[34]
https://www.oecd.org/content/dam/oecd/en/about/programmes/edu/pisa/publications/technical-report/pisa-2018-technical-report-files/full-report/PISA%202018%20Techincal%20report%20full.zip
[35]
Theoretical considerations on scaling methodology in PISA - OECD
OECD Programme for International Student Assessment (PISA) scaling methodologies are reviewed from the mathematical perspective. In particular, the paper aims ...
[36]
[PDF] Theoretical considerations on scaling methodology in PISA
Dec 13, 2022 · OECD Programme for International Student Assessment (PISA) scaling methodologies are reviewed from the mathematical perspective.
[37]
[PDF] PISA 2022 Results (Volume I) | OECD
In 2022, as countries were still dealing with the lingering impacts of the COVID-19 pandemic, nearly 700 000 students from 81 OECD Member and partner economies ...
[38]
[PDF] Technical Report and User Guide for the 2018 Program for ...
8 For analysis purposes, PISA datasets include sets of 10 plausible values for each of the PISA 2018 scales. Thus, if any analysis were to be ...
[39]
Evaluating the effects of analytical decisions in large-scale ...
Aug 27, 2022 · First, an overview of the official methods for scaling the cognitive data in the PISA large-scale assessment (LSA) is given. The focus here is ...
[40]
[PDF] The impact of growing participation in PISA on scaling outcomes (EN)
Aug 17, 2022 · The impact of growing participation in PISA on scaling outcomes. A Monte Carlo simulation study. OECD Education Working Paper No. 277. Artur ...
[41]
PISA 2022 Database - OECD
From this page you can download the PISA 2022 dataset with the full set of responses from individual students, school principals, teachers and parents. These ...Missing: verification | Show results with:verification
[42]
[PDF] PISA Data Analysis Manual - SPSS® SECOND EDITION | OECD
The data collected during each PISA cycle are an extremely valuable source of information for researchers, policy makers, educators, parents and ...
[43]
[PDF] Theoretical considerations on scaling methodology in PISA - OECD
Dec 13, 2022 · In particular, the paper aims to elucidate the model structures and the model assumptions of item response theory used in the item scaling phase ...Missing: criticisms | Show results with:criticisms
[44]
[PDF] Conditioning: How background variables can influence PISA scores
Apr 9, 2020 · Yet, PISA receives significant criticism for its scaling model and the opaqueness in communicating it. One particular point of concern is the so ...
[45]
PISA 2018 Results (Volume I) - OECD
Dec 3, 2019 · The OECD Programme for International Student Assessment (PISA) examines what students know in reading, mathematics and science, and what ...Missing: origins | Show results with:origins
[46]
[PDF] PISA 2018 Results (Volume I) | OECD
In fact, only seven of the 79 education systems analysed saw significant improvements in the reading, mathematics and science performance of their students ...
[47]
https://julkaisut.valtioneuvosto.fi/bitstream/handle/10024/161921/PISA%252018%2520first%2520results%2520-%2520Brochure.pdf?sequence=1&isAllowed=y
[48]
[PDF] Highlights of U.S. PISA 2018 Results Web Report
In the United States, 14 percent of 15-year-old students in 2018 were top performers in reading literacy, scoring at proficiency levels 5 and above; 19 percent ...
[49]
PISA 2022 Results (Volume I) - OECD
Dec 5, 2023 · This is one of five volumes that present the results of the eighth round of assessment, PISA 2022. Volume I, The State of Learning and ...Philippines · Indonesia · United States · Mexico
[50]
PISA Scores by Country 2025 - World Population Review
Discover population, economy, health, and more with the most comprehensive global statistics at your fingertips.Pisa Scores By Country 2025 · Japan · Pisa 2022
[51]
Decline in educational performance only partly attributable ... - OECD
Dec 5, 2023 · The decline in performance can only partially be attributed to the COVID-19 pandemic, with falling scores in reading science and maths already apparent prior ...
[52]
Equity in education in PISA 2022: PISA 2022 Results (Volume I)
Dec 5, 2023 · Among the 10% weakest-performing students, girls outperformed boys on average across OECD countries (4 score points difference) and in 27 out of ...
[53]
Long-term trends in performance and equity in education - OECD
Dec 5, 2023 · PISA scores declined similarly for both high- and low-achieving students between 2012 and 2022 on average across OECD countries. In mathematics, ...
[54]
Average performance of 15-year-old students in mathematics, 2022
Dec 6, 2023 · Initially, the average PISA score across subjects and all OECD countries was at 500 with a standard deviation of 100, so that most students ...
[55]
Immigrant background and student performance: PISA 2022 ... - OECD
Dec 5, 2023 · Disparities in mathematics performance by immigrant background did not change between 2018 and 2022 in most countries/economies with comparable ...
[56]
Will the gap ever be bridged? A cross-national comparison ... - Genus
Aug 17, 2023 · This article analyses the evolution in the skills gap between native students and students with an immigrant background by comparing traditional (France, ...
[57]
The progression of achievement gap between immigrant and native ...
This paper depicts the evolution of gaps in academic performance between native and immigrant background students, as they progress from primary to secondary ...
[58]
Behind Singapore's PISA rankings success - The Conversation
Dec 8, 2016 · Singapore has topped the global Programme for International Student Assessment (PISA) rankings in maths, science and reading.
[59]
Why do Singaporean Students perform so well in PISA?
Dec 1, 2016 · Singapore has been widely recognised as one of the world's top-performing systems. ... What explains the top rankings in the current PISA tests?
[60]
Instruction time and student achievement: The moderating role of ...
I find that on average, an additional hour of instruction time leads to an increase of 0.03 standard deviations in students' test scores across all countries.
[61]
[PDF] Successful Education Reform: Lessons from Poland
The improvement in Poland's PISA scores was also greater and more consistent than that of other peer countries. Of the five transitional countries in ...
[62]
Publication: Successful Education Reform : Lessons from Poland
Poland's education reforms have produced a large overall improvement in educational performance, as measured by results on the Organization for Economic ...
[63]
School Autonomy and Accountability - OECD
PISA results suggest that, when autonomy and accountability are intelligently combined, they tend to be associated with better student performance...Missing: training | Show results with:training
[64]
Lessons from Singapore - Teacher's Notes
Jan 15, 2017 · Singapore's educational success is widely attributed to four factors; curriculum and pedagogy, teaching standards, leadership development and culture.
[65]
School Accountability, Autonomy, Choice, and the Level of Student ...
Our results reveal that different facets of accountability, autonomy, and choice are strongly associated with the level of student achievement across countries.Missing: training | Show results with:training
[66]
The rise and fall of Finland mania, part two: Why did scores plummet?
Jan 18, 2024 · Finland's average scale score went down by an incredible 79 points between 2003 and 2022—lapping the other laggards by miles. As of 2022, ...
[67]
General Intelligence and Socioeconomic Status as Strong Predictors ...
In the 2018 PISA survey, the 10% most socioeconomically advantaged students outscored their 10% most disadvantaged counterparts in reading by 1.5 standard ...
[68]
PISA 2022 Results (Volume I and II) - Country Notes: Viet Nam | OECD
Dec 5, 2023 · In Viet Nam socio-economically advantaged students (the top 25% in terms of socio-economic status) outperformed disadvantaged students (the ...
[69]
Vietnam's extraordinary performance in the PISA assessment
This paper examines the nature and drivers of Vietnam's paradoxical performance in the Program for International Student Assessment (PISA) – consistently ...
[70]
Regional differences in the educational outcomes of young immigrants
Sep 8, 2017 · In Canada, the average PISA math score of immigrant students aged 15 was similar to the score of third- or higher-generation students. · In ...
[71]
PISA Achievement in Sweden From the Perspective of Both ...
At the within-country and individual level, native Swedish students who took the PISA test in 2015 outperformed first- and second-generation migrants. Moreover, ...
[72]
Better migrants, better PISA results: Findings from a natural experiment
Sep 25, 2015 · We find that around 75% of the 40-point increase in the PISA score of first-generation immigrant students was due to changes in the individual background ...
[73]
Country and school family composition's effects on mathematics ...
Family structures are associated with achievement outcomes, but the percentage of children residing in different family structures has changed over time.
[74]
Family policy, family structure, and children's educational achievement
▻ Literacy scores for students vary by family structure. ▻ Students in single-mother homes fare worst than those in two-parent homes. ▻ Economic resources are a ...
[75]
Factors predicting mathematics achievement in PISA: a systematic ...
Jun 20, 2023 · Three major factors emerged at Level 2, namely family SES; family structure; and parental expectation and behavior. ... The impact of parental ...
[76]
[PDF] Sky's the Limit: Growth mindset, students, and schools in PISA. - OECD
For the first time in 2018, PISA included a “growth mindset” instrument to gauge students' beliefs about intelligence malleability. To date, this has been the ...
[77]
What Can Be Learned from Growth Mindset Controversies? - PMC
Research on these mindsets has found that people who hold more of a growth mindset are more likely to thrive in the face of difficulty and continue to improve, ...
[78]
[PDF] Students, digital devices and success | OECD
Excessive use of digital devices for leisure in classrooms can negatively impact students' academic performance. • 58% of students in France reported being ...
[79]
Why do East Asian children perform so well in PISA ... - ResearchGate
Aug 7, 2025 · My results suggest that second-generation East Asian immigrants outperform their native Australian peers by approximately 100 test points.
[80]
Learning motivations and effort beliefs in Confucian cultural context
Feb 2, 2023 · Many East Asian societies are culturally influenced by the Confucian tradition, which has a comprehensive value system emphasizing social roles, ...
[81]
[PDF] Let's Read Them a Story! The Parent Factor in Education | OECD
New findings from PISA show that parental involvement in education is pivotal for the success of children throughout their school years and beyond.
[82]
[PDF] Parental Involvement in Selected PISA Countries and Economies (EN)
May 7, 2012 · This working paper evaluates the levels of parental involvement across countries and sub-groups within countries, as well as the relationship ...
[83]
Digital Distractions in Class Linked to Lower Academic Performance
Dec 8, 2023 · The 2022 Program for International Student Assessment found that two-thirds of U.S. students get distracted by digital devices in class.
[84]
[PDF] PISA 2022 - Insights and Interpretations - OECD
Dec 5, 2023 · However, PISA results show no clear difference in recent performance trends between education systems with limited school closures such as ...
[85]
[PDF] The PISA Shock, Socioeconomic Inequality, and School Reforms in ...
The shock generated by the PISA release was grounded in the fact that Germany had quite a strong perception of its educational apparatus, believed to be an ...
[86]
The PISA shock, socioeconomic inequality, and school reforms in ...
In Germany, the poor performance in PISA 2000 stimulated a heated public debate and a strong policy response. The government reacted to the low average and ...
[87]
[PDF] Evidence from the German “PISA shock” - ifo Institut
As argued in the previous sections, the PISA shock in Germany led to an exogenous increase in the salience of the education topic, which rules out issues of ...
[88]
Poland • NCEE - National Center for Education and the Economy
Poland has transformed its education system, with major reforms in 1999, 2009, and 2015, including changes to school structure and curriculum.
[89]
Poland: Polish Education Reforms and Evidence from International ...
Nov 24, 2020 · The average performance of Polish students in PISA has improved since 2000 by more than 30 points in reading, which is one of the largest ...
[90]
PISA and Education Reform in Europe: Cases of Policy Inertia ...
Nov 12, 2021 · The present analysis examined the relationship between PISA results and their influence on policy development within a select group of European nations.
[91]
PISA 2018 in England, Northern Ireland, Scotland and Wales: Is the ...
Aug 28, 2021 · Results from PISA have had substantial real-world impact upon education policy (Baird et al., 2011). This includes reforms made to national ...School Nonresponse · Low Pupil Response Rates · Northern Ireland
[92]
[PDF] What Can PISA Tell Us about U.S. Education Policy?
Sep 22, 2014 · PISA analyses from 2012 demonstrate that there is a strong relationship between nation's levels of achievement and the extent to which they ...
[93]
[PDF] Lessons from PISA 2012 for the United States (EN) - OECD
This volume follows on from the report Strong Performers and Successful Reformers in Education: Lessons from PISA for the United States, which was published ...
[94]
The Policy Impact of PISA - OECD
This paper examines the normative impact of PISA by investigating how, and the extent to which , national policy actors use PISA in policies and practices, to ...Missing: competitiveness | Show results with:competitiveness
[95]
The Experience of Middle-Income Countries Participating in PISA ...
This report provides a systematic review and empirical evidence related to the experiences of middle-income countries and economies participating in the ...
[96]
The effects of PISA on global basic education reform: a systematic ...
Jan 29, 2025 · This study aimed to analyze findings from empirical research about the impact of PISA on global basic education policies.Missing: controversies | Show results with:controversies<|separator|>
[97]
[PDF] The Policy Impact of PISA: An Exploration of the Normative Effects of ...
Feb 22, 2012 · Assessment (PISA) affect national educational reform and policy-making. This paper examines the normative impact of PISA by investigating ...
[98]
[PDF] The Impact of the 1999 Education Reform in Poland
Between 2000 and 2006 Poland improved in PISA test scores by 0.16 to 0.28 of a standard deviation in science, math and reading. This was preceded in 1999 with ...
[99]
[PDF] What Caused the Improvement in the PISA Scores of Polish Students?
Poland's educational reforms and the improvement in students' scores in the PISA tests. There are four main hypotheses explaining this relationship, i.e. ...
[100]
The labour market effects of the polish educational reform of 1999
Sep 1, 2022 · The results indicate that the reform has increased employment probability (by around 3 percentage points) and earnings (by around 4%).
[101]
What Caused the Improvement in the PISA Scores of Polish Students?
Aug 6, 2025 · Zawistowska (2014) considers that the greatest impact on the increase in Poland's PISA scores was the educational reform made in 1999. In this ...
[102]
Expert: How PISA created an illusion of education quality and ...
Dec 3, 2019 · Furthermore, there is empirical evidence that suggests what PISA measures is not significantly different from other international assessments or ...
[103]
The politicization of PISA in evidence-based policy discourses
Jan 24, 2024 · The same report repeatedly noted the potential for unintended negative consequences such as narrowing of the curriculum, academic ...
[104]
[PDF] Some of the Impacts of a Narrowed Curriculum Resulting from High ...
Although an apparently widespread and unintended practice, narrowing the curriculum has been found to be one of the least effective ways to improving test ...
[105]
The failure of incentives to drive school improvement - ACER News
'Incentive schemes often result in unintended and undesirable behaviours on the part of teachers and schools, ranging from the narrowing of the school ...
[106]
Exemption or Exclusion? A study of student exclusion in PISA in ...
Dec 13, 2020 · This article focuses on Norway's experience with exclusion rates in PISA, including an analysis tracking this increase between 2000 and 2018.
[107]
[PDF] PISA's Inconsistencies - OBESSU
Concerning the assessment of national education systems, we have long criticised the reductionist methodology and use of the OECD Programme for International ...
[108]
The Long-Run Impact of Improving PISA Outcomes | Eric A. Hanushek
This paper uses recent economic modeling to relate cognitive skills – as measured by PISA and other international instruments – to economic growth.
[109]
'It Just Isn't Working': PISA Test Scores Cast Doubt on U.S. ...
Dec 5, 2019 · An international exam shows that American 15-year-olds are stagnant in reading and math even though the country has spent billions to close gaps with the rest ...
[110]
Students' Test Scores Unchanged After Decades of Federal ...
Dec 10, 2019 · Math and reading scores across the country have continued a yearslong stagnation, with students largely showing no progress in academic achievement.
[111]
(PDF) When Do Numbers Count? The Differential Impact of the PISA ...
May 24, 2013 · (PDF) When Do Numbers Count? The Differential Impact of the PISA Rating and Ranking on Education Policy in Germany and the US.
[112]
4 takeaways from the PISA results - The Thomas B. Fordham Institute
Dec 8, 2023 · Education reform has a near-singular focus on poor-performing students. Advanced students get cast off with an assurance that “they'll be ...
[113]
Singapore's Strong Showing in PISA 2022 - MOE
Dec 5, 2023 · Singapore's Strong Showing in PISA 2022 Affirms Resilience of Education System Through COVID-19 Pandemic.
[114]
(PDF) Chinese responses to Shanghai's performance in PISA
Aug 9, 2025 · This article analyses the public responses in China to Shanghai's performance in the 2012. Programme for International Student Assessment ...
[115]
[PDF] Immigration helps explain Sweden's school trouble
Aug 10, 2015 · Sweden's education performance has faltered in the past decades, with scores tumbling in the. OECD's international Pisa survey since the ...
[116]
PISA 2022 Results (Volume I and II) - Country Notes: Sweden | OECD
Dec 5, 2023 · In reading, the average difference in performance between immigrant and non-immigrant students was 81 score points in favour of non ...
[117]
PISA 2022 in Scotland: declining attainment and growing social ...
Dec 5, 2023 · In reading, inequality rose between 2012 and 2022 because the score in the lowest-status group fell twice as fast (a drop of 20 points) as ...Missing: UK response
[118]
https://www.edwardconard.com/macro-roundup/breaking-down-the-2022-pisa-math-results-by-subpopulation-cremieuxrecueil-finds-that-us-asians-and-whites-topped-the-charts-scoring-on-par-with-top-international-performers/
[119]
(PDF) Finland: Success Through Equity—The Trajectories in PISA ...
Besides, Finland's mathematical achievement in PISA remained at the top during the twodecade, its performance has been declining in recent years, including the ...
[120]
[PDF] Finland's Right to Learn Programme: Achieving equity and ... - OECD
Besides the progressive decline in Finland's PISA scores, a further concern relates to. Finland's equity gaps, which have been widening over the years as will ...
[121]
India Opts Out of International Student Evaluation PISA Test - The Wire
Mar 9, 2025 · Many, including the India government, had rejected the results asserting that students had scored low because of a 'cultural disconnect' with ...Missing: criticism | Show results with:criticism
[122]
'Pisa score reflects language gaps' | The Star
Feb 4, 2024 · Malaysia scored 388 for the reading domain, a drop of 27 points from 415 in 2018, with less than 50% of our students reaching the minimum level (Level 2) for ...
[123]
[PDF] Understanding Malaysia's decline in PISA scores - ISIS
Jul 16, 2024 · Our analysis suggests that Malaysia's average PISA scores are slightly lower than expected for its income level – signifying potential future ...Missing: irrelevance | Show results with:irrelevance
[124]
Government's education statistics “seriously flawed” | UCL News
Apr 22, 2021 · In the UK, around 40% of students are not included in the PISA data. · Scotland changed the PISA test date in 2018 to later in the school year.<|separator|>
[125]
Maths scores in world education rankings inflated for England and ...
Apr 22, 2021 · But there are serious flaws with some children being excluded from the study, schools being unwilling to participate, and some pupils not ...
[126]
Impact of differential item functioning on group score reporting in the ...
Nov 15, 2022 · We investigated the potential impact of differential item functioning (DIF) on group-level mean and standard deviation estimates using empirical and simulated ...
[127]
(PDF) How Many Plausible Values? - ResearchGate
Jul 8, 2025 · We show analytically and via simulation that the number of plausible values used determines the amount of Monte Carlo error on point estimates and standard ...Missing: critiques | Show results with:critiques
[128]
Some thoughts on analytical choices in the scaling model for test ...
Sep 3, 2022 · Unfortunately, the role of not-reached items becomes even more critical in scaling with the implementation of multi-stage testing because the ...Missing: criticisms | Show results with:criticisms
[129]
How accurate is the Pisa test? - BBC News
Dec 10, 2013 · "Pisa does present the uncertainty in the scores and ranks - for ... "But I believe that the imputation of plausible values, based on ...Missing: critique | Show results with:critique
[130]
Reanalysis of the German PISA Data: A Comparison of Different ...
May 26, 2020 · Our findings suggest that the change from paper-based to computer-based tests could have a severe impact on trend estimation but that the change ...
[131]
[PDF] Reliability analysis of PISA 2018 reading literacy student ... - ERIC
The main criterion determined by the PISA program while forming the sample groups for the tests is the sampling selection applied by weighting the size, ...Missing: critiques | Show results with:critiques
[132]
[PDF] THEORETICAL CONSIDERATIONS ON SCALING METHODOLOGY ...
Feb 16, 2023 · The objective of this study is to revisit the statistical modelling employed for the scaling in. PISA and to provide insights for maximising the ...
[133]
How similar are the PISA and TIMSS studies? | UCL IOE Blog
Dec 4, 2017 · Research has shown that TIMSS and PISA provide similar pictures of student achievement at the country level. A recent assessment published as a ...Missing: PIAAC | Show results with:PIAAC
[134]
Lasting effects of quality of schooling: Evidence from PISA and PIAAC
The PIAAC performance differences were strongly related to the PISA achievement trends (r = 0.70), and relations held up when controls were introduced for level ...Missing: validity | Show results with:validity
[135]
(PDF) TIMSS and PISA are not a Competition: Purpose, Difference ...
May 3, 2025 · TIMSS was found to focus on curriculum-based, grade-level achievements, whereas PISA emphasized age-based competencies applicable to real-world ...
[136]
[PDF] Comparisons Between PISA and TIMSS – Are We the Man with Two ...
Nov 20, 2006 · Rather than assessing the same subjects as TIMSS, PISA aims to assess reading literacy, mathematical literacy and scientific literacy, which it ...
[137]
(PDF) Cultural Capital and PISA - ResearchGate
It provides an objective evaluation of the influence of and criticisms against the role of PISA in education policymaking in many education systems worldwide.<|separator|>
[138]
geared towards success? Cultural origins of gender gaps in student ...
We find that the central cultural dimension that matters for gender gaps in student achievement is the extent to which a society emphasizes ambition, ...Missing: equity | Show results with:equity
[139]
How robust are socio‐economic achievement gradients using PISA ...
Nov 27, 2023 · This paper addresses the issue of potential bias that may impact estimates of socio-economic achievement gaps using PISA data. Estimates of ...Measurement Error In... · Data And Methods · AnalysisMissing: equity causes
[140]
[PDF] Bridging the divide: A review of global gaps in PISA performance
Nov 26, 2024 · Such lower-performing countries will be facing obsolete or too strict curricula that do not match the needs of a changing world [10]. Page 4 ...
[141]
Full article: Capturing the spark: PISA, twenty-first century skills and ...
Since its inception in 2000, the OECD's PISA programme has become the most influential comparative educational assessment and central to the emergence of ...
[142]
PISA score as an inappropriate measure for growth? Empirical ...
Mar 12, 2024 · The second hypothesis (H2) states that between 2006 and 2019, the rise in PISA scores in East Asia had a stronger influence on economic growth ...
[143]
PISA score as an inappropriate measure for growth? Empirical ...
Mar 12, 2024 · The literature often uses the PISA results as a proxy for growth, while its use and impact on growth are not empirically proven.
[144]
[PDF] Comparing NAEP, TIMSS, and PISA in Mathematics and Science
NAEP measures fourth-, eighth-, and twelfth-grade students' performance, most frequently in reading, mathematics, and science, with assessments designed ...
[145]
TIMSS vs. PISA: what can they tell us about student success?
Feb 19, 2024 · The results indicate that TIMSS and PISA assessments offer complementary information, particularly for low-performing schools. Our findings ...
[146]
[PDF] Synthesizing NAEP and International Large-Scale Assessment ...
Note: International assessments include the Progress in Reading Literacy Study (PIRLS), Trends in International. Mathematics and Science Study (TIMSS), and ...Missing: alternatives | Show results with:alternatives