Fact-checked by Grok 2 weeks ago

Item-total correlation

Item-total correlation, also known as corrected item-total correlation or item-rest correlation, is a Pearson product-moment correlation coefficient that measures the association between scores on a single test item and the total score derived from all other items in a multi-item scale or test, excluding the item in question.^[1] This statistic, rooted in classical test theory, assesses an item's contribution to the overall reliability and homogeneity of the instrument by indicating how well the item aligns with the underlying construct measured by the test.^[2] In test development and validation, item-total correlation serves as a critical tool for item selection and refinement, helping researchers identify and retain items that enhance internal consistency while flagging those that may dilute the test's coherence.^[2] Higher values signify stronger item-test congruence, which positively influences overall test reliability metrics such as Cronbach's alpha, as formalized in foundational psychometric literature.^[3] For example, during bottom-up construction (adding items) or top-down revision (deleting items), correlations guide decisions to maximize the test's ability to distinguish between respondents based on the targeted trait.^[2] The correlation is computed as r_{iR} = \frac{\text{cov}(X_i, R)}{\sigma_{X_i} \sigma_R}, where X_i is the score on the item, R is the rest score (total minus the item), cov denotes covariance, and \sigma represents standard deviation; this "corrected" form avoids artificial inflation from including the item in its own total.^[1] Interpretation thresholds vary by context, but values exceeding 0.30 are generally deemed acceptable for cognitive and personality assessments, with correlations below 0.20 often prompting item removal or revision to ensure the scale's unidimensionality.^[3] In practice, these correlations are most reliable with larger sample sizes (e.g., N ≥ 500) and when items have sufficient variance in difficulty and discrimination.^[2]

Fundamentals

Definition

Item-total correlation refers to the Pearson product-moment correlation coefficient calculated between the scores on a single test item and the total score derived from all other items in the test, excluding the item in question.^[4]^[5] This statistic, originally formulated by Karl Pearson in 1896 as a general measure of linear association, is applied in psychometrics to quantify the relationship between an individual item's performance and the overall test outcome.^[4] Within classical test theory (CTT), the primary purpose of item-total correlation is to evaluate the extent to which an individual item contributes to the measurement of the underlying construct or trait that the test intends to assess.^[6]^[7] Developed as a foundational framework in psychometrics by researchers such as Lord and Novick (1968), CTT posits that observed scores comprise true scores plus error, and item-total correlation helps determine if an item aligns with this true score component by indicating its discriminatory power across varying levels of the trait.^[6] Higher correlations suggest that the item effectively captures aspects of the construct, thereby supporting the test's validity and reliability.^[6] Unlike broader inter-item correlations, which examine pairwise relationships among multiple items, item-total correlation specifically emphasizes the item's association with the aggregate rest score to assess the test's overall homogeneity—the degree to which all items measure the same underlying dimension—and internal consistency.^[6]^[8] This focus makes it a key indicator of whether the item enhances the test's unidimensionality, as outlined in seminal work by Cronbach (1951) on internal structure.^[6] For instance, in a 20-item personality inventory designed to measure extraversion, the item-total correlation for the fifth item—perhaps assessing preference for social gatherings—would compute the Pearson correlation between responses to that item alone and the summed scores across the other 19 items for each respondent.^[6]

Computation

The item-total correlation is computed as the Pearson product-moment correlation coefficient between an individual item's scores and the rest score (total test score excluding the item) across a sample of respondents. The formula is given by

r_{it} = \frac{\text{Cov}(X_i, T')}{\sigma_{X_i} \cdot \sigma_{T'}},

where X_i represents the scores on the i-th item, T' is the rest score (T - X_i, with T being the total score), \text{Cov}(X_i, T') denotes the covariance between the item and rest scores, and \sigma_{X_i} and \sigma_{T'} are the standard deviations of the item scores and rest scores, respectively.^[2]^[9] To compute the item-total correlation, first score each item and sum the scores to obtain total test scores for the sample, then subtract the item score to get the rest score for each item. Apply the Pearson correlation formula using statistical software; for example, in SPSS, this is obtained via the Reliability Analysis procedure by selecting the scale items and reviewing the "Corrected Item-Total Correlation" output column, while in R, the psych package's alpha() function yields the same metric alongside Cronbach's alpha.^[10] An uncorrected version, using the full total score T including the item, can sometimes be computed but tends to inflate the correlation due to self-inclusion and is less commonly used in practice.^[2]^[11] Computation assumes the underlying data meet Pearson correlation prerequisites, including normally distributed scores and a linear relationship between the item and rest scores. Stability of the correlation estimate typically requires a sample size greater than 30 respondents, though larger samples (e.g., n > 100) enhance precision in psychometric applications.^[2]

Applications

Item Analysis

Item-total correlation plays a central role in item analysis within classical test theory (CTT), serving as a key metric for evaluating the quality of individual test items during the development and refinement of psychometric instruments. In this process, developers pilot a test on a representative sample and subsequently compute the item-total correlation for each item to determine its alignment with the overall construct measured by the test. This correlation assesses the extent to which an item's scores covary with the total test score, thereby indicating the item's contribution to the test's overall variance and its ability to discriminate between respondents of varying ability levels.^[12] Historically, the use of item-total correlation in item analysis emerged in the early 20th century as part of the foundational developments in psychometrics under CTT, building on Charles Spearman's 1904 introduction of reliability concepts and correlation corrections for measurement error. A pivotal advancement came in 1936 when Marion Richardson demonstrated that excluding items with low item-test correlations could enhance overall test reliability, assuming comparable item variances; this was further formalized in the 1937 Kuder-Richardson formulas for reliability estimation. These early contributions established item-total correlation as a systematic tool for test validation, predating the advent of item response theory (IRT) in the mid-20th century by emphasizing aggregate score relationships over probabilistic modeling of individual responses.^[13] In practice, item analysis integrates item-total correlation with other indices, such as item difficulty (the proportion of respondents answering correctly), to provide a multifaceted evaluation. After computing correlations, items are scrutinized for their discriminatory power: those with low positive or negative correlations are flagged as potentially misaligned with the test's construct, often due to factors like ambiguous wording, irrelevant content, or poor alignment with the intended ability. For instance, developers may integrate difficulty levels—typically aiming for moderate difficulty (e.g., 30-70% correct responses)—to ensure that low correlations are not solely attributable to items being too easy or too hard, which could limit variance and thus correlation strength. This combined approach allows for targeted revisions, such as rephrasing or eliminating problematic items, to optimize the test's homogeneity and effectiveness.^[12]^[14] A representative application occurs in educational testing, where an item yielding an item-total correlation of 0.15 might signal issues like ambiguity or lack of relevance to the construct, prompting revision or deletion to avoid diluting the test's validity. Conversely, an item with a correlation of 0.45 would indicate strong alignment and contribution to total variance, supporting its retention in the final test form. Such evaluations ensure that retained items collectively enhance the test's ability to measure the targeted trait reliably.^[14]

Reliability Assessment

Item-total correlations play a crucial role in assessing the internal consistency of a test or scale, particularly through their connection to Cronbach's alpha, a widely used measure of reliability. Cronbach's alpha is calculated using the formula

\alpha = \frac{k}{k-1} \left(1 - \frac{\sum \mathrm{Var}(X_i)}{\mathrm{Var}(T)}\right),

where k is the number of items, \mathrm{Var}(X_i) is the variance of item i, and \mathrm{Var}(T) is the variance of the total score. High average item-total correlations (r_{it}) contribute to higher alpha values because they reflect stronger inter-item covariances, which reduce the ratio of item variances to total variance in the formula. In unidimensional tests, the average item-total correlation approximates the test's reliability coefficient, providing a direct indicator of how well items cohere to measure a single underlying construct.^[15]^[16]^[2] A primary application of item-total correlations in reliability assessment is scale purification, where items with low r_{it} (typically below 0.30) are iteratively removed to enhance overall internal consistency. This process is common in questionnaire development within psychology and education, as it helps refine multi-item scales by eliminating items that do not contribute meaningfully to the total score, thereby maximizing Cronbach's alpha without altering the scale's intended dimensionality. For instance, in test construction simulations, selecting items based on corrected item-total correlations has been shown to closely align with optimal ordering for achieving maximum test-score reliability.^[2] Psychometric studies demonstrate that optimizing item-total correlations through such purification can substantially improve test reliability in multi-item scales. For example, removing an item with a poor correlation from a customer service scale raised alpha from 0.785 to 0.922 for the remaining three items, illustrating a relative improvement of about 17%. These enhancements underscore the practical value of item-total correlations in ensuring robust, reliable measurement tools for research and assessment.^[17]^[18]

Interpretation

Threshold Guidelines

In psychometrics, item-total correlations (r_it) are evaluated against established thresholds to determine an item's contribution to scale reliability and validity. Values exceeding 0.30 are generally considered acceptable, indicating strong alignment between the item and the overall construct measured by the test. Correlations in the range of 0.20 to 0.30 are viewed as marginal, prompting further review of the item's wording, relevance, or potential revisions. Scores below 0.20 signal poor performance, often justifying item deletion to enhance scale quality, while negative correlations typically indicate issues such as the need for reverse scoring on negatively worded items or fundamental misfit with the construct, requiring immediate attention.^[19]^[20]^[2] These thresholds vary by test characteristics and scale type. For shorter tests with fewer than 10 items, slightly lower minimums around 0.20 may suffice due to reduced opportunities for item intercorrelations, though higher values remain preferable. In the context of Likert-type scales assessing narrow or unidimensional constructs, correlations above 0.40 are recommended to ensure robust item-scale homogeneity.^[21]^[22] Influential psychometric guidelines provide foundational benchmarks for these evaluations. Seminal work in psychometrics, such as Nunnally's (1978) Psychometric Theory, proposes a minimum r_it of 0.20 for power tests (e.g., those without strict time limits) and 0.40 or higher for speed tests, influencing widespread adoption in scale development.^[20] Practical decision rules guide item retention or removal based on these thresholds. If an item's r_it falls below the established cutoff, developers should first assess its content validity—ensuring it adequately represents the target construct—before deletion, as statistical weakness alone may not warrant exclusion if theoretical relevance is strong. This stepwise approach balances empirical rigor with conceptual integrity in test refinement.^[21]^[19]

Influencing Factors

Several factors can influence the magnitude of item-total correlations (r_it), affecting their reliability and interpretability in psychometric analysis. Sample characteristics play a significant role, particularly sample size and composition. Small sample sizes, typically fewer than 50 participants, lead to inflated variability in r_it estimates due to the high standard error of the correlation coefficient, making the values unstable and less representative of the population parameter.^[23] Similarly, samples with restricted range—often resulting from selecting homogeneous groups with limited variability in the underlying trait—attenuate observed r_it values by reducing the shared variance between the item and total score, as the correlation coefficient is sensitive to truncated distributions.^[24] In contrast, broader, more heterogeneous samples that capture greater trait variability tend to yield higher and more stable r_it, provided the test measures the construct consistently across subgroups.^[25] Test design issues also systematically alter r_it. In multidimensional tests, where items tap into multiple underlying constructs, the total score encompasses unrelated dimensions, diluting the correlation for any single item with the overall scale and often resulting in lower r_it values than in unidimensional instruments. Ceiling and floor effects, arising from items with extreme difficulty levels (e.g., too easy or too hard for the sample), further suppress r_it by limiting item variance and response differentiation, as most respondents cluster at the scale endpoints, reducing the item's ability to covary meaningfully with the total score.^[26] Item properties inherent to wording and scoring can artificially depress r_it. Ambiguous or poorly worded items introduce response inconsistency or random error, leading to weaker associations with the total score and consequently lower correlations, as respondents may interpret the item differently, undermining its measurement precision.^[12] For reverse-scored items—intended to counter acquiescence bias but phrased in the opposite direction of the construct—failure to apply the reversal transformation before computation results in negative or near-zero r_it, as the item's scores inversely relate to the total without adjustment.^[27] Statistical artifacts, such as outliers and non-normal distributions, introduce additional bias in Pearson-based r_it estimates. Outliers can distort the linear relationship, often pulling the correlation downward by disproportionately influencing the covariance term in extreme cases.^[28] Non-normal distributions, particularly those with skewness or kurtosis, further bias r_it downward, as the Pearson coefficient assumes bivariate normality for optimal performance and may underestimate true associations under violations of this assumption.^[29]

Item-Rest Correlation

The item-rest correlation is synonymous with the corrected item-total correlation as defined in this article, representing the Pearson product-moment correlation between an individual item's score X_i and the rest-score T', where T' represents the total test score T excluding the contribution of that specific item (T' = T - X_i).^[2] This approach eliminates the artificial inflation caused by the item's self-correlation that would occur if using an uncorrected total score including the item itself, providing a purer measure of the item's relationship to the underlying construct as captured by the remaining items.^[30] The formula for the item-rest correlation r_{ir} is given by:

r_{ir} = \frac{\text{Cov}(X_i, T')}{\sigma_{X_i} \cdot \sigma_{T'}}

where \text{[Cov](/page/Covariance)}(X_i, T') is the covariance between the item score and the rest-score, and \sigma_{X_i} and \sigma_{T'} are their respective standard deviations.^[2] This formulation, proposed by Henrysson in 1963, corrects for the overlap inherent in any uncorrected item-total correlations and has become a standard in psychometric item analysis.^[30] One key advantage of the item-rest correlation is that it offers an unbiased estimate of an item's contribution to the overall test, avoiding the overestimation that occurs when the item correlates with itself in an uncorrected total score.^[30] This makes it particularly valuable in modern psychometrics for item selection during test construction, as it better reflects the item's true discriminative power relative to the scale's other components.^[31] Empirical analyses consistently show that item-rest correlations provide a more conservative assessment than uncorrected item-total correlations, as the exclusion of the item reduces the shared variance, especially for items with high internal variance.^[2]

Discrimination Statistics

Discrimination statistics provide alternative metrics to item-total correlation for evaluating item quality in psychometrics, emphasizing an item's ability to differentiate between high- and low-performing groups rather than its overall linear relationship with total scores. These approaches are particularly useful in classical test theory for assessing how well items separate examinees based on ability levels.^[32] One common discrimination statistic is the point-biserial correlation, applicable to dichotomous items (e.g., correct/incorrect responses), which measures the correlation between item scores (coded as 0 or 1) and total test scores. The formula for the point-biserial correlation coefficient r_{pb} is given by:

r_{pb} = \frac{M_u - M_l}{SD_{total}} \sqrt{P(1 - P)}

where M_u is the mean total score for the upper (high-performing) group, M_l is the mean for the lower (low-performing) group, SD_{total} is the standard deviation of total scores across all examinees, and P is the proportion of examinees answering the item correctly. This statistic quantifies the extent to which success on the item aligns with higher overall performance.^[33] Another widely used metric is the upper-lower discrimination index, which directly compares performance on the item between the top and bottom groups, typically defined as the highest and lowest 27% of examinees based on total scores. The index D is calculated as:

D = P_u - P_l

where P_u is the proportion correct in the upper group and P_l is the proportion correct in the lower group. Values of D > 0.40 indicate strong discrimination, meaning the item effectively distinguishes high- from low-ability examinees.^[34]^[35] Both point-biserial correlation and the upper-lower discrimination index assess item quality by focusing on group differentiation, but they differ from item-total correlation in emphasis: while item-total correlation evaluates the item's covariance with the entire test score, discrimination statistics prioritize the item's capacity to separate extreme performers, providing a more targeted view of discriminative power.^[32]^[12] In multiple-choice tests, a scenario where the upper-lower discrimination index is low despite a moderate item-total correlation may indicate issues such as excessive guessing by low performers, which inflates correct responses in the lower group without reflecting true ability differences.^[12]

References

[1]
Item-Score Reliability in Empirical-Data Sets and Its Relationship ...
In test construction, the item-rest correlation is used to define the association of the item with the total score on the other items. Higher item-rest ...
[2]
Item-Score Reliability as a Selection Tool in Test Construction
Jan 10, 2019 · In test construction, the corrected item-total correlation is used to define the association of the item with the total score on the other items ...Introduction · Item Selection in Test... · Simulation Study · Discussion
[3]
Item Total Correlation - an overview | ScienceDirect Topics
Item-total correlation is defined as the correlation of a single item with the total set of items on a scale, excluding that item. This correlation helps ...
[4]
(PDF) Some hidden characteristics of item-total correlation and ...
Jun 25, 2025 · The item-total correlation or item-test correlation (Rit) is a widely used classical estimator of item-score association which is used as an ...
[5]
Item Analysis Report – Item-Total Correlation Discrimination
Dec 16, 2013 · Higher positive values for the item-total correlation indicate that the item is discriminating well between high- and low-performing ...Missing: definition | Show results with:definition
[6]
[PDF] Classical Test Theory and the Measurement of Reliability
The problem in estimating total reliability is to determine how much of the total variance is due to specific or unique item variance. Shading represent the ...
[7]
https://www.sciencedirect.com/science/article/pii/B0080430767007221
[8]
Encyclopedia of Research Design
A preferred concept might be the item–rest correlation, which is the correlation between the item and the sum of the rest of the item scores. Another term ...Missing: definition | Show results with:definition
[9]
Methods and formulas for Item Analysis - Minitab - Support
The standard deviation of the total mean is the square root of the average squared deviation of all total scores from the total mean score.
[10]
Cronbach's Alpha (α) using SPSS Statistics
Step-by-step instructions on how to run Cronbach's Alpha in SPSS Statistics using a relevant example. This guide shows you the procedure as well as the ...
[11]
Methods for Estimating Item-Score Reliability - PMC - NIH
Examples are the corrected item-total correlation (Nunnally, 1978, p. 281), which quantifies how well the item correlates with the sum score on the other ...Missing: formula | Show results with:formula
[12]
Understanding Item Analyses – Institutional Assessment & Evaluation
Various hand calculation procedures have traditionally been used to compare item responses to total test scores using high and low scoring groups of students.Missing: variant | Show results with:variant
[13]
[PDF] Classical Test Theory in historical Perspective - Winsteps.com
Then in 1904 Charles Spearman showed us how to correct a correla- tion coefficient for attenuation due to measurement error and how to obtain the index of ...
[14]
Item Analysis in Psychometrics: Improve Your Test
Mar 31, 2021 · ... psychometric software. Download a free copy of Iteman: Software for Item Analysis. What is Item Analysis in psychometrics? Item analysis ...Missing: seminal | Show results with:seminal
[15]
Coefficient alpha and the internal structure of tests | Psychometrika
A general formula (α) of which a special case is the Kuder-Richardson coefficient of equivalence is shown to be the mean of all split-half coefficients.
[16]
Making sense of Cronbach's alpha - PMC - NIH
Jun 27, 2011 · If the items in a test are correlated to each other, the value of alpha is increased. However, a high coefficient alpha does not always mean a ...
[17]
Cronbach's Alpha: Definition, Calculations & Example
Cronbach's alpha quantifies the level of agreement on a standardized 0 to 1 scale. Higher values indicate higher agreement between items. High Cronbach's alpha ...
[18]
Item-Score Reliability as a Selection Tool in Test Construction - PMC
Jan 11, 2019 · This study investigates the usefulness of item-score reliability as a criterion for item selection in test construction.
[19]
Best Practices for Developing and Validating Scales for Health ... - NIH
Jun 11, 2018 · Items with very low adjusted item-total correlations (< 0.30) are less desirable and could be a cue for potential deletion from the tentative ...
[20]
Methods for Estimating Item-Score Reliability - Sage Journals
Apr 9, 2018 · ... item indices. Examples are the corrected item-total correlation (Nunnally, 1978, p. 281), which quantifies how well the item correlates with ...Method Ms · Simulation Study · Coefficient Alpha
[21]
Selecting the items | Health Measurement Scales - Oxford Academic
Item-total correlation. One of the oldest, albeit still widely used, methods for checking the homogeneity of the scale is the item–total correlation. As the ...
[22]
[PDF] Validation of general job satisfaction in the Korean Labor and ...
A correlation coefficient of 0.40 or higher was used as a cut-off for identifying the candidate items [6].
[23]
[PDF] standards_2014edition.pdf
American Educational Research Association. Standards for educational and psychological testing / American Educational Research Association,.
[24]
At what sample size do correlations stabilize? - ScienceDirect.com
Sample correlations converge to the population value with increasing sample size, but the estimates are often inaccurate in small samples.
[25]
Correction for range restriction: Lessons from 20 research scenarios
The consequence of failing to correct for range restriction is biased correlations that will not represent the unrestricted sample. Failing to correct for range ...
[26]
Restricted Range - Statistics How To
Mar 11, 2025 · In fact, when the range is restricted, a peculiar phenomenon happens: the correlation coefficient goes down. The following image shows the ...
[27]
Investigation of causes of ceiling effects on working alliance measures
Jul 21, 2022 · Ceiling effects refer to a set of scores clustering toward the top of the range for an item, subscale, or total scale score. Because traditional ...<|control11|><|separator|>
[28]
Psychometric Properties of Reverse-Scored Items on the CES-D in a ...
Reverse-scored items on assessment scales increase cognitive processing demands, and may therefore lead to measurement problems for older adult respondents.
[29]
Robust Correlation Analyses: False Positive and Power ... - Frontiers
Jan 9, 2013 · Our simulations showed that when outliers contaminate data, Spearman's correlation indeed performs better than Pearson's correlation and can ...
[30]
Reducing Bias and Error in the Correlation Coefficient Due to ... - NIH
With nonnormal data, the traditional Pearson product–moment correlation may mischaracterize relationships in more noticeable ways. When using the Pearson ...
[31]
Correction of item-total correlations in item analysis | Psychometrika
The biserial correlation between an item and the total test of which the item is a part tends to be misleadingly high when used in item analysis, ...
[32]
[PDF] International Journal of Educational Methodology - ERIC
Apr 5, 2020 · ... item discrimination power is one of the two to five item parameters that characterize the test items (e.g., Lord & Novick 1968). Two other ...
[33]
[PDF] Item point-biserial discrimination
The first step in calculating the point-biserial correlation coefficient for a distractor is to assign dummy values to the item. Traditionally, one is for ...
[34]
Item-total point-biserial correlation - Assessment Systems (ASC)
Jul 28, 2021 · The point-biserial coefficient is a Pearson correlation between scores on the item (usually 0=wrong and 1=correct) and the total score on the test.Missing: formula | Show results with:formula
[35]
[PDF] Item-Analysis-Definitions.pdf
Point Biserial - The correlation between the right/wrong scores that students receive on a given item and the total scores that the students receive when ...
[36]
Interpretation of Discrimination Index [40] | Download Table
The index ranges from -1.00 to +1.00 and classified as satisfactory, acceptable, marginal or poor items if their discrimination indices are ≥0.40, 0.30 to ≤0.39 ...Missing: strong | Show results with:strong