Fact-checked by Grok 2 weeks ago

Information quality

Information quality refers to the extent to which information satisfies the stated and implied needs of its users, ensuring it is fit for purpose in supporting decision-making and actions within organizations and society.^[1] Often used interchangeably with data quality in scholarly contexts, it emphasizes the usability and reliability of information as a resource in the information age.^[2] A foundational framework for understanding information quality was developed by Wang and Strong in 1996, categorizing it into four primary groups: intrinsic, contextual, representational, and accessibility.^[3] Intrinsic dimensions focus on the inherent properties of the information, including accuracy (freedom from errors), believability (trustworthiness), objectivity (impartiality), and reputation (perceived credibility of the source).^[2] Contextual dimensions address suitability for specific tasks, such as relevancy (appropriateness to the user's needs), timeliness (availability when needed), completeness (absence of missing elements), and value-added (benefits exceeding costs).^[2] Representational aspects ensure clear presentation, encompassing interpretability (clarity of meaning), ease of understanding, concise representation, and consistent representation.^[2] Accessibility dimensions highlight usability, including accessibility (ease of access), security (protection from unauthorized use), and related operational features.^[2] These dimensions are not fixed but vary by context, user, and time, with accuracy, completeness, timeliness, consistency, and relevance identified as the most frequently studied and critical attributes across research.^[2] High information quality reduces uncertainty in decision-making, enhances organizational performance, and mitigates risks from poor data, such as flawed analyses or inefficient processes.^[1] Measurement approaches combine objective assessments (e.g., conformance to standards) and subjective evaluations (e.g., user perceptions), often tailored to specific domains like healthcare or business intelligence.^[1] As information systems evolve with big data and AI, ongoing research emphasizes dynamic frameworks to address emerging challenges in quality assurance.^[2]

Fundamentals

Definition and Scope

Information quality is defined as the degree to which information meets the stated or implied needs of its users, encompassing key attributes such as accuracy, completeness, timeliness, and relevance.^[3] This definition emphasizes the practical utility of information in supporting tasks like decision-making and problem-solving, rather than mere technical correctness.^[4] A central principle underlying this definition is "fitness for use," which assesses information based on its suitability for intended applications, drawing from quality management concepts in ISO 9000 standards that describe quality as the extent to which inherent characteristics fulfill requirements. In the context of information, this principle shifts focus from absolute perfection to contextual appropriateness, ensuring that information aligns with user expectations and purposes.^[3] The scope of information quality extends across diverse formats, including digital data in databases and non-digital forms such as printed reports or traditional media broadcasts, where credibility and reliability remain critical concerns.^[5] Perspectives on quality can be user-centric, prioritizing how well information serves specific individual or organizational needs like relevance and understandability, or system-centric, focusing on intrinsic properties such as syntactic accuracy and consistency within the information system itself.^[3] For instance, high-quality information facilitates effective decision-making by providing reliable insights, whereas low-quality information in healthcare records has been linked to errors including misdiagnoses and adverse patient outcomes.^[6]^[7]

Historical Evolution

The concept of information quality emerged in the mid-20th century, rooted in statistical quality control principles from manufacturing that were adapted to data management. In the 1950s, pioneers like W. Edwards Deming and Joseph Juran emphasized process control and continuous improvement to minimize defects, influencing early applications to data as a form of "product" in emerging computing systems.^[8] By the 1960s, as databases began to take shape, these ideas intersected with database theory, where data accuracy and reliability were seen as essential for operational efficiency, though formal frameworks were still nascent.^[9] Hans Peter Luhn's 1958 work on business intelligence further highlighted the need for high-quality data to support decision-making in automated systems.^[9] The 1990s marked a pivotal rise in information quality as a distinct field, driven by the explosion of data from data warehousing and enterprise systems. Thomas Redman's 1996 book, Data Quality for the Information Age, introduced key dimensions like accuracy and timeliness, framing data quality as a critical business asset rather than a technical afterthought. Concurrently, Richard Wang and Diane Strong's 1996 framework categorized data quality into intrinsic, contextual, representational, and accessibility dimensions, providing a foundational taxonomy that influenced subsequent research.^[10] Larry English advanced this through Total Information Quality Management (TIQM), adapting manufacturing quality methods like Deming's cycle to holistic information processes, as detailed in his 1999 book Improving Data Warehouse and Business Information Quality.^[11] In the 2000s, formalization accelerated with organizational standards and tools. The Data Management Association (DAMA) incorporated data quality into its Data Management Body of Knowledge (DMBOK), first published in 2009 and expanded in subsequent editions, emphasizing governance and assessment practices.^[12] Jack Olson's 2003 book Data Quality: The Accuracy Dimension popularized data profiling techniques for assessing and improving accuracy at scale.^[13] The ISO 8000 series, initiated around 2004 and with core parts published from 2007, established international standards for data quality in exchanges, defining portable, verifiable data characteristics.^[14] The 2010s and 2020s saw evolution driven by big data and AI, shifting focus from static assessments to dynamic, real-time monitoring. The volume and velocity of data from sources like social media and IoT necessitated automated quality controls, as big data frameworks like Hadoop amplified issues of veracity and integration.^[8] AI advancements, particularly machine learning models reliant on clean datasets, further propelled innovations in predictive quality assurance, with tools emerging for anomaly detection and continuous validation in pipelines.^[9] The second edition (DAMA-DMBOK2) was published in 2017, and as of 2025, work on the third edition is underway to incorporate advancements in data management.^[12] This era built on earlier foundations, integrating TIQM principles into scalable systems to address conceptual challenges from data proliferation.^[15]

Core Concepts

Conceptual Challenges

One of the primary conceptual challenges in information quality lies in its inherent subjectivity, as perceptions of quality are shaped by individual user needs and contexts rather than fixed attributes. For instance, timeliness may be paramount for financial analysts relying on real-time market data, where delays can lead to significant losses, but it holds lesser importance for historians accessing archival records preserved for long-term reference. This variation underscores that information quality is not an absolute property but a relational one, dependent on the consumer's perspective and intended use.^[3] Context-dependency further complicates the assessment of information quality, particularly in multi-stakeholder environments where conflicting priorities can transform valuable data for one group into irrelevant noise for another. In collaborative projects, such as healthcare systems involving providers, patients, and regulators, the same dataset might be deemed high-quality by clinicians for its clinical accuracy but inadequate by administrators due to insufficient aggregation for policy analysis. This relativity arises because quality emerges from the fit between information and its application context, making universal standards elusive.^[16] Trade-offs represent another core challenge, requiring balances between competing quality attributes that often cannot be optimized simultaneously. For example, achieving completeness in data collection enhances analytical depth but may conflict with privacy protections under regulations like the EU's General Data Protection Regulation (GDPR), which mandates data minimization to safeguard personal information. Similarly, prioritizing accuracy through rigorous verification processes can delay information delivery, undermining timeliness in fast-paced domains like emergency response. These tensions highlight the need for deliberate prioritization, as overemphasizing one dimension invariably compromises others.^[17]^[18] Philosophical debates further illuminate these challenges, drawing from epistemology to question whether information quality reflects objective truth or a socially constructed phenomenon. Traditional epistemological views posit quality as tied to veridical representation—information that accurately mirrors reality—yet constructivist perspectives argue it is negotiated within communities, influenced by cultural norms and power dynamics. Luciano Floridi's philosophy of information, for instance, frames quality through levels of well-formedness, meaning, and truthfulness, but acknowledges debates over whether these criteria impose universal standards or merely reflect contextual agreements. Such discussions reveal the tension between aspiring to objective benchmarks and recognizing quality's interpretive nature.^[19]^[20]

Theoretical Foundations

The theoretical foundations of information quality draw from several seminal frameworks that conceptualize quality as a multifaceted construct essential for effective decision-making and system performance. One core theory is Total Data Quality Management (TDQM), developed by Larry English, which integrates quality principles into organizational processes by treating information as a critical asset requiring continuous improvement through definition, measurement, analysis, and enhancement activities.^[21] TDQM emphasizes a holistic approach, adapting quality management methodologies like those from Deming and Juran to ensure information meets end-user needs across its lifecycle. Complementing this, the model proposed by Wang and Strong in 1996 categorizes information quality into four primary dimensions: intrinsic (inherent accuracy and reliability), contextual (relevance to specific tasks), representational (clarity and interpretability), and accessibility (ease of obtaining the information).^[3] This framework shifts focus from mere accuracy to a consumer-centric view, highlighting how quality perceptions vary by use case. Foundational frameworks further solidify these theories by providing standardized and semantically grounded structures. The ISO/IEC 25012 standard, established in 2008, defines a data quality model specifically for structured data in software products, outlining 15 characteristics such as accuracy, completeness, and timeliness to guide evaluation in system design and maintenance.^[22] Similarly, semantic accuracy theory, as articulated by Wand and Wang in 1996, links information quality to the faithful representation of real-world semantics through ontological foundations, positing that high-quality data must correctly capture entities, relationships, and states without ambiguity or misrepresentation.^[23] This theory underscores the representational dimension by anchoring quality assessments in conceptual modeling, ensuring data aligns with intended meanings. Multidimensional models integrate these foundations with broader system success metrics, particularly emphasizing user satisfaction. For instance, the DeLone and McLean Information Systems Success Model (updated in 2003) incorporates information quality as a key component alongside system quality and service quality, arguing that superior information quality enhances user satisfaction, intention to use, and net benefits by delivering relevant, accurate, and timely outputs. This integration illustrates how theoretical models interconnect to form a cohesive understanding of quality's role in achieving organizational outcomes. The evolution of these theories reflects a progression from product-based views—treating information as a static artifact evaluated post-creation—to process-based perspectives that embed quality management within dynamic data lifecycles. Early models focused on inherent attributes of the data product itself, whereas contemporary frameworks like TDQM advocate for proactive, iterative processes that address quality at every stage from acquisition to dissemination. This shift accommodates the complexities of modern information environments, where data flows continuously and quality must be sustained through ongoing governance.

Dimensions and Measurement

Key Dimensions

Information quality is commonly assessed through a set of key dimensions that capture its multifaceted nature, often categorized into intrinsic, contextual, representational, and accessibility aspects, as outlined in foundational frameworks for data quality evaluation.^[3] These dimensions provide a structured way to understand what makes information suitable for use, emphasizing attributes independent of specific contexts or applications. The seminal work by Wang and Strong (1996) identifies 15 dimensions across these four categories.^[3] Intrinsic dimensions focus on the inherent properties of the information itself, regardless of its use or context. Accuracy refers to the extent to which the information is correct, reliable, and free of error. Believability measures the extent to which the information is accepted as true and credible. Objectivity assesses the impartiality and lack of bias in the information. Reputation evaluates the trustworthiness of the source or content.^[3] Contextual dimensions evaluate how well the information aligns with the needs and circumstances of its intended use. Relevancy measures the applicability of the information to specific tasks or decisions. Timeliness assesses whether the age of the information is appropriate for the task. Completeness involves the extent to which the information is of sufficient breadth, depth, and scope for the task, without missing elements. Value-added considers the benefits provided by the information exceeding its costs. Appropriate amount of data ensures the quantity of available information is suitable, neither too much nor too little.^[3] Representational dimensions concern the clarity and efficiency of how the information is presented. Interpretability emphasizes the use of appropriate language, units, and clear definitions. Ease of understanding ensures the information is clear and comprehensible without ambiguity. Representational consistency maintains uniform presentation across formats and compatibility with prior data. Concise representation delivers the information compactly, without redundancy or overwhelming detail.^[3] Accessibility dimensions address the practical usability and protection of the information. Accessibility refers to the ease and quick retrievability of the information. Access security involves restrictions and safeguards to prevent unauthorized access and maintain confidentiality and integrity.^[3] These dimensions are not isolated; they exhibit interdependencies that influence overall information quality. For instance, achieving high accuracy may come at the expense of timeliness, as verifying data for errors can delay its availability, creating trade-offs in dynamic environments. Similarly, enhancing completeness might reduce conciseness if additional details introduce redundancy, underscoring the need to balance dimensions based on contextual priorities. Such interactions highlight that optimizing one dimension can inadvertently affect others, requiring holistic consideration in quality assessments.

Metrics and Evaluation Methods

Metrics for evaluating information quality are broadly categorized into objective and subjective types. Objective metrics provide quantifiable, verifiable measures based on predefined rules or statistical analysis, such as error rates calculated as (number of errors / total records) × 100, which assess the proportion of inaccuracies in a dataset.^[24] In contrast, subjective metrics rely on human judgment, often through user surveys evaluating aspects like relevance or usability, introducing variability but capturing contextual nuances that automated methods may overlook.^[25] Specific formulas operationalize key dimensions of information quality. For completeness, the metric is defined as the ratio of complete records to total records, expressed as (number of complete records / total records), indicating the extent to which required data fields are populated.^[26] Accuracy is commonly measured as 1 - (error count / sample size), where errors are discrepancies identified against a reference standard, yielding a proportion of correct data within a sampled subset. Evaluation approaches encompass several established methods to apply these metrics. Data profiling involves statistical analysis of datasets to summarize structure, patterns, and anomalies, such as frequency distributions or null value counts, facilitating initial quality insights without domain-specific rules.^[27] Rule-based checking enforces predefined constraints, like syntax validation for formats (e.g., ensuring email addresses match regex patterns), to detect violations systematically across large volumes.^[28] Golden record comparison benchmarks data against a trusted master record, calculating match rates or discrepancies to verify accuracy and consistency in master data management contexts.^[29] Standards for metrics are outlined in frameworks like the DAMA-DMBOK, which recommends aligning measures with business objectives and dimensions such as accuracy and completeness, emphasizing reproducible and scalable assessments.^[30] Emerging AI-driven metrics incorporate machine learning for anomaly detection to evaluate consistency, where models like isolation forests identify outliers deviating from expected patterns, enhancing detection in dynamic environments.^[31] Despite these advances, limitations persist, particularly scalability issues in big data environments, where traditional metrics struggle with volume and velocity, leading to high computational costs and incomplete coverage during real-time processing.^[32]

Practices and Standards

Standards

International standards provide frameworks for ensuring information quality across industries. ISO 8000, titled "Data quality," establishes requirements for data quality management, including syntax, semantics, and master data quality, with parts like ISO 8000-150:2022 specifying roles and responsibilities for organizations.^[33] Complementing this, ISO/IEC 25012:2008 defines a data quality model with characteristics such as accuracy, completeness, and timeliness, serving as a basis for evaluating and improving data products in software systems.^[34] These standards promote interoperability and compliance, particularly in sectors like manufacturing and information technology, by aligning practices with measurable criteria.

Assessment Techniques

Assessment techniques for information quality encompass a range of practical methods employed in organizational settings to evaluate the reliability, accuracy, and usability of data assets. These techniques typically include manual audits, which involve systematic reviews by human experts to identify inconsistencies and errors through sampling and verification processes; automated profiling tools, such as Talend and Informatica, which analyze data structures and content to detect patterns, anomalies, and quality issues at scale; and hybrid approaches that combine human oversight with automation for more nuanced evaluations.^[35]^[36]^[37] A standard step-by-step process for assessment begins with data profiling, which serves as the discovery phase to examine data sources for completeness, validity, and relationships, often using summary statistics and pattern analysis. This is followed by cleansing validation, where sampled or profiled data is checked against predefined rules to confirm accuracy and consistency post-initial processing. Ongoing monitoring is then implemented through dashboards that provide real-time visualizations of quality metrics, enabling continuous detection of drifts or degradations in data integrity.^[38]^[39]^[40] Organizations often employ maturity models to gauge the effectiveness of their assessment practices, such as the IBM Data Governance Maturity Model, which defines progressive levels from ad-hoc (initial, reactive efforts) to optimized (proactive, integrated governance with automated controls). These models help benchmark current capabilities and identify gaps in assessment rigor.^[41] For case-specific applications, unstructured data assessment frequently utilizes sentiment analysis to evaluate the relevance and bias in textual content, extracting emotional tones and contextual accuracy from sources like customer feedback or social media. In contrast, structured data evaluation commonly involves schema matching techniques to align database schemas across sources, ensuring semantic consistency and resolving integration discrepancies.^[42]^[43]^[44] Best practices emphasize involving stakeholders, such as data stewards and business users, in regular assessment cycles to incorporate domain expertise and align evaluations with organizational needs. Additionally, integrating assessment techniques with Extract, Transform, Load (ETL) processes ensures quality checks occur seamlessly during data movement, applying metrics like accuracy and completeness to maintain standards throughout pipelines.^[45]^[46]

Improvement Strategies

Improving information quality requires multifaceted strategies that address organizational, procedural, and technical dimensions. Governance strategies form the foundation by establishing clear roles and policies to oversee data handling. Data stewardship roles, such as appointing dedicated stewards responsible for data ownership and accountability, ensure consistent application of quality standards across the organization.^[47] These roles involve monitoring data usage and enforcing policies that integrate quality gates—mandatory validation checkpoints—in data pipelines to prevent low-quality data from propagating downstream.^[48] For instance, policies may require automated checks for completeness and accuracy before data enters production systems, as implemented in federal data governance frameworks.^[49] Process-oriented methods provide structured approaches to systematically enhance quality. Six Sigma methodologies adapt defect-reduction techniques to data processes, using the DMAIC framework (Define, Measure, Analyze, Improve, Control) to identify and eliminate errors like inaccuracies or inconsistencies that impact business outcomes.^[50] This involves prioritizing data fields based on their effect on key metrics, such as customer satisfaction, and calculating defects per million opportunities to target improvements iteratively.^[50] Similarly, the PDCA (Plan-Do-Check-Act) cycle, when tailored to information management, supports continuous improvement by planning quality enhancements, implementing them, verifying results through audits, and acting on findings to refine processes.^[51] In quality-relevant contexts, PDCA enables ongoing optimization of data workflows, ensuring adaptability to evolving organizational needs.^[52] Cultural aspects emphasize fostering an environment where quality becomes a shared responsibility. Training programs for data literacy equip employees with skills to understand, evaluate, and utilize data effectively, promoting a mindset of curiosity and critical thinking.^[53] These programs, often structured in steps like piloting initiatives and scaling organization-wide, build foundational knowledge in data terms and analytics to support better decision-making.^[53] Incentivizing quality involves linking data improvements to performance metrics and communicating tangible benefits, such as revenue gains from enhanced accuracy, to encourage buy-in across teams.^[54] Establishing cross-functional groups to collaborate on quality goals further embeds these practices into the organizational culture, reducing silos and promoting accountability.^[54] Technological solutions automate and scale quality enhancements. Data cleansing tools employ deduplication algorithms to identify and merge duplicate records, improving accuracy and reducing redundancy in large datasets.^[55] Techniques like probabilistic record linkage and similarity-based matching, as in scalable parallel algorithms, efficiently handle big data volumes by comparing attributes to detect overlaps.^[56] Master data management (MDM) systems centralize authoritative data sources, integrating cleansing, matching, and validation processes to ensure consistency across the data lifecycle.^[57] These systems apply rules for data harmonization and survivorship, enabling real-time quality checks that support reliable analytics and operations.^[57] Emerging trends leverage advanced technologies for proactive quality management. AI and machine learning enable predictive quality through anomaly detection models that forecast potential issues by analyzing patterns in data streams.^[58] For example, ensemble learning frameworks combine algorithms like isolation forests to automatically correct anomalies in big data, minimizing manual intervention and enhancing integrity.^[59] Blockchain technology supports traceability by creating immutable ledgers for data provenance, allowing verification of information origins and changes to maintain trust and quality.^[60] In supply chain applications, blockchain-based systems facilitate real-time monitoring and secure sharing of quality-related data, reducing errors from untraceable modifications.^[61]

Professional and Organizational Aspects

Professional Associations

DAMA International, established in 1988 as the global arm of an organization founded in 1980, serves as a leading non-profit body dedicated to advancing data management practices, including information quality, through its comprehensive Data Management Body of Knowledge (DMBOK).^[62] The DMBOK outlines best practices for data quality management, emphasizing accuracy, completeness, and relevance to support organizational decision-making and compliance.^[12] DAMA offers the Certified Data Management Professional (CDMP) certification, available at Associate, Practitioner, and Master levels, which validates expertise in data quality among other disciplines and has certified over 10,000 professionals worldwide.^[63] IQ International, formerly known as the International Association for Information and Data Quality (IAIDQ) and chartered in 2004, focused on enhancing information quality through education, certification, and community building for professionals in business and IT until it wound up as an organization around 2020.^[64] ^[65] It provided the Information Quality Certified Professional (IQCP) certification, launched in 2011, which benchmarked skills in assessing and improving data quality processes.^[66] The organization produced publications and promoted frameworks for information quality management to foster better business outcomes.^[67] Other notable groups include the Data Governance Professionals Organization (DGPO), a vendor-neutral non-profit advancing data governance practices that underpin information quality through policies, standards, and best practices frameworks.^[68] DGPO offers resources like glossaries and over 60 hours of webinar content on topics such as data governance value propositions, supporting professionals in maintaining high-quality data ecosystems.^[69] These associations contribute to the field by advocating for international standards, such as ISO 8000, which defines data quality characteristics for objective validation across supply chains.^[70] Membership in these organizations provides benefits including networking opportunities, access to exclusive resources like templates and newsletters, and participation in working groups, aiding professionals in data quality roles.^[71] With global reach through 60 regional chapters for DAMA and international communities for others, they influence data management standards that align with regulatory requirements worldwide.^[72]

Conferences and Events

The International Conference on Information Quality (ICIQ), sponsored by the Massachusetts Institute of Technology (MIT), was held annually from 1996 to 2017, serving as a primary academic forum for advancing research in information quality.^[73] It emphasized theoretical and methodological contributions, including data quality assessment, process modeling, and quality management frameworks, attracting scholars from computer science, information systems, and related fields.^[74] Proceedings from each event were published, with select papers fast-tracked for peer-reviewed journals such as Information & Management.^[75] Complementing the academic focus, the Chief Data Officer and Information Quality (CDOIQ) Symposium provides a practitioner-oriented venue, established in 2007 and in its 19th year as of 2025.^[76] This international gathering highlights real-world case studies on implementing information quality strategies in organizational settings, such as data governance in enterprise environments and integration with business analytics.^[77] It draws professionals from industry, including chief data officers and quality specialists, to discuss practical challenges and solutions.^[76] Other notable events include the Data Governance & Information Quality (DGIQ) Conference, often supported by DAMA International chapters, which combines symposia-style sessions on data stewardship and quality metrics.^[78] In Europe, the CDOIQ European Symposium offers a regional counterpart, focusing on continent-specific regulatory impacts on information quality, such as GDPR compliance and cross-border data flows.^[79] These conferences typically feature diverse formats, including workshops on developing quality metrics, keynote addresses exploring AI's role in enhancing or challenging information integrity, and dedicated networking sessions for collaboration.^[80] Attendance generally ranges from 200 to 500 participants per event, blending in-person and virtual options to broaden accessibility.^[77] Historically, these gatherings evolved from modest workshops in the 1990s, centered on foundational data quality issues, to more expansive hybrid formats following the 2020 shift due to global events, enabling wider international participation.^[76] Key outcomes include the dissemination of conference proceedings that document emerging best practices and the cultivation of collaborations leading to industry standards, such as shared frameworks for quality auditing.^[74]^[81]

Applications and Impacts

In Data Management

In data management, information quality plays a pivotal role across the data lifecycle, encompassing ingestion, storage, and retrieval phases to ensure reliable decision-making and operational efficiency. During the ingestion phase, data from diverse sources is collected and validated to prevent the introduction of inaccuracies, inconsistencies, or incompletenesses, such as through cleansing, standardization, and error detection processes that align with key dimensions like accuracy and completeness.^[82] In storage, quality checks maintain data integrity within systems like SQL databases by enforcing constraints, indexing, and periodic audits to avoid "dirty data" that could propagate errors downstream.^[83] Retrieval phases further involve real-time validation to deliver trustworthy data for analytics, mitigating risks from outdated or corrupted records.^[84] Key challenges in data management include handling duplicates in customer relationship management (CRM) systems and ensuring integration quality in data lakes. Duplicates often arise from human errors during entry, faulty imports, or unsynchronized external integrations, leading to redundant records that distort reporting; rates beyond 5% can cause user complaints and loss of system credibility.^[85] Solutions involve deploying detection tools that alert users in real-time, normalizing data formats, and iteratively merging records using heuristics, often in sandbox environments to preserve critical fields.^[85] In data lakes, integration challenges stem from heterogeneous sources with varying formats, risking a "data swamp" of unreliable information that undermines governance and compliance with standards like GDPR.^[86] Effective solutions include robust extract-transform-load (ETL) processes for consistency and role-based access controls within a governance framework to enforce quality standards during ingestion and processing.^[86] Tools like Apache NiFi facilitate information quality through automated pipelines that support validation, cleansing, and monitoring. NiFi's processors, such as ValidateRecord for schema compliance and UpdateRecord for error correction, enable routing of invalid data while providing provenance tracking to audit lineage and detect anomalies in real-time.^[87]^[88] A notable example is its use in segregating bad records during flows, ensuring only high-quality data proceeds to storage or analysis. The Enron scandal exemplifies quality failures, where fabricated financial data in reporting systems concealed losses, leading to bankruptcy and prompting regulatory reforms like the Sarbanes-Oxley Act that emphasized data integrity and auditing in corporate data management.^[89]^[90] Metrics for information quality are applied via real-time scoring in big data environments like Hadoop, where frameworks assess dimensions such as completeness and timeliness during processing to flag issues proactively.^[83] These approaches yield benefits including enhanced analytics accuracy and cost reductions; for instance, master data management (MDM) practices can cut data-related expenses by up to 30% through error minimization and duplication elimination.^[91] Overall, prioritizing quality in data management fosters trustworthy insights and compliance.^[92]

In Broader Fields

In journalism and media, information quality is upheld through rigorous fact-checking processes that verify claims against reliable sources, cross-reference data, and assess contextual accuracy to combat misinformation. Following the 2016 U.S. presidential election, which highlighted the spread of false narratives on social media, organizations like the International Fact-Checking Network established standards for transparency, non-partisanship, and evidence-based verification, leading to increased adoption of real-time fact-checking during elections and crises.^[93]^[94] These practices help reduce the amplification of disinformation in covered stories, though challenges persist in scaling verification amid vast digital volumes.^[95] In healthcare, high information quality in electronic health records (EHRs) ensures accurate, complete, and timely data that directly influences patient outcomes, such as reducing medication errors through standardized documentation. Poor data integrity, including incomplete entries or inconsistencies, can lead to misdiagnoses or delayed treatments, exacerbating risks in clinical decision-making.^[96] Compliance with the Health Insurance Portability and Accountability Act (HIPAA) further mandates secure, accurate handling of protected health information, with violations often stemming from data quality lapses that compromise privacy and care efficacy.^[97] Studies show that EHR systems with robust quality controls improve overall patient safety metrics, including decreases in adverse events.^[98] Public policy relies on information quality in government data portals to foster transparency and informed decision-making, where standardized metadata and validation protocols ensure data reliability for public use. The U.S. Digital Accountability and Transparency Act (DATA Act) of 2014 established government-wide financial data standards, requiring agencies to publish machine-readable spending information on portals like USAspending.gov, which has enhanced accountability by making approximately $6.8 trillion in annual federal expenditures verifiable (as of FY 2024).^[99]^[100] Open data initiatives under this framework have improved policy evaluation, though ongoing challenges include inconsistent data formats across agencies that can undermine usability.^[101] In education and research, peer review serves as a primary quality gate in academic publishing, where experts scrutinize manuscripts for methodological soundness, evidential support, and originality to maintain scholarly integrity. This process identifies inaccuracies in citations and data, ensuring traceability and reproducibility, preventing the propagation of erroneous information in subsequent research; lapses here can distort meta-analyses and policy recommendations derived from aggregated studies.^[102] Despite its flaws, such as potential reviewer biases, peer review remains foundational, with journals like those from the American Association for the Advancement of Science upholding it to filter out low-quality submissions.^[103] Societal impacts of information quality extend to AI ethics, where poor data quality in training sets perpetuates biases, leading to discriminatory outcomes in applications like hiring algorithms or predictive policing. Reducing bias requires curating diverse, high-quality datasets that represent underrepresented groups.^[104] Ethical frameworks emphasize auditing data provenance and applying debiasing techniques, such as re-sampling or adversarial training, to align AI with principles of fairness and accountability.^[105] High-impact contributions, including NIST guidelines, underscore that proactive quality management in AI data pipelines is essential for mitigating societal harms like eroded public trust in automated systems.^[106]

References

[1]
[PDF] Information-Quality-Definitions-Measurement-Dimensions-and ...
ABSTRACT: Quality data is inevitably an important pre-requisite for managerial decision- making, especially when the decisions made can have far-reaching ...
[2]
Overview of Data Quality: Examining the Dimensions, Antecedents ...
Feb 10, 2023 · Decision quality is determined by data quality, which refers to the degree of data usability. Data is the most valuable resource in the twenty-first century.
[3]
Beyond Accuracy: What Data Quality Means to Data Consumers
The purpose of this paper is to develop a framework that captures the aspects of data quality that are important to data consumers.
[4]
https://web.mit.edu/tdqm/www/tdqmpub/WandWangCACMNov96.pdf
[5]
Information Quality and Trust: From Traditional Media to Cybermedia
Information Quality and Trust: From Traditional Media to Cybermedia ... Influence of news interest, payment of digital news, and primary news sources in media ...
[6]
Impact of information quality and decision-maker quality on decision ...
The decision quality improves with higher information quality for a decision-maker that has knowledge about the relationships among problem variables. However, ...
[7]
Problems with health information technology and their effects on ...
Examples of such errors include medication administration errors and failure to follow up test results. Delays in care process were linked to system access, and ...
[8]
The Evolution of Data Quality: Understanding the Transdisciplinary ...
Data quality has historically been addressed by controlling the measurement processes, controlling the data collection processes, and through data ownership.
[9]
A Brief History of Data Quality - Dataversity
May 14, 2024 · In the late 1980s and early 1990s, many organizations began to realize the value of data, and data mining. CEOs and decision-makers increasingly ...
[10]
[PDF] Data and Information Quality Research: Its Evolution and Future - MIT
As a focused and established area of research, data and information quality began to attract the research community's attention in the late 1980s. To address ...
[11]
Total Quality data Management (TQdM) - SpringerLink
Larry P. English ... It describes the processes required to assess and improve information quality in order to achieve business performance excellence.
[12]
[PDF] Dimensions of Data Quality (DDQ) - DAMA NL
Sep 3, 2020 · Wang, R.Y. and Strong, D. (1996). Beyond Accuracy: What data quality means to Data. Consumers. Journal of Management Information Systems, 1996.
[13]
Data Quality - ScienceDirect.com
Jack Olson explains data profiling and shows how it fits into the larger picture of data quality. Show less. Data Quality: The Accuracy Dimension is about ...
[14]
ISO 8000-1:2022 - Data quality — Part 1: Overview
stating the scope of the ISO 8000 series ...
[15]
Make Data Human: Apply Deming's Principles to Data Analytics
Dec 4, 2023 · Applying W. Edward Deming's management principles to the industralization of data analytics yields astonishing results.
[16]
Data Quality Is Context Dependent - SpringerLink
Abstract. We motivate, formalize and investigate the notions of data quality assessment and data quality query answering as context dependent activities.
[17]
Information Quality: The Importance of Context and Trade-Offs
Sep 12, 2025 · This paper explores the nature of information quality as a contextual, or fit-based, construct. Using this contingency approach we see that the ...
[18]
[PDF] The impact of the General Data Protection Regulation (GDPR) on ...
This study addresses the relationship between the General Data. Protection Regulation (GDPR) and artificial intelligence (AI). After.<|control11|><|separator|>
[19]
The Philosophy of Information Quality - Book - SpringerLink
In stockThis work fulfills the need for a conceptual and technical framework to improve understanding of Information Quality (IQ) and Information Quality standards.
[20]
Epistemic Values and Information Management
The philosophy of information is concerned with “how information should be adequately created, processed, managed, and used” (Floridi, 2002b, p. 138).
[21]
Interview with Larry English, Creator of TIQM - Data Quality Pro
Nov 19, 2024 · Larry English is an internationally recognized authority in information and knowledge management and information quality improvement.
[22]
ISO/IEC 25012:2008 - Data quality model
In stockISO/IEC 25012:2008 defines a general data quality model for data retained in a structured format within a computer system.
[23]
[PDF] Data Quality Dimensions - MIT
Specifically, we suggest rigorous definitions of data quality dimensions by anchoring them in ontological foundations; and we show how such dimensions can, in.
[24]
Measure Data Quality – 7 Metrics to Assess Your Data - Precisely
Nov 10, 2023 · Seven metrics to assess data quality include: ratio of data to errors, empty values, transformation errors, dark data, email bounce rates, ...
[25]
[PDF] Data Quality Assessment - MIT
Answering this question requires usable data quality metrics. Currently, most data quality measures are developed on an ad hoc basis to solve specific problems ...
[26]
[PDF] An Evaluation of the Conformed Dimensions of Data Quality in ...
Metric Formula: Column Population = for a given column, the ... Completeness. Completeness measures the degree of population of data values in a data set.
[27]
What is Data Profiling? | IBM
Data profiling, or data archeology, is the process of reviewing and cleansing data to better understand how it's structured and maintain data quality standards ...What is data profiling? · How does data profiling work?
[28]
A Rule-Based Data Quality Assessment System for Electronic Health ...
There are three system components, (1) rule logic templates and knowledge tables supporting the rules, (2) rule results tables, and (3) ability to report ...
[29]
The Golden Record of Data Quality: Truth or Myth?
Mar 13, 2023 · Data analysts rely on a Golden Record as a single source of truth to compare their data to ensure accuracy. Data exchange often feels like ...
[30]
Artificial intelligence methods and approaches to improve data ...
This study explores artificial intelligence (AI) methods and approaches used to improve data quality, with a particular focus on healthcare data.
[31]
The Challenges of Data Quality and Data Quality Assessment in the ...
May 22, 2015 · High-quality data are the precondition for analyzing and using big data and for guaranteeing the value of the data.Missing: Pipino | Show results with:Pipino
[32]
How To Conduct Data Quality Audits: A Step-by-Step Guide
Mar 18, 2024 · Data quality audits typically include three steps: establishing key metrics and standards, collecting and analyzing the data, and identifying and documenting ...Planning Your Data Quality Audit · The Data Quality Audit Process
[33]
Talend Data Quality: Trusted Data for the Insights You Need
Automate better data. Data profiling lets you quickly identify data quality issues, discover hidden patterns, and spot anomalies through summary statistics ...Profile, Clean, And... · Truly Trust Your Data · Automate Better DataMissing: techniques manual audits Informatica
[34]
Informatica Data Quality and Profiling
Use the data quality capabilities in the Developer tool to analyze the content and structure of your data and enhance the data in ways that meet your business ...Missing: audits Talend
[35]
What Is Data Quality Management? - IBM
Data quality management includes practices such as data profiling, data cleansing, data validation, data quality monitoring and metadata management.
[36]
Data Quality Framework: A Step‑By‑Step Guide [2025] - EWSolutions
Oct 14, 2025 · A data quality framework gives you a repeatable set of processes, standards, and tools to systematically improve data's accuracy, completeness, and consistency.Data Governance Structure &... · Data Profiling & Assessment · Maintaining Data Quality...Missing: techniques | Show results with:techniques
[37]
The Essential Guide to Mastering Data Quality Monitoring - FirstEigen
Dec 16, 2024 · Effective data quality monitoring involves continuous assessment using various techniques and tools to identify and rectify issues promptly.
[38]
Data Governance Maturity Model Guide 2025 - Dataversity
Aug 14, 2025 · What are the five levels of data maturity? · Ad Hoc or Initial – Uncoordinated, reactive processes for data governance and data quality, often ...
[39]
Sentiment analysis methods, applications, and challenges
This paper provided a systematic literature review of sentiment analysis methods, applications, and challenges.
[40]
[PDF] Assessing the Quality of Unstructured Data: An Initial Overview
Nowadays, computers can in- terpret the knowledge encoded in unstructured data using methods from text analytics, image recognition and speech recognition.Missing: schema | Show results with:schema
[41]
Learning to Rerank Schema Matches | IEEE Journals & Magazine
Dec 27, 2019 · Schema matching is at the heart of integrating structured and semi-structured data with applications in data warehousing, data analysis
[42]
Top 10 Data Quality Best Practices to Improve Data Performance
Dec 15, 2023 · These best practices range from regular audits to user training, all aimed at maintaining accurate, complete, and timely data.Top 10 Data Quality Best... · 1. Data Governance Framework · 1. Data Quality Assessment
[43]
Best practices for managing data quality: ETL vs ELT - Talend
This article will underscore the relevance of data quality to both ETL and ELT data integration methods by exploring different use cases in which data quality ...
[44]
Best Practices for Data Governance and Quality Assurance
Nov 20, 2023 · This guide examines data governance best practices analysts can use to protect their organizations' digital assets and aid decision-making.
[45]
[PDF] How to transform the landscape of analytics with data governance
Data governance is the organization and implementation of policies, procedures, structure, roles, and responsibilities which outline and enforce rules of ...
[46]
Data governance and management | GSA
Data governance is the exercise of authority and control (planning, monitoring, and enforcement) over data assets.<|separator|>
[47]
Using Six Sigma to Measure and Improve Data Quality | ORMS Today
Sep 6, 2024 · Six Sigma is a data-driven methodology for eliminating defects and improving processes in any organization.
[48]
https://www.stonybrook.edu/commcms/irpe/reports/_presentations/HowToTransform_Burnette_Hosch_2019_11_10.pdf
[49]
PDCA cycle: continuous optimization of quality-relevant processes
May 12, 2023 · The PDCA cycle provides a concept for the structured improvement of corporate processes. It can be applied to all quality-relevant processes.
[50]
Data literacy: The key to cracking the data culture code | MIT Sloan
Aug 14, 2024 · Data is the common language of our time. Achieving data literacy in your organization requires a shared mindset, language, and skills.
[51]
12 Actions to Improve Your Data Quality - Gartner
Jul 14, 2021 · No. 1: Establish how improved data quality impacts business decisions · No. 2: Define what is a “good enough” standard of data · No. 3: Establish ...
[52]
Distributed Data Deduplication for Big Data: A Survey
Distributed data deduplication has become a popular technology in big data management to save more storage space, enhance I/O performance, and improve system ...
[53]
A Scalable Parallel Deduplication Algorithm - IEEE Xplore
In this paper, we present our parallel deduplication algorithm, called FER- APARDA. By using probabilistic record linkage, we were able to successfully detect ...
[54]
How to Ensure Data Quality and Consistency in Master ... - Dataversity
Apr 1, 2024 · The process of ensuring data quality and data consistency within master data management (MDM) is multifaceted.
[55]
An Automated Big Data Quality Anomaly Correction Framework ...
Dec 1, 2023 · We propose a sophisticated framework that automatically corrects big data quality anomalies using an intelligent predictive model.
[56]
[PDF] Outlier detection optimization using machine learning for improving ...
Oct 17, 2024 · This paper explores the implementation of advanced machine learning techniques to optimize outlier detection for enhancing data quality ...<|separator|>
[57]
Blockchain-based framework for supply chain traceability: A case ...
Blockchain-based traceability enables secured information sharing, facilitates product quality monitoring/control, operation monitoring/control, real-time data ...
[58]
A Blockchain-based Traceability System to Achieve the Quality ...
This study will focus on blockchain applied to traceability system as database technology because it can minimize the shortcomings of the database with ...
[59]
Who We Are - DAMA International®
... inception in 1980. Founded in Los Angeles, DAMA® quickly expanded with early chapters in cities like San Francisco, Portland, Seattle, Minneapolis, New York ...
[60]
Data Management Body of Knowledge (DAMA-DMBOK
DAMA-DMBOK is a globally recognized framework that defines the core principles, best practices, and essential functions of data management.DAMA® Dictionary of Data... · DAMA-DMBOK® Infographics · FAQs
[61]
About CDMP® Certification - DAMA International®
It validates your expertise in data management across disciplines like: Data Governance; Metadata & Reference Data; Data Quality; Data Architecture; Data ...CDMP® Certification Levels · Join DAMA®/Renew...
[62]
IQ International - LinkedIn
Who We Are Chartered in January 2004, we are the not-for-profit professional society for people passionate about improving Information Quality.<|separator|>
[63]
IQ Inc. - FIMA US 2026 - Worldwide Business Research
Since 2011 the association has offered benchmark certification, the Information Quality Certified Professional (IQCP) program. Website: http://www.iaidq.org.
[64]
Information Quality Framework (from legacy organization, IAIDQ/IQ ...
This was created by IAIDQ (later renamed IQ International) for the Information Quality Certified Professional (IQCP) designation. This is a high-level ...
[65]
https://castlebridge.ie/insights/copy-author-interview-bob-seiner/
[66]
Data Governance Professionals Organization: DGPO
The DGPO is a non-profit, vendor neutral, association of business, IT and data professionals dedicated to advancing the discipline of data governance. dgpros.MembershipAbout Us
[67]
[PDF] CDMP 2025_13 - Data Quality.pptx - DAMA Northeast
It defines characteristics that can be tested by any organization in the data supply chain to objectively determine conformance of the data to. ISO 8000. B ...<|separator|>
[68]
https://dgpo.org/about-us/
[69]
Home - DAMA International®
We exist to empower individuals and organizations worldwide to manage data with integrity, professionalism, and purpose.What is Data Management? · DAMA® Data Management... · About DAMA
[70]
International Conference on Information Quality - MIT
IQ-2001 is sponsored, in part, by MIT, CITM, UC Berkeley, Northeastern University, Marist College, Group 1 Software, Information Integrity Coalition, and Data ...
[71]
MIT ICIQ Proceedings - Information Quality - UA Little Rock
The International Conference on Information Quality (ICIQ) is an annual conference sponsored by the Massachusetts Institute of Technology (MIT)
[72]
The 19th Annual CDOIQ Symposium
The 19th Annual CDOIQ Symposium will take place from July 15-17 in Cambridge, MA. The International Chief Data Officer and Information Quality (CDOIQ) Symposium ...
[73]
CDOIQ Symposium
The International Chief Data Officer and Information Quality (CDOIQ) Symposium, now in its 18th year, is one of the key events for sharing and exchanging ...
[74]
2025 Data Governance & Information Quality (DGIQ) West + ...
This spring, we're combining these industry-leading conferences to offer an unparalleled learning experience from May 5-9, 2025, in Anaheim, CA.Conference Policies · Program · Non-Attendee Subscription · Venue & TravelMissing: MIT | Show results with:MIT
[75]
CDOIQ European Symposium: Home
CDOIQ European Symposium is an exclusive, one-day deep dive event into critical topics shaping the data and analytics landscape in Europe.Missing: ECIQ | Show results with:ECIQ
[76]
Session 21-A – The 19th Annual CDOIQ Symposium
In this session, a panel of experts will share real-world lessons—what worked, what didn't, and why. Topics include improving strategic alignment, data quality, ...Missing: practitioner oriented
[77]
[PDF] Annual Chief Data Officer & Information Quality (CDOIQ) Symposium
Jul 11, 2024 · • Focused on data architecture, data quality & data governance, and ... data governance and quality practice from scratch at a multi ...
[78]
What is Data Ingestion? | IBM
Data ingestion is the process of collecting data from various sources into a database for storage, processing and analysis, for use within the organization.
[79]
Data quality management in big data: Strategies, tools, and ...
This study addresses the critical need for effective Big Data Quality Management (BDQM) in education, a field where data quality has profound implications ...
[80]
Data Ingestion: Essential Insights - Databricks
Discover the essentials of data ingestion, its challenges and best practices to efficiently integrate data from various sources into your database systems.
[81]
How to Solve CRM Data Deduplication Dilemmas - CIO
Start by using the best available duplicate detection tools that warn users while they enter data. Before you deploy any tool, test that it doesn't throw such ...
[82]
Data Lake Strategy: Its Benefits, Challenges, and Implementation
Sep 20, 2024 · Efficient data ingestion and integration processes are vital for maintaining data consistency and accuracy within a data lake. Organizations ...5 Benefits Of A Data Lake... · 2. Data Integration · 4. Data Ingestion And...
[83]
Apache NiFi Overview
Oct 21, 2024 · NiFi supports buffering of all queued data as well as the ability to provide back pressure as those queues reach specified limits or to age off ...
[84]
How to Ensure Data Quality with Apache NiFi?
Jun 10, 2025 · Apache NiFi's Role in Ensuring Data Quality · 1. Automated Data Validation · 2. Intelligent Data Cleansing · 3. Contextual Data Enrichment · 4. Real ...
[85]
The Importance of Data Quality for Business - Reworked
Aug 22, 2022 · Enron's executives and the company's auditing firm provided fabricated data to the board of directors and shareholders to cover financial fraud ...
[86]
The Rise and Fall of Enron - Journal of Accountancy
Mar 31, 2002 · The purpose of this article is to summarize preliminary observations about the collapse, as well as changes in financial reporting, auditing and corporate ...
[87]
How Master Data Management Services save Your data costs by up ...
Feb 5, 2025 · Master Data Management (MDM) services reduce duplicate records, enhance inventory accuracy, and streamline procurement, cutting data costs by up to 30%.
[88]
(PDF) Master Data Management Challenges - ResearchGate
Aug 6, 2025 · The study indicates that poor data quality impacts critical business operations, affecting up to 70% of strategic business decisions and ...
[89]
How to combat fake news and disinformation - Brookings Institution
Dec 18, 2017 · Through digital sources, there has been a tremendous increase in the reach of journalism, social media, and public engagement. Checking for news ...Missing: processes | Show results with:processes
[90]
Fake news and the spread of misinformation: A research roundup
Much of the fake news that flooded the internet during the 2016 election season consisted of written pieces and recorded segments promoting false information or ...
[91]
Countering Disinformation Effectively: An Evidence-Based Policy ...
Jan 31, 2024 · A high-level, evidence-informed guide to some of the major proposals for how democratic governments, platforms, and others can counter disinformation.
[92]
[PDF] Information Integrity in the Electronic Health Record American ...
Poor documentation, inaccurate data, and insufficient information can result in poor patient outcomes and increased healthcare expense. Indeed, inaccurate data ...
[93]
[PDF] Privacy, Security, and Electronic Health Records - HHS.gov
EHRs allow providers to use information more effectively to improve the quality and efficiency of your care, but. EHRs will not change the privacy protections ...Missing: outcomes | Show results with:outcomes
[94]
7 EHR usability, safety challenges—and how to overcome them
Dec 11, 2023 · EHR design, customization or configuration can contribute to patient harm. Researchers also are quantifying the physician burdens of EHRs.
[95]
[PDF] DIGITAL ACCOUNTABILITY AND TRANSPARENCY ACT OF 2014
May 9, 2014 · —The Secretary and the Director, in consultation with the heads of Federal agencies, shall establish Government-wide financial data standards ...Missing: portals | Show results with:portals
[96]
Federal Information Transparency | U.S. GAO
The DATA Act seeks to improve the transparency of federal spending by expanding on prior legislation to set government-wide data standards, link award spending ...
[97]
[PDF] Data Quality Playbook - CFO.gov
Nov 30, 2018 · B. The passage of the DATA Act in 2014 and the focus on open data transparency has steered governance bodies, agencies, and other stakeholders ...Missing: portals | Show results with:portals
[98]
Peer Review in Scientific Publications: Benefits, Critiques, & A ...
Peer reviewers provide suggestions to authors on how to improve the quality of their manuscripts, and also identify any errors that need correcting before ...
[99]
The present and future of peer review: Ideas, interventions ... - PNAS
Jan 27, 2025 · The reliability of peer review is low, as reviewers of the same work often disagree with each other's assessments (6). The validity of peer ...
[100]
Peer review - Why, when and how - ScienceDirect
Peer review ensures scientific information is truthful, valid, and accurate, and helps authors improve their work before publication.<|control11|><|separator|>
[101]
[PDF] Towards a Standard for Identifying and Managing Bias in Artificial ...
Mar 15, 2022 · Systemic and implicit biases such as racism and other forms of discrimination can inadvertently manifest in AI through the data used in training ...
[102]
Addressing bias in big data and AI for health care - NIH
Here, we describe the challenges in rendering AI algorithms fairer, and we propose concrete steps for addressing bias using tools from the field of open ...
[103]
[PDF] Fairness And Bias in Artificial Intelligence - arXiv
This paper provides a comprehensive overview of the sources and impacts of bias in AI, examining data, algorithmic, and user biases, along with their ethical ...