Fact-checked by Grok 2 weeks ago

Exploratory testing

Exploratory testing is a software testing approach in which testers dynamically design and execute tests based on their knowledge of the product, ongoing exploration of the test item, and results from previous tests.^[1] It emphasizes simultaneous learning, test design, and execution, allowing testers to adapt to new discoveries without relying on pre-scripted procedures.^[2] Unlike traditional scripted testing, where test cases are fully documented in advance, exploratory testing treats testing as an active investigation that uncovers defects through creativity and real-time decision-making.^[3] The term was coined by Cem Kaner in the 1980s, drawing inspiration from John Tukey's concept of exploratory data analysis, and was further popularized by James Bach in the 1990s through his development of the Rapid Software Testing methodology.^[4] Bach observed that unscripted testing often revealed more bugs than rigid scripts, leading to the creation of the first dedicated exploratory testing course in 1996.^[4] Key characteristics include the use of test charters—focused mission statements guiding sessions—and techniques such as scenario testing, risk-based exploration, and heuristics for coverage, enabling testers to probe for usability issues, edge cases, and unexpected behaviors.^[2] Exploratory testing is particularly valuable in agile and rapid development environments, where it provides quick feedback and complements automated testing by leveraging human intuition to identify complex defects that scripts might miss.^[2] Practical applications and empirical studies have shown it to be significantly more productive in certain contexts, such as finding critical bugs faster than scripted methods.^[5]^[6] It is often managed through session-based test management, which structures exploratory efforts into time-boxed sessions with debriefs to ensure accountability and visibility.^[3] As defined in standards like ISO/IEC/IEEE 29119, it remains a core technique in modern software quality assurance.^[1]

Fundamentals

Definition and Core Concepts

Exploratory testing emerges as a key approach within the broader field of software testing, which encompasses activities designed to evaluate software products for defects, assess their quality, and ensure they meet specified requirements as part of quality assurance efforts.^[7] In quality assurance, testing aims to provide confidence in the software's reliability, functionality, and user satisfaction by systematically uncovering issues that could impact performance or usability.^[8] At its core, exploratory testing is an approach to software testing characterized by the simultaneous learning, test design, and execution, where testers actively control the process to investigate the software's behavior and identify defects.^[5] This method emphasizes the tester's personal freedom and responsibility, allowing them to adapt their strategies in real time based on observations and insights gained during the session.^[9] Unlike scripted testing, where predefined test cases dictate the sequence of actions, exploratory testing integrates discovery and verification fluidly to uncover unexpected issues.^[10] Key concepts in exploratory testing include test charters, which serve as time-boxed missions outlining the session's focus areas, objectives, and potential risks to explore, thereby providing lightweight structure without rigid constraints.^[11] Debriefing sessions follow each charter to review results, discuss findings, and capture learnings, ensuring that the exploratory efforts yield documented value for the team.^[11] Central to its effectiveness is the role of the tester's intuition and adaptability, leveraging critical thinking and heuristics to make informed decisions and pivot as new information emerges during testing.^[5] Exploratory testing is distinct from ad-hoc testing, which is frequently viewed as unplanned and haphazard; in contrast, exploratory testing is a disciplined, skill-based practice that maintains cognitive structure through charters and debriefs while documenting insights to support ongoing improvement.^[5] This structured flexibility highlights the tester's expertise in driving meaningful exploration rather than random probing.^[11]

Key Principles

Exploratory testing is fundamentally guided by the principle of context-driven testing, which emphasizes that testing decisions should be informed by the specific circumstances of the project, including risks, stakeholder needs, and the tester's expertise, rather than adhering rigidly to predefined scripts. This approach recognizes that the effectiveness of testing practices varies according to the unique context, such as the product's maturity, team dynamics, and available resources. As articulated in the context-driven school of software testing, the value of any practice depends on its context, and there are no universal "best practices" that apply in isolation. Similarly, good software testing requires judgment and skill exercised cooperatively across the project to address evolving challenges. A core aspect of exploratory testing is its heuristic-based approach, where testers employ rules of thumb or mental shortcuts to direct their exploration and prioritize areas likely to yield valuable insights. Heuristics, such as focusing on recent changes in the software or investigating edge cases where inputs deviate from expected norms, serve as flexible guides rather than prescriptive rules, enabling testers to adapt quickly to emerging patterns. For instance, the Heuristic Test Strategy Model provides guidewords across dimensions like project elements (e.g., recent changes) and quality criteria (e.g., usability edges) to stimulate diverse test ideas without constraining creativity. This method draws on cognitive devices like checklists and mnemonics to enhance test coverage efficiently in uncertain environments. Testers in exploratory testing exercise significant freedom in designing and executing tests in real time, but this autonomy is coupled with responsibility for ensuring adequate coverage and transparently reporting discoveries. This balance allows individuals to manage their time as executives of their own efforts, aligning actions with session objectives while remaining accountable to the project's goals and stakeholders. Such responsibility is often operationalized through lightweight structures like test charters, which outline focus areas without dictating steps. Learning stands as a central activity in exploratory testing, involving continuous adaptation and refinement of tests based on real-time observations of the software's behavior. This process integrates simultaneous learning, test design, and execution, fostering an iterative cycle where insights from one interaction inform the next, thereby deepening the tester's understanding of the product and potential defects. Through this learning loop, testers enhance their inquiry and curiosity, transforming exploratory sessions into dynamic investigations that evolve with the findings.

Historical Development

Origins and Early Concepts

The roots of exploratory testing trace back to the early days of software development in the 1950s and 1970s, when testing practices were largely ad-hoc and intuitive, integrated with debugging efforts to identify and fix errors in nascent computer programs.^[12]^[13] During this debugging-oriented era, which extended until around 1956, software verification relied on informal methods without distinct separation from coding, often performed by developers themselves in response to immediate operational failures.^[12] By the late 1950s through the 1970s, testing evolved into a demonstration-oriented phase, where the primary goal was to prove that programs functioned as intended, still emphasizing confirmation over discovery but marking the first organized testing teams, such as the one formed by Gerald Weinberg around 1957–1958.^[14]^[12] A pivotal shift occurred around 1979, transitioning to a destruction-oriented approach that encouraged testers to actively seek out and expose hidden flaws by attempting to "break" the software, laying groundwork for more investigative testing styles.^[12] This era, spanning 1979 to 1982, redefined testing as a deliberate process of fault detection rather than mere validation, influenced by works like Glenford J. Myers' 1979 book The Art of Software Testing, which advocated executing programs specifically to uncover errors.^[14] In this context, exploratory elements emerged as testers intuitively probed systems to reveal unanticipated issues, contrasting with prior confirmatory methods and fostering a mindset of adaptive investigation.^[12] The term "exploratory testing" was formally coined in 1983 by Cem Kaner, a software testing expert, drawing inspiration from John Tukey's concept of exploratory data analysis as well as real-world observations of skilled testers to articulate the simultaneous learning, test design, and execution practices.^[15]^[4] Kaner introduced the concept during early workshops and in his initial writings, describing a flexible style that emphasized tester autonomy and real-time adaptation over predefined scripts.^[16] This naming captured the essence of investigative testing as a disciplined yet creative process, building directly on the destruction-oriented foundations of the late 1970s.^[15] These early ideas gained traction in Silicon Valley's dynamic, fast-paced development environments of the 1980s, where rapid innovation demanded agile testing approaches unencumbered by bureaucracy.^[16] This contrasted with the more rigid, specification-driven testing prevalent in military-influenced projects from the post-World War II era, which prioritized conformance to strict requirements over exploratory discovery.^[17]^[16] Kaner's formulation thus formalized practices already informally used by top testers in these innovative hubs, setting the stage for broader adoption.^[15]

Evolution and Key Contributors

The formalization of exploratory testing gained momentum in the late 1980s and 1990s through the work of Cem Kaner, who coined the term in 1983 and elaborated on its principles in his 1988 book Testing Computer Software. In this seminal text, co-authored with Jack Falk and Hung Quoc Nguyen, Kaner advocated for tester autonomy, allowing professionals to dynamically investigate software behaviors rather than adhering strictly to predefined scripts, thereby adapting to emerging risks in real-time.^[16] This approach marked a shift from traditional scripted methods, emphasizing learning and improvisation as core to effective testing. Kaner further advanced the field by co-founding the Association for Software Testing in 2004, an organization dedicated to promoting context-driven practices and professional development in software testing.^[18] In the 2000s, exploratory testing evolved through the development of structured yet flexible methodologies, notably James Bach's Rapid Software Testing (RST) approach, introduced around 2000 as part of his experiences leading testing teams since the late 1980s. RST integrates time-boxed charters—focused mission statements for testing sessions—with heuristics and observational skills to enable efficient exploration under resource constraints, fostering rapid feedback in dynamic development environments. Bach, a principal consultant at Satisfice Inc., positioned RST within the Context-Driven School of Testing, co-founded with Cem Kaner and Bret Pettichord in 1999, which prioritizes adapting testing to project-specific contexts over universal best practices.^[19]^[20] From the 2010s onward, exploratory testing expanded through influential publications, conferences, and broader adoption in modern development paradigms. Elisabeth Hendrickson's 2012 book Explore It!: Reduce Risk and Increase Confidence with Exploratory Testing provided practical guidance on designing on-the-fly experiments and charters, making the practice accessible for agile teams seeking to balance structure with adaptability. Conferences such as EuroSTAR, Europe's premier software testing event since 1993, played a key role in dissemination, featuring sessions on exploratory techniques that highlighted real-world applications and innovations. This period also saw exploratory testing integrated into agile methodologies, as manifested in frameworks like Scrum, where it supports iterative discovery and risk mitigation. Maaret Pyhäjärvi emerged as a leading modern advocate, authoring Contemporary Exploratory Testing in 2024 and promoting "strong-style" collaborative exploration through her writings, presentations, and organization of events like the European Testing Conference, emphasizing empirical learning and tester expertise in contemporary contexts.^[21]^[22]

Practices and Techniques

Conducting Exploratory Testing

Exploratory testing sessions are typically structured as time-boxed activities to maintain focus and efficiency, lasting between 60 and 120 minutes each, guided by a specific charter that outlines the mission, scope, and objectives.^[11] The process begins with setup, where the tester reviews relevant requirements, product context, and any available documentation to inform the exploration.^[4] During the core exploration phase, testers apply heuristics—such as consistency with user expectations or historical behavior—to dynamically design and execute tests while learning about the software.^[23] Logging occurs concurrently, capturing defects, risks, and observations to ensure traceability without interrupting the flow.^[11] Several techniques enhance the effectiveness of these sessions. Thread-based testing involves following specific user journeys or workflows, such as simulating end-to-end interactions to uncover integration issues.^[24] Tour-based approaches guide exploration through metaphorical "tours," for instance, a complexity tour that probes intricate code paths or feature interactions to reveal hidden behaviors.^[11] Pairing, where two testers collaborate in real-time, leverages diverse perspectives to deepen insights and accelerate problem detection.^[4] Documentation in exploratory testing emphasizes rapid, lightweight capture to support analysis without rigid scripting. Testers record observations using notes, screenshots, or dedicated session sheets that track activities, findings, and time allocations.^[11] Following the session, debriefs with stakeholders synthesize these records, reviewing defects, risks, and coverage to inform next steps.^[23] A risk-based focus directs session charters toward high-risk areas, such as newly developed features or critical integrations, to maximize impact on product quality.^[4] This prioritization adapts dynamically as risks emerge during exploration, ensuring resources target potential failure points.^[11]

Tools and Supporting Practices

Exploratory testing relies on lightweight tools to structure sessions without imposing rigid scripts, with session-based test management (SBTM) serving as a foundational approach to track progress and ensure accountability. SBTM emphasizes time-boxed testing sessions guided by charters—brief mission statements outlining objectives, such as exploring user workflows or edge cases—followed by debriefing to review findings and metrics like bugs discovered or areas covered.^[25] Tools like Rapid Reporter, an open-source application designed specifically for SBTM, enable testers to log notes, timestamps, and observations in real-time during sessions, facilitating quick reporting and charter adherence.^[26] Similarly, simple templates in Microsoft Excel can be adapted for charter tracking, allowing teams to document session goals, actual coverage, and pass/fail ratios without specialized software.^[27] Supporting software enhances the exploratory process by capturing evidence and organizing insights. Bug tracking systems such as Jira integrate seamlessly, permitting testers to log defects directly from exploratory sessions with attachments like screenshots or videos, while maintaining links to charters for traceability.^[28] Screen recording tools like OBS Studio, a free and versatile option, allow testers to document interactions in video format, replaying them to analyze unexpected behaviors or share with stakeholders during debriefs.^[29] For visualizing explorations, mind-mapping software such as XMind helps create dynamic diagrams of test ideas, branching scenarios, and risk areas, promoting creative navigation through the application's features.^[30] Key practices bolster the effectiveness of these tools by fostering skill development and collaboration. Charters not only guide individual sessions but also build tester expertise through iterative refinement, encouraging deeper product understanding over time.^[31] Team rotations, where members alternate roles in sessions to bring diverse viewpoints, enhance coverage by challenging assumptions and uncovering blind spots that solo testing might miss.^[32] Metrics derived from coverage charters, such as the number of explored scenarios or untested paths identified, provide quantifiable insights into session outcomes without quantifying every action.^[33] Best practices emphasize integration and responsibility to maximize exploratory testing's value. Hybrid approaches combine exploratory efforts with automation, where automated checks handle repetitive validations, freeing testers to focus on novel investigations and using tools like Jira to orchestrate both.^[34] Ethical exploration requires explicit permissions for potentially disruptive actions, such as stress testing that could impact production-like environments, ensuring no unintended harm to systems or data.^[35]

Comparisons and Integrations

Versus Scripted Testing

Scripted testing, also known as test case-based testing, relies on predefined test cases that outline specific steps, inputs, and expected outcomes to ensure reproducibility and systematic coverage of requirements.^[16] This approach allows teams to verify that the software behaves as anticipated under controlled conditions, facilitating easy delegation to less experienced testers and supporting regulatory compliance through auditable documentation.^[16] In contrast, exploratory testing emphasizes simultaneous test design, execution, and learning, enabling testers to adapt their approach in real-time based on observations and emerging insights.^[4] While scripted testing follows a rigid, predefined path that may overlook novel defects or interactions not anticipated during planning, exploratory testing fosters creativity and adaptability, allowing testers to uncover unexpected issues through freestyle exploration or lightly structured charters.^[16] The fundamental distinction lies in the tester's cognition: scripted methods prioritize foresight and procedure, potentially limiting deviation, whereas exploratory methods empower ongoing decision-making and risk-based pivots.^[16]^[4] Scripted testing is particularly suited for regression testing, where stability and repeatability are paramount, and for environments requiring strict adherence to standards, such as compliance-driven industries.^[16] Exploratory testing, however, excels in scenarios involving new features, complex user interactions, or evolving requirements, where the goal is to discover design flaws or usability issues that predefined scripts might miss.^[16]^[4] Many testing efforts incorporate hybrid models that blend elements of both approaches, such as using scripted cases as a foundation while allowing exploratory charters for deeper investigation.^[16]^[4] This combination leverages the structure of scripts for coverage alongside the flexibility of exploration for innovation.

Role in Agile and Other Methodologies

Exploratory testing integrates seamlessly into Agile methodologies by aligning with the iterative nature of sprints, where it enables testers to provide rapid feedback on evolving software features and adapt to shifting requirements during development cycles.^[36] In Agile teams, it is often employed through short, focused sessions that investigate uncertainties or risks in user stories—allowing for real-time learning and defect discovery without rigid scripts.^[37] This approach supports the Agile principle of continuous improvement by complementing automated tests in hybrid environments, where scripted testing handles regression while exploratory efforts uncover unanticipated issues.^[38] In DevOps practices, exploratory testing enhances continuous integration and continuous delivery (CI/CD) pipelines by facilitating ad-hoc sessions for validating deployments and exploring system behaviors in production-like environments.^[39] It addresses gaps in automated testing by focusing on post-deployment validation, where testers can probe for emergent issues arising from frequent releases, thereby promoting faster feedback loops and higher reliability in dynamic infrastructures.^[40] Within other methodologies, exploratory testing can be adopted in traditional Waterfall approaches to identify overlooked defects, often integrated into testing phases to enhance sequential processes.^[41] Integrating exploratory testing into these methodologies presents challenges, particularly in balancing it with automation-heavy environments where scripted tests dominate, potentially leading to underutilization of exploratory skills.^[42] Scaling it also requires structured charters and collaboration to maintain consistency and share insights, avoiding silos in feedback collection.^[43]

Advantages and Limitations

Benefits

Exploratory testing excels at uncovering hidden defects that scripted approaches often miss, such as usability flaws, complex interactions, and edge cases arising from unexpected user behaviors. In controlled experiments, exploratory testing has demonstrated significantly higher defect detection rates; for instance, one study found that it identified 292 defects compared to only 64 by test case-based testing, with exploratory methods detecting more severe and critical issues across various difficulty levels.^[44] This advantage stems from the tester's ability to adapt in real-time, exploring unscripted paths that reveal issues like system interactions not anticipated in predefined test cases.^[45] The approach enhances tester engagement by empowering skilled professionals to leverage their creativity, intuition, and domain knowledge, fostering a more fulfilling testing process. Unlike rigid scripted testing, exploratory methods encourage active learning and decision-making during sessions, which boosts problem-solving skills and job satisfaction among testers.^[4] This increased involvement also builds deeper system understanding, as testers iteratively refine their exploration based on immediate feedback, leading to richer insights into software behavior.^[46] Exploratory testing offers time efficiency, particularly in dynamic projects, by eliminating extensive documentation overhead and combining test design, execution, and analysis into a simultaneous process. Case studies in embedded systems development show it can save substantial preparation time, such as reducing two months of scripting effort while still detecting critical defects overlooked by hundreds of automated tests.^[47] This streamlined workflow accelerates feedback loops, making it faster to set up and iterate in environments with tight schedules.^[39] Its adaptability makes exploratory testing ideal for projects with ambiguous or evolving requirements, where traditional scripting struggles to keep pace. Testers can pivot based on emerging discoveries, suiting agile and DevOps contexts by integrating seamlessly with iterative development without rigid preconditions.^[39] This flexibility ensures comprehensive coverage of uncertain areas, such as novel features or incomplete specifications, enhancing overall software quality assurance.^[46]

Challenges and Drawbacks

Exploratory testing encounters significant reproducibility issues, as the simultaneous design and execution of tests without predefined scripts makes it difficult to repeat exact sessions for defect verification by developers or other stakeholders. This unstructured approach often results in incomplete documentation of the precise steps, conditions, or inputs that led to a failure, complicating debugging and regression efforts.^[48] To address this, practitioners can employ logging tools during sessions to capture tester actions, system states, and observations, thereby facilitating partial reconstruction of test paths.^[49] The method's effectiveness is highly dependent on the tester's skills, experience, and domain knowledge, which can lead to inconsistent outcomes when novices perform it. Inexperienced testers may struggle to apply intuition for test design or failure recognition, potentially overlooking subtle issues that skilled practitioners would detect.^[50] Mitigation strategies include targeted training programs, peer mentoring, and paired testing sessions to build competency and standardize exploratory approaches across teams.^[50] Coverage concerns arise due to the risk of missing systematic or predefined areas of the software without guiding structures like test charters. The free-form exploration may result in uneven attention to features, leaving gaps in validation that scripted methods more reliably address.^[48] Using time-boxed charters to outline focus areas and debriefs to review session outcomes helps ensure more balanced coverage while preserving exploratory flexibility.^[49] Scalability poses challenges in large teams or complex projects, where coordinating multiple exploratory sessions without structured support can lead to duplicated efforts, tracking difficulties, and biases in individual exploration paths. Personal heuristics or preconceptions may skew focus, reducing overall efficiency in distributed environments.^[48] Implementing session-based test management, with defined durations and reporting templates, supports coordination and bias reduction in scaled settings.^[49]

Evidence and Applications

Empirical Studies

Empirical research on exploratory testing (ET) has primarily focused on controlled experiments and case studies to evaluate its defect detection capabilities, efficiency, and influencing factors compared to traditional scripted approaches. These studies, often conducted in academic and industrial settings, provide evidence of ET's viability in software quality assurance, particularly in dynamic environments. A notable controlled experiment by Afzal et al. in 2014 compared ET with test case-based testing (TCT) using industrial participants on the open-source text editor jEdit. The results indicated that ET was more effective than TCT in fault detection, identifying significantly more defects overall, but required more efficient use of time, finding more defects in the same 90-minute sessions. This efficiency gain was attributed to ET's flexible, unscripted nature, which allowed testers to adapt quickly without documentation overhead, though coverage tracking remained a challenge.^[51] Building on such comparisons, Asplund's 2019 study examined contextual factors affecting ET's fault detection in a safety-critical medical technology firm. Through a multi-team analysis, the research found that variables like tester experience, domain knowledge, and team dynamics had a stronger influence on ET outcomes than in scripted methods, where predefined cases mitigated variability.^[52] For instance, experienced testers in ET detected more subtle faults due to their ability to improvise, highlighting ET's reliance on human factors for effectiveness.^[52] Recent advancements have explored enhancements to ET, such as gamification. A 2023 IEEE study by Coppola et al. investigated gamified ET tools for graphical user interface testing in web applications, involving 144 participants. The gamified approach, incorporating elements like leaderboards and badges, improved test case creation by 15-25% in terms of coverage and diversity compared to standard ET, while maintaining similar defect detection rates. Participants reported higher engagement, suggesting gamification as a means to boost exploratory activities without increasing cognitive load.^[53] In agile contexts, a 2025 qualitative study by Neri, Marchand, and Walkinshaw, published in Springer's XP proceedings, analyzed ET integration within Scrum teams across multiple organizations. Interviews revealed that ET enhanced adaptability to changing requirements, enabling faster feedback loops and better alignment with sprint goals. Key success factors included team collaboration and shared charters, which mitigated risks of incomplete coverage; without these, ET's benefits diminished in larger teams.^[37] Despite these insights, empirical research on ET exhibits gaps, including a scarcity of longitudinal studies tracking long-term impacts on software quality metrics and insufficient metrics for evaluating AI-integrated ET approaches, such as automated charter generation.^[54] Future work should address these to strengthen ET's evidence base in evolving development paradigms.^[54]

Real-World Applications

In web development, exploratory testing is widely applied to e-commerce sites to investigate user flows and detect user experience issues overlooked by scripted tests. For example, testers might simulate atypical shopping scenarios, such as rapid cart additions or cross-device session handoffs, revealing inconsistencies in navigation or payment gateways. At Google, exploratory testing has been utilized internally to uncover subtle interface defects, as illustrated in a 2007 case where a young tester's unscripted exploration exposed documentation and replication challenges in software verification.^[55] Similarly, in a crowdtesting project for La Redoute's e-commerce app, exploratory sessions across 18 iOS devices mimicked real user behaviors, identifying usability bugs and providing improvement suggestions that enhanced cross-platform consistency.^[56] For mobile app testing, exploratory sessions focus on device-specific behaviors during Android and iOS releases, allowing testers to probe interactions like gesture responses or battery impacts under varying conditions. This approach is particularly effective for revealing issues in dynamic environments, such as app performance across network fluctuations or OS-specific permissions. An industrial multiple case study across four software development companies demonstrated how exploratory testing addressed mobile-unique challenges, including location-based features and hardware integrations, leading to more robust app releases.^[57] In enterprise software, exploratory testing integrates into banking systems to conduct security explorations during compliance audits, enabling testers to simulate adversarial actions like unauthorized access attempts or data leakage paths. This helps verify adherence to regulations such as PCI DSS by uncovering vulnerabilities in transaction processing or authentication flows. In complex payment environments, firms have employed exploratory testing to identify hidden risks, such as edge-case failures in multi-factor authentication, ensuring system reliability and reducing exposure to fraud.^[58] Real-world applications highlight lessons from both successes and failures in exploratory testing. For instance, in agile software development case studies, exploratory testing has revealed integration bugs in DevOps pipelines, such as mismatched API responses during continuous deployment, preventing escalations to production; however, inadequate session documentation in one analyzed incident led to challenges in reproducing and prioritizing the defects.^[59] These examples underscore the importance of combining exploratory efforts with structured reporting to maximize impact in fast-paced environments.

Future Trends

Emerging Technologies

Cloud-based testing environments are transforming exploratory testing by providing scalable, remote access to diverse hardware configurations, enabling testers to conduct unscripted sessions without the constraints of local setups. These platforms allow parallel execution of exploratory activities across multiple devices, reducing setup time and increasing coverage for complex applications like mobile software. For instance, AWS Device Farm offers a cloud infrastructure where testers can interact with real physical devices for exploratory testing of new features, supporting manual debugging and ad-hoc explorations in a secure, on-demand manner.^[60] This scalability is particularly beneficial for distributed teams, as it eliminates the need for expensive in-house device labs while maintaining the flexibility inherent to exploratory approaches.^[61] The integration of virtual reality (VR) and augmented reality (AR) technologies is emerging as a key advancement in exploratory testing, particularly for applications designed for immersive user experiences. In VR/AR environments, exploratory testing involves testers navigating simulated spaces to assess spatial interactions, user immersion, and performance under varied conditions, revealing defects such as motion sickness triggers or rendering inconsistencies that scripted tests might overlook. Manual exploratory sessions in these setups emphasize real-time user feedback and adaptive probing, ensuring that immersive apps deliver seamless experiences across hardware like headsets and sensors.^[62] For example, testers can explore virtual prototypes to identify usability flaws in AR overlays or VR navigation, fostering iterative improvements in development cycles.^[63] This approach leverages the exploratory nature of testing to mimic end-user behaviors in controlled yet dynamic simulations. Big data analytics is increasingly applied to logs generated during exploratory testing sessions, enabling the identification of patterns in defect clusters and informing targeted testing strategies. By processing session-based logs—which capture tester actions, observations, and outcomes—analytics tools reveal concentrations of defects in specific modules or workflows, a phenomenon known as defect clustering where a majority of issues arise in fewer than 20% of the codebase.^[64] In practice, post-session analysis of these logs helps quantify defect distribution and reproducibility, highlighting areas of weak coverage or coding vulnerabilities without relying on predefined scripts.^[65] This data-driven insight enhances the efficiency of exploratory testing by guiding future sessions toward high-risk zones, though it requires robust logging practices to ensure comprehensive data capture. As of 2025, collaborative platforms are rising in prominence for supporting real-time exploratory testing among distributed teams, facilitating shared sessions and instant feedback to bridge geographical gaps. These platforms integrate features like live screen sharing, concurrent annotations, and centralized defect logging, allowing multiple testers to contribute to a single exploratory charter simultaneously. For example, tools such as TestRail enable time-boxed sessions with real-time collaboration, where team members can observe and intervene in exploratory activities remotely, boosting collective discovery of issues.^[66] This trend aligns with agile practices in global teams, where synchronous sharing reduces miscommunication and accelerates defect resolution, with adoption projected to grow as remote work persists.^[67]

AI and Automation Integration

The integration of artificial intelligence (AI) into exploratory testing has evolved to augment human testers by providing real-time guidance and automating routine aspects, allowing for more focused creative exploration. AI-guided tools, such as generative AI models like ChatGPT and GitHub Copilot, assist in suggesting testing heuristics, brainstorming edge cases, and dynamically generating test charters based on initial user inputs or application context. For instance, these tools can analyze requirements or past session data to propose exploratory paths, such as prioritizing security vulnerabilities in a login feature, thereby expanding the scope of human-led discovery without rigid scripting.^[68]^[69] In hybrid automation approaches, AI handles repetitive tasks within exploratory sessions, such as visual regression testing, while preserving human oversight for nuanced judgment. Platforms like Testim leverage AI to offer session-based suggestions, including smart locators for UI elements and playback of exploratory actions, which automate documentation and bug drafting from screenshots or audio logs. Similarly, Applitools employs Visual AI to scan interfaces for anomalies across devices, automating detection of layout shifts during ad-hoc exploration and integrating with CI/CD pipelines for seamless feedback, thus freeing testers to pursue innovative defect hunting. This synergy enhances efficiency in Agile environments by combining AI's pattern recognition with human intuition.^[70]^[71]^[72] A growing trend as of 2025 involves agentic AI systems, which autonomously perform exploratory actions such as UI interactions and decision-making in testing environments, further augmenting human-led sessions by handling complex, multi-step explorations.^[73] Despite these advancements, challenges persist, including AI-induced biases in suggestion generation that may overlook diverse user scenarios if training data lacks inclusivity, necessitating rigorous validation of outputs. Human oversight remains essential in complex, ambiguous contexts where AI struggles with novel ambiguities or inconsistent results, as seen in generative models that require manual refinement for accurate test charters. Ethical concerns around algorithmic discrimination further underscore the need for diverse datasets and transparency in AI-driven tools.^[69]^[74]^[75] Projections for 2025 indicate AI could improve overall software testing efficiency by up to 45% in Agile and DevOps pipelines, primarily through reduced maintenance and faster session analysis, according to industry analyses. Pilot programs at Microsoft, using Azure DevOps with AI-generated automation from manual exploratory inputs, have demonstrated streamlined transitions to continuous testing.^[76]^[77] Google's internal use of Gemini models for automating UI testing supports enhanced QA workflows by reducing manual effort in exploratory phases.^[78] These developments position AI as a transformative co-pilot, scaling exploratory practices amid accelerating software delivery demands.^[79]

References

[1]
exploratory testing - ISTQB Glossary
A test approach in which tests are dynamically designed and executed based on tester's knowledge, exploration of a test item, and previous test results.
[2]
[PDF] The Nature of Exploratory Testing - Cem Kaner
The Nature of Exploratory Testing. Copyright © 2004 Cem Kaner & James Bach. Scenario testing. • We can use any technique in the course of exploratory testing.
[3]
[PDF] Standard Glossary of Terms used in Software Testing Version 3.1 All ...
Testing based on the tester's experience, knowledge and intuition. exploratory testing. Ref: After Bach. An informal test design technique where the tester ...
[4]
Exploratory Testing - Satisfice, Inc.
All testing is exploratory. Some testing is very much so. This page summarizes exploratory testing as we think about it in RST methodology.
[5]
[PDF] Exploratory Testing Explained
Cem. Kaner suggests regular meetings with testers to discuss test progress, at least once per week. He finds it useful to open the meeting with a standard ...
[6]
[PDF] ISTQB Certified Tester - Foundation Level Syllabus v4.0
Sep 15, 2024 · Software testing is a set of activities to discover defects and evaluate the quality of software work products. These work products, when being ...<|control11|><|separator|>
[7]
quality assurance - ISTQB Glossary
Activities focused on providing confidence that quality requirements will be fulfilled. Abbreviation: QA
[8]
Defining Exploratory Testing « Cem Kaner, J.D., Ph.D.
Exploratory software testing is a style of software testing that emphasizes the personal freedom and responsibility of the individual tester.
[9]
What Is Exploratory Testing? - Atlassian
Exploratory testing is an approach to software testing that is often described as simultaneous learning, test design, and execution.
[10]
[PDF] Exploratory Testing - DevelopSense
Exploratory software testing is… • a style of software testing. • that emphasizes the personal freedom and responsibility. • of the individual tester.
[11]
[PDF] Glimpses from the History of Software Testing
Nov 20, 2013 · • Until 1956 - Debugging oriented. • 1957–1978 - Demonstration oriented. • 1979–1982 - Destruction oriented. • 1983–1987 - Evaluation oriented.Missing: shift | Show results with:shift
[12]
[PDF] Software Testing Techniques - CMU School of Computer Science
Before the year 1975, although software testing was widely performed as an important part of software development, it remained an intuitive, somehow ad hoc ...
[13]
History of Software Testing - GeeksforGeeks
Jul 23, 2025 · The first testing team was formed by Gerald M. Weinberg. Demonstration-oriented Era (1957-1978): During this era, testing was carried out as a ...
[14]
[PDF] Black Box Software Testing - BBST® Courses
I coined the phrase “exploratory testing” in 1983 to describe the practice of some of the best testers in Silicon. Valley. Naturally, the concept has evolved ( ...
[15]
[PDF] Exploratory Testing - Cem Kaner
Nov 17, 2006 · WHET #1 and #2 – James Bach convinced me that the activities we undertake to learn about the product (in order to test it) are exploratory too.
[16]
What is Software Testing? - IBM
History of software testing ... Software testing began alongside the development of software engineering, which emerged just after World War II. Computer ...
[17]
The AST Legacy - Association for Software Testing
The organization was founded by visionary leaders including Cem Kaner, James Bach, and Bret Pettichord, who had articulated the seven principles of context- ...Missing: co- | Show results with:co-
[18]
About James Bach - Satisfice, Inc.
I created the first-ever class in Exploratory Testing. I created the Rapid Software Testing methodology. I have written a couple of books (Lessons Learned ...
[19]
Context Driven Testing
The context-driven school of software testing advocates testing in a way that conforms to the context of the project.
[20]
Reduce Risk and Increase Confidence with Exploratory Testing
4-day returnsThis book contains a wealth of concrete and practical advice about exploring your software to discover its capabilities, limitations, and risks.
[21]
Contemporary Exploratory Testing - Maaret Pyhäjärvi - Leanpub
Aug 4, 2024 · This book is about exploratory testing as an approach to thinking and learning while testing. Some might call this skilled testing. Some might say just testing.
[22]
None
Summary of each segment:
[23]
Session-Based Test Management - Satisfice, Inc.
Nov 1, 2000 · SBTM is a kind of activity-based test management which is an alternative to artifact-based management.
[24]
Top 12 Exploratory Testing Tools | BrowserStack
Explore tools & techniques for exploratory testing. Improve your app's quality and uncover hidden bugs with a hands-on testing approach.
[25]
Session based test management (SBTM) - Ministry of Testing
Dec 17, 2024 · It's a method for measuring and managing exploratory testing. It's a management tool to help others see how a tester is progressing in their exploratory ...
[26]
Top 10 Jira Testing Tools for QA Teams - TestRail
Oct 16, 2025 · Testmo is a unified Jira test management platform that integrates test cases, exploratory testing, and automation into a single interface. The ...1. Testrail · 4. Qmetry Test Management... · 5. PractitestMissing: OBS XMind
[27]
Top 15 Best Exploratory Testing Tools (Updated 2025) - Testmo
This article lists our top 15 best exploratory testing tools to manage your exploratory test sessions, track ad-hoc testing and take rich notes & screenshots.
[28]
Document Exploratory Testing Using Mind Maps
Explain the idea of using mind maps' techniques in Exploratory Testing sessions. Create mind maps to generate tests and to document your test execution.Mind Map Style Exploratory... · Document Exploratory Testing...
[29]
Exploratory Testing: How to Perform Effectively in Agile Development
Nov 7, 2024 · This post will teach you how to structure, perform, and report on exploratory testing using an agile test management tool.
[30]
(PDF) Team Exploratory Testing Sessions - ResearchGate
Aug 9, 2025 · In this paper, we study the team aspect in the ET context and explore how to use ET in team sessions to complement other testing activities. The ...
[31]
Session-Based Test Management (SBTM) in Agile Development
Aug 9, 2022 · Session-based testing is a software test method that aims to combine accountability and exploratory testing to provide rapid defect discovery.
[32]
Hybrid Testing: Combining Manual and Automated Testing - testRigor
Mar 18, 2025 · Hybrid testing is a testing approach that combines manual and automation testing techniques to maximize efficiency, coverage and accuracy in developing a ...
[33]
Thoughts Toward The Ethics of Testing - Satisfice, Inc.
Jun 14, 2012 · Maintain a reasonable impartiality. The purpose of testing is to cast light on the status of the product and its context, in the service of my ...Missing: considerations | Show results with:considerations
[34]
Implementing Exploratory Testing in an Agile Context: A Study ...
Oct 17, 2023 · Exploratory Testing (ET) is a testing technique that has been spreading in the agile environment, as it allows professionals to learn ...
[35]
Exploratory Software Testing in Scrum: A Qualitative Study
May 29, 2025 · Exploratory Testing (ET) is a dynamic software testing approach that emphasises creativity, real-time learning, and defect discovery.
[36]
[PDF] Exploratory Testing | Agile Alliance
Two great ways of vectoring exploratory testing can be found in session based test management by James Bach and exploratory testing tours by James Whittaker.
[37]
Exploratory Testing: A Dynamic Approach to Software Quality ...
Dec 16, 2024 · This paper delves into the concept, benefits, limitations, and applicability of exploratory testing in modern agile and DevOps environments.
[38]
Exploratory testing in connected mode - Azure - Microsoft Learn
Oct 1, 2025 · Users with Basic access can use the extension to perform exploratory testing, as described in this article.Prerequisites · Connect to Azure DevOps
[39]
Exploratory Testing in a Large Organization - Agile Alliance
I will start with the definition as described by James Bach. “Simultaneous learning, test design and test execution”. Exploratory Testing Explained – James Bach ...
[40]
How the Agile Method Transforms Software Testing | Planview LeanKit
Exploratory testing emphasizes the tester's autonomy, skill, and creativity, much as other Agile practices emphasize these same qualities in developers.
[41]
How Exploratory Testing Reveals Hidden Issues - BairesDev
Feb 18, 2025 · Exploratory testing is a hands-on, unscripted testing technique that uses a tester's creativity, experience, and intuition.Approach Differences · Techniques And Tools For... · Best Practices For...
[42]
https://www.bairesdev.com/blog/exploratory-testing/
[43]
[PDF] An experiment on the effectiveness and efficiency of exploratory ...
more defects of varying levels of difficulty, types and severity levels. ... Itkonen J, Rautiainen K (2005) Exploratory testing: a multiple case study. In ...
[44]
https://torkar.github.io/pdfs/ese-exp-test.pdf
[45]
Fostering the diversity of exploratory testing in web applications
Jun 19, 2022 · Exploratory testing (ET) is a software testing approach that complements automated testing by leveraging business expertise. It has gained ...
[46]
A Methodical Approach to Functional Exploratory Testing for ... - MDPI
Oct 5, 2022 · The purpose of this paper is to present a case study of functional exploratory testing that demonstrates it to be a highly valuable technique.
[47]
Exploratory testing: a multiple case study - IEEE Xplore
Abstract: Exploratory testing (ET) - simultaneous learning, test design, and test execution - is an applied practice in industry but lacks research.
[48]
https://ieeexplore.ieee.org/document/1541817
[49]
https://www.satisfice.com/articles/et-article.pdf
[50]
Exploratory testing: Do contextual factors influence software fault ...
Itkonen et al. Defect detection efficiency: test case based vs. exploratory testing. Proceedings of International Symposium on Empirical Software Engineering ...<|control11|><|separator|>
[51]
(PDF) An Experiment on the Effectiveness and Efficiency of ...
Aug 7, 2025 · An Experiment on the Effectiveness and Efficiency of Exploratory Testing. June 2014 ... Itkonen · Aalto University · Richard Torkar at University ...
[52]
8-year-old exploratory testing - Google Testing Blog
May 2, 2007 · This story vividly demonstrates two points about exploratory testing. First is that you have to be very careful to record everything you do ...
[53]
Case Study | La Redoute: E-Commerce App Crowdtesting - CTG
Exploratory tests were performed on 18 devices on iOS. The testers replicated the behavior of typical users to identify bugs and provided suggestions based on ...
[54]
(PDF) Mobile Application Testing in Industrial Contexts
Aug 7, 2025 · In this paper, we presented a multiple case-study involving four software development companies in the area of mobile and smartphones ...
[55]
Exploratory Testing in Complex Payment Environments - Ubertesters
Sep 12, 2025 · Discover how exploratory testing helps uncover hidden risks and ensures reliability in complex payment environments.
[56]
(PDF) Investigating the Role of Exploratory Testing in Agile Software ...
Aug 9, 2025 · This paper clarifies the complex interactions between exploratory testing and Agile principles, illuminating their effects on project outcomes, ...
[57]
AWS Device Farm FAQs | Mobile & Web App Testing
... exploratory testing of new functionality, and executing manual test plans. AWS Device Farm also offers significant savings by eliminating the need for ...
[58]
Mobile App Testing: Test Types, Best Practices, and Tools - TestRail
Oct 30, 2025 · Ranorex is an automation testing tool that supports mobile app testing on both Android and iOS platforms. Its intuitive interface enables ...
[59]
How to test AR/VR apps the right way - DeviQA
Aug 27, 2025 · Learn about best practices for AR/VR app testing that improve quality, catch issues early, and deliver seamless immersive experiences.
[60]
How to Test Augmented/Virtual Reality (AR/VR) – Immersive ...
Functional Testing- Exploratory testing, planning, and implementing test cases as per the functionality or business requirements, while completely integrating ...
[61]
What is Defect Clustering in Software Testing? - BrowserStack
Defect clustering in software testing refers to a non-uniform distribution of defects throughout the application. It is instead concentrated in a few select ...Defect Clustering Principle · Types Of Defects · Defect Prevention Methods...
[62]
Team Exploratory Testing Sessions - Saukkoriipi - 2012
Apr 5, 2012 · Based on the defect clustering, one area was recognized as having weak testing coverage and possible coding problems. During the analysis phase, ...Missing: logs | Show results with:logs<|control11|><|separator|>
[63]
9 Software Testing Trends in 2025 - TestRail
Jul 10, 2025 · Emerging trends like AI-assisted testing, cloud-based tools, shift-left testing, and crowdtesting are helping teams meet modern demands and stay ...
[64]
Top Exploratory Testing Tools to Watch in 2025 - Testomat.io
Apr 2, 2025 · In this exploratory testing tutorial, you'll learn about the essential tools that make running exploratory tests simple and effective.
[65]
Exploratory Testing with GenAI: How AI Becomes an External ... - Qt
Sep 9, 2025 · Maaret Pyhäjärvi – Director, Consulting, CGI · Role: Scaling AI-driven capabilities in Testing within CGI's global software development and QA ...Using Ai For Software... · Start Where You Are · Tl;Dr For Testers And Qa...<|control11|><|separator|>
[66]
AI in exploratory testing - Xray Blog
Jul 3, 2025 · The integration of AI into Exploratory Testing isn't about replacing human testers but rather augmenting their capabilities. By leveraging AI ...
[67]
AI in Software Testing: The Automation Revolution - Testim.io
Testing exploratory support – AI can guide testing efforts by providing suggestions and recommendations during an exploratory testing session. Predictive ...
[68]
Low code, AI-powered Functional and Visual Testing - Testim
Feb 8, 2025 · Learn how functional and visual testing compliment each other to deliver a holistic testing strategy. Testim and Applitools integration.<|separator|>
[69]
AI-Driven Testing with Applitools Autonomous: What You Need to ...
Oct 24, 2024 · Applitools Autonomous is a leading AI-based testing platform that reduces the time and effort required to create, maintain, and run tests. The ...About Ai-Driven Testing · Ai-Driven Testing Key... · About Applitools Autonomous
[70]
Testing AI Applications: Challenges and Best Practices
Sep 18, 2025 · - Algorithmic Biases: AI apps can inadvertently discriminate against minorities if the training data itself contains social biases. Detecting ...
[71]
Exploring the Challenges in AI Testing - Testworthy
Without transparency, there is a lack of accountability, potential for bias as well as a general mistrust of AI driven work. Lack of Trained Resources. Another ...Lack Of Quality Data · Ethical Issues · Need For Human Element<|separator|>
[72]
[PDF] state of testing™ - report 2025 - PractiTest
Machine learning/AI testing increased from 7% in 2023 to 16% in 2025, reflecting growing interest in leveraging AI for test automation, defect prediction, and ...
[73]
How Top Companies Are Using AI to Speed Up Software Testing in ...
Jul 1, 2025 · AI-powered self-healing automation is key to speed up software testing by minimizing manual repairs. In fact, 30–50% of automated UI tests fail ...
[74]
From Manual Testing to AI-Generated Automation
Jul 24, 2025 · Seamless CI/CD integration, allowing hundreds of tests to run automatically; On-demand test execution directly from the Azure Test Plans ...
[75]
Accelerating scientific breakthroughs with an AI co-scientist
A multi-agent AI system built with Gemini 2.0 as a virtual scientific collaborator to help scientists generate novel hypotheses and research proposals.Missing: testing | Show results with:testing