QA professionals know the importance of full test coverage for catching hidden software defects. The impact of undetected bugs that leak into production can range from inconsequential to nothing short of catastrophic. A recent Internet outage provides a real-world example of how a single bug can disrupt the global operation of digital business on the Internet.
In traditional Test Data Management (TDM), the test data lifecycle is based on the premise that some or all data used for testing is sourced from production. A full or subsetted copy of a production database is transferred to a clean room where it is examined for personally identifiable information (PII) and masked or anonymized before being transferred to a non-production environment for testing.
Software release frequencies are continuously accelerating. The latest Capgemini/Sogeti Continuous Testing Report 2020 measured the release frequencies for 500 large enterprises in North America and Europe. The results, shown in the graphic below, indicate 61% of organizations are deploying a new build on a daily or weekly basis. Another 26% deploy code hourly, while some even deploy several times per hour.
As the technology leader in synthetic test data generation, GenRocket has created a new paradigm for Test Data Management (TDM) to meet the need for speed when testing in Agile and DevOps environments. Traditional TDM requires modernization. Copying, masking and subsetting production data is simply too time-consuming and cumbersome for the age of Agile.
Wikipedia defines dynamic data as information that changes asynchronously over time as new information becomes available. In financial services, the term is synonymous with transactional data, but the concept of dynamic data is not unique to financial transactions. Dynamic data can result from any change in state during the execution of an application workflow. To properly test workflows with dynamic state changes, the data used for testing must also be dynamic.
There is growing interest among quality assurance professionals in the use of synthetic data generation for software testing. Their interest in synthetic data is usually triggered by a requirement for data privacy or the need for accelerated data provisioning for Agile and DevOps. However, the most compelling reason to augment the use of production data, or manually created spreadsheet data, with synthetic data is to have total control over the variety of data needed to maximize test coverage.
Agile adoption is in full swing. According to the most recent State of Agile Report, it’s being adopted by 95% of organizations. That’s not to say it’s easy to accomplish an Agile transformation. In fact, 77% of organizations are still in the process of implementing its methodologies as they struggle with cultural, organizational and technological change.
Part 3 in the series: Moving from Test Automation to Intelligent Automation In part 2 of this series, Data Modeling and Referential Integrity, we explored GenRocket’s ability to reproduce the structure of any database, file format or data interface standard by importing a data model and establishing referential integrity between related data tables. This capability allows a data architect to establish a framework for testers to generate any volume or variety of test data that conforms to the structure of application data sources. In GenRocket’s component architecture, data tables are referred to as Domains while columns, are referred to as Attributes. In addition to data tables in a database, Domains can define any real-world object. Think of a Domain as you would a noun: a person, place or thing.
Part 2 in the series: Moving from Test Automation to Intelligent Automation In part 1 of this series, we introduced the concept of Intelligent Data Provisioning - the ability to design and generate test data on-demand using a flexible self-service framework. It’s the future of traditional Test Data Management and essential for ensuring quality at speed in DevOps and Agile environments.
Part 1: Making the case for intelligent test data provisioning Automated testing has become essential technology for Continuous Integration and Continuous Delivery. For QA teams to achieve the ultimate goal of quality at speed, the intelligent use of automation must play a significant role at each level of the Agile software testing pyramid.