{"id":10546,"date":"2020-05-27T18:01:13","date_gmt":"2020-05-27T18:01:13","guid":{"rendered":"https:\/\/www.genrocket.com\/blog\/?p=10546"},"modified":"2026-06-10T14:37:38","modified_gmt":"2026-06-10T14:37:38","slug":"data-modeling-and-referential-integrity","status":"publish","type":"post","link":"https:\/\/www.genrocket.com\/blog\/data-modeling-and-referential-integrity\/","title":{"rendered":"Data Modeling and Referential Integrity"},"content":{"rendered":"

Part 2 in the series: Moving from Test Automation to Intelligent Automation<\/em><\/strong><\/p>\n

In part 1 of this series, we introduced the concept of Intelligent Data Provisioning<\/a><\/em><\/u> – the ability to design and generate test data on-demand using a flexible self-service framework. It\u2019s the future of traditional Test Data Management<\/a><\/em> and essential for ensuring quality at speed<\/em> in DevOps and Agile environments.
\n<\/p>\n

To ensure the validity of synthetic data<\/a> designed to replicate a production database, it\u2019s crucial to maintain the integrity of its data structure. Data structure is defined by a database schema or Data Definition Language (DDL) and serves as the blueprint for generating real-time synthetic test data. With GenRocket\u2019s\u00a0Test Data Automation<\/em>\u00a0(TDA)<\/a> platform, a QA team member imports the data model into the TDA platform. Then with the help of an intelligent wizard, all parent\/child\/sibling relationships are reviewed, refined and established as GenRocket<\/a>\u00a0Domains<\/em>\u00a0for use with any\u00a0Test Data Scenario.<\/em><\/p>\n

\"\"<\/center>The data model defines the relationship between primary keys in a parent table and foreign keys in dependent tables. To ensure referential integrity<\/em> of synthetic test data, all key fields that define data relationships must be properly linked and contain accurate values that are based on business rules. GenRocket holds the only awarded patent for generating test data with referential integrity.<\/p>\n

The concept of referential integrity is illustrated in the ER diagram below. An employee database with a user<\/em> data table contains key pairs that relate the department, role and security-level<\/em> tables. The parent table contains the primary key and its child or sibling tables contain foreign keys. Together, they define the relationships between data tables.<\/p>\n

\"\"<\/center>Learn more about parent, child, sibling relationships and their role in test data generation by viewing this knowledgebase article and embedded video.<\/a><\/u><\/p>\n


\n<\/p>\n

Generating Model-Based Test Data<\/strong><\/p>\n

Once imported and validated, the data model allows QA teams to generate test data for any category of testing<\/a>. This allows rapid provisioning of data for both functional and non-functional tests by applying rules that define the volume and variety of data needed to meet test case objectives. GenRocket\u2019s component architecture and project dashboard make it easy to design and configure the precise test data needed for testing in a matter of minutes.<\/p>\n

\"\"<\/center>This self-service approach fits perfectly within the Agile framework for breaking down large-scale application test requirements (at the Epic<\/em> level) into manageable Stories<\/em> and Tasks<\/em> allowing the QA team to create test cases with specific objectives. By using GenRocket\u2019s TDA platform to control data patterns and permutations, a data-driven testing approach can be employed to maximize test coverage and code quality.<\/p>\n


\n<\/p>\n

\"\"<\/center>
\n<\/p>\n

GenRocket stores Test Data Scenarios and Test Data Cases<\/em> in a repository that is shared by the QA team. Scenarios and Cases<\/em> can be repurposed as needed and version-controlled for automated regression testing on multiple versions of code. Each time a Test Data Scenario or Test Data Case<\/em> is invoked by a test procedure, a fresh copy of data is generated. This allows destructive testing procedures without altering the original state of the test dataset and eliminates the need for data refresh.<\/p>\n

Here is a summary of the steps followed in GenRocket\u2019s Test Data Automation process:<\/u><\/p>\n

    \n
  1. Determine all data sources and formats for the application under test<\/li>\n
  2. Import the data model or DDL for those data sources and validate referential integrity<\/li>\n
  3. Define the test data requirements for each test case at the Agile Story level<\/li>\n
  4. Create executable Test Data Scenarios and Test Data Cases<\/em> using GenRocket\u2019s self-service dashboard<\/li>\n
  5. Automate test procedures and invoke Test Data Scenarios and Test Data Cases<\/em> during test execution<\/li>\n
  6. Store, repurpose and manage Test Data Scenarios and Test Data Cases<\/em> throughout the testing lifecycle<\/li>\n<\/ol>\n

    GenRocket\u2019s intelligent test data provisioning platform elevates test automation to become intelligent automation<\/em> enabling QA to keep pace with Agile and DevOps environments while improving the quality of code released to production.<\/p>\n


    \n<\/p>\n

    Importing a Data Model into GenRocket<\/strong><\/p>\n

    GenRocket has designed multiple ways to import a data model into the GenRocket TDA platform and control the referential integrity of data relationships. This is to accommodate QA teams that may not have access to database schema. Additionally, some databases are poorly normalized and lack good referential integrity. And in some cases, a data model simply does not exist before newly developed code is implemented.<\/p>\n

    Here are four different methods to import a data model into GenRocket:<\/u><\/p>\n

      \n
    1. DDL File Import<\/li>\n
    2. Extract Table Schema (XTS)<\/li>\n
    3. CSV File Import<\/li>\n
    4. Manually with a Scratch Pad<\/li>\n<\/ol>\n

      You can learn how to use each of these methods, by reading this knowledgebase article.<\/a><\/u><\/p>\n

      In the GenRocket component architecture, each data table is represented as a Domain.<\/em> Testers can quickly change Domain<\/em> parent, child and sibling relationships to produce the type of data they need and to maintain the referential integrity of generated data.<\/p>\n

      Database schemas are constantly evolving and GenRocket was designed with this in mind. Even when a schema is not finalized for testing a user story, testers can change their GenRocket Domains<\/em> to reflect the latest version and the system will automatically restructure existing Scenarios to match re-defined Domain relationships. This process is referred to as Domain Auto-Refactoring.<\/p>\n

      For a detailed description of how GenRocket can work with multiple database environments, read the knowledgebase article How GenRocket Works with Databases.<\/a><\/em><\/u><\/p>\n


      \n<\/p>\n

      Modeling a Database Environment – One Domain at a Time
      \n<\/strong><\/p>\n

      GenRocket allows testers, quality engineers and developers to import any data model and immediately begin to design and generate test data. While the process is streamlined by an intuitive user interface and assisted by intelligent automation, modeling a large-scale enterprise database with hundreds of tables can take time.<\/p>\n

      It\u2019s important to understand that only those tables (i.e., Domains<\/em>) needed for a given test case should be modeled and designed into a Test Data Scenario, not the entire database schema. The most efficient way to model a database is by defining one Domain<\/em> at a time, based on test data requirements.<\/p>\n

      Consider the following database schema diagram showing 60 tables. Now imagine an application that needs to access several databases of similar size and scope. It\u2019s not required, or even recommended, that the QA team define the hundreds of data tables potentially touched by this application prior to executing a test plan.<\/p>\n

      \"\"<\/center>Instead, it makes more sense to define and generate the test data Domains<\/em> as they are needed \u2013 one Domain<\/em> at a time. This allows testers to rapidly define test data for a given test case and generate that data on-demand. Then the process can be repeated for subsequent sprints until the entire test plan is complete. This is the best approach for conducting continuous integration and testing in a DevOps environment.<\/p>\n

      \"\"<\/center>Incrementally and over time, all data models for all databases will be fully defined and available for automated functional, non-functional and regression testing. When this happens, the QA organization will realize the maximum benefit of intelligent automation. There will be no requirement for copying, masking, modifying and refreshing production data for testing. Instead, the entire QA process will be transformed into an accelerated quality assurance environment where the speed of testing and the quality code are fully optimized.<\/p>\n

      To see GenRocket\u2019s Test Data Automation<\/em> technology in action, view a banking solutions video in which GenRocket CTO Hycel Taylor demonstrates the power of intelligent test data provisioning.<\/p>\n


      \n<\/p>\n