Guide: Defining your test configuration

Track Test bed use

This guide walks you through the process of defining your project’s test configuration.

What you will achieve

At the end of this guide you will have a test bed instance with a fully configured setup to allow users to start testing. As part of this guide you will create:

  1. A domain, representing your overall project.
  2. A specification, identifying what your users will be testing against.
  3. A test suite, containing the executable test cases your users can use.
  4. A community, to manage your project’s users.
  5. An organisation, as part of the community to execute tests.

Note

Acting as community administrator: This guide demonstrates use of the test bed as a test bed administrator, matching what you would have on a local instance used for development. In practice, when using the shared ISA² test bed you would be acting as community administrator with a ready-made (but empty) domain and community.

What you will need

  • About 15 minutes.
  • A web browser.
  • A test bed instance that you can access via your browser.
  • The test bed user guide (to optionally lookup additional information on each of the described steps).

How to complete this guide

This guide will lead you step-by-step through the interface of a freshly installed test bed to define your test configuration. In terms of defining your testing needs and strategy, we will be using the fictional context described in Guide: Creating a test suite. In short, you will be assumed to be part of a cross-border project that is defining a specification for the content of purchase orders that are to be exchanged between EU retailers.

In terms of a test suite to address your project’s testing needs you can follow Guide: Creating a test suite to create it or simply download the resulting test suite from here. This test suite contains a single test case that allows the developers of retailer systems to validate purchase orders via direct upload. Note that if you want to use a more complex test suite you may also use the one resulting from Guide: Messaging in test cases (available here). The overall steps followed by this guide would not differ apart from the test suite archive to be used.

Finally, keep in mind that all the steps you will be following are documented at length in the test bed user guide. The current guide provides a guided and condensed version of the documentation considering your specific fictional scenario.

Steps

Carry out the following steps to complete this guide.

Step 1: Log in

The first step is to log into the test bed using the default test bed administrator account:

  • Email: test@test.com
  • Password: test
../_images/login.png

Once logged in you will be greeted with the test bed’s landing page (empty for a new installation):

../_images/landing.png

Note

Further info: The test bed’s landing page is where you and your users can access all the test bed’s features. It also serves as the place to include custom welcome information that can differ per user community or even per organisation.

Check the user guide’s Log in section for more details.

Step 2: Create a domain

Click the ADMIN link from the interface’s header and then, from the side menu, the Domain Management link. In doing so you have now accessed the (currently empty) domain management dashboard.

../_images/domainDashboard.png

This is where, as test bed administrator, you can view the different domains defined. Each of these typically relates to a single project as it serves to group together related specifications. Click on the Create domain button to create one for your project.

../_images/createDomain.png

In the resulting form provide the details for your project, specifically:

  • Short name: EU Purchase Order Project
  • Full name: EU Purchase Order Project
  • Description: A project to define the Purchase Order specifications for the electronic exchange of purchase orders between EU retailers

Once ready, click on Save to create your domain. You should now be back on the domain management dashboard where you can see the domain you just created for your project:

../_images/domainList.png

Click the newly created table row that corresponds to your domain. In doing so you will be presented with your domain’s details as follows:

../_images/domainDetails.png

Note

Further info: Domains serve to group related specifications and focus your user’s available options to what interests them. In addition, they represent the place where test suites can be parameterised to match your specific test bed instance.

Check the user guide’s Manage test configuration section for more details.

Step 3: Create a specification

Next up we will create an entry for the specification that our project is defining. Note that in this case we will define a single one but in you could also have multiple. It all depends on the different actual specifications your users are able to test conformance for.

Click the Create specification button, following which you will be presented with the form to complete its details:

../_images/createSpecification.png

In this form enter the following information:

  • Short name: EU Purchase Order v1.0
  • Full name: EU Purchase Order v1.0
  • Description: Defines the XML syntax of purchase orders that are to be exchanged between EU retailers

Finish creating the specification by clicking on Save. You will return to the domain’s details that now also includes the specification you just created.

../_images/specificationList.png

Click on the newly created table row that corresponds to your specification to view its details:

../_images/specificationDetails.png

Note

Further info: A specification matches one-to-one the actual specifications your users will be testing for conformance. This may be a single overall specification or multiple depending on the conformance possibilities available to your users (e.g. you could define a specification per version if you want to support parallel versions). Specifications identify actors and the test suites that will be used.

Check the user guide’s Manage specification details section for more details.

Step 4: Upload a test suite

For the next step you will deploy your first test suite. Click on the Deploy test suite button and select the test suite ZIP archive you want to upload. For the purpose of this guide use the test suite from Guide: Creating a test suite available here. This test suite defines:

  • An actor named Retailer.
  • A single test case named testCase1_upload to allow the validation of purchase orders via direct upload.

Once the test suite is uploaded you will see a summary popup of what was changed. Closing this you will now see the specification’s details updated to include the newly defined actor and test suite:

../_images/testSuiteUpload.png

Note

Further info: At this point you have everything you need to start testing. A typical step from here would be that you first try out the new test suite using the administrator’s test system.

Check the user guide’s Validate your test setup section for detail on how to do this. For the purpose of this guide we will first proceed with the creation of your project’s community to complete the configuration part of your project.

Step 5: Create a community

With the testing setup complete, we will next define a community for our project’s users. You could use the Default community created with the test bed but it is a best practice to always define a specific community as this facilitates subsequent management. This is also how you would be operating when on the ISA² test bed, where your project would be introduced as a community.

First off click the User Management link from the left-hand menu. Doing so will take you to the user management dashboard which is where a test bed administrator manages fellow administrators and communities:

../_images/userManagementDashboard.png

From this screen click the Create community button. This will present you with a form to introduce your community’s information:

../_images/communityCreation.png

Enter the following information:

  • Short name: EU Purchase Order community
  • Full name: EU Purchase Order community

To complete click Save. Doing so will take you back to the user management dashboard where you should now see your new community:

../_images/communityList.png

From this table click the table row for your newly created community. Doing so will take you to your community’s detail page:

../_images/communityDetails.png

We will next link the community to the domain you previously created. Doing so, although not mandatory, will allow your users to only see the specifications relevant to their testing needs.

Expand the Domain drop-down list and select the entry for EU Purchase Order Project. Once selected, click on Save changes to complete the link. This takes you back to the user management dashboard where you see the available communities. As we are not finished yet with a community, click its row from the table to come back to its detail page.

As a final setup point for the new community we will add a community-specific landing page that will greet your users. To create this click the Create landing page button. Doing so you are presented with the form to complete the landing page’s information:

../_images/createLandingPage.png

Provide here the following information:

  • Name: EU Purchase Order landing page
  • Default: Checked (i.e. true).
  • For the content use the editor to add a message such as the following:
../_images/landingPageContent.png

Click on Save to complete. In the confirmation box that appears click Yes to confirm that you want to set a new default landing page. Doing so will ensure that all organisations of this community will see the same landing page when using the test bed.

Note

Further info: The community detail page provides a single point from which all user management aspects linked to its members can be handled. From here community administrators can be defined as well as community’s member organisations and users. In addition, from here customised information such as landing pages (which we saw) and legal notices can be managed that will serve to personalise the test bed for the community’s users.

Check the user guide’s Manage community details section for details on the available options.

Step 6: Create an organisation

As a final step in the initial configuration that we will do, we will create a first organisation for our community. Recall that organisations are the entities that will be testing for conformance that further define their own users and administrators.

From the community’s detail page click the Create organisation button. Doing so presents you with the form to fill in the organisation’s details:

../_images/createOrganisation.png

As a first organisation we will introduce a fictional retailer called ACME retailing. Complete its information as follows:

  • Short name: ACME Retailing
  • Full name: ACME Retailing

When ready click on Save to create the organisation. Doing so will return you to the community’s detail page where you should see ACME Retailing included in the list of community organisations:

../_images/organisationList.png

To complete let’s proceed with creating an administrator for this organisation. Click its row from the Organisations table to access its details:

../_images/organisationDetails.png

Next click on the Create user button. This will take you to a screen to enter the new user’s information:

../_images/userCreate.png

Complete the form as follows:

  • Name: John Doe
  • Email: admin@retailing.acme.eu
  • Role: Administrator
  • One-time password: admin
  • Confirm one-time password: admin

To complete the creation of the user click on Save. You will then be returned to the organisation’s detail page where you will see your new user added to its list of users:

../_images/createdUser.png

Note

Account credentials: The email you provide when creating a user is considered a functional account name formatted as an email address. The test bed does not check to see if it is an active address nor does it ever attempt to send it emails. Regarding the password, this is a one-time password that the user will be prompted to change upon first login.

With the creation of the first organisation’s user your initial setup can be considered complete.

Note

Further info: The test bed allows you to perform additional actions for organisations such as customising their experience through landing pages or configuring their tests on their behalf. In terms of user roles, organisations may have administrators, to define what they will be testing for, and users to execute and follow-up on tests.

Check the user guide’s Manage organisation details section for details on the possibilities regarding organisations.

Summary

Congratulations! You have just completed the basic setup on the test bed to start testing. In doing so you defined details relevant to your project in terms of domain, specification and test suites, as well as a community for the management of your project’s members.

See also

Be sure to check out the test bed user guide for further information on the steps you completed as well as the test bed’s additional features. A good next step for you from this point would be to try executing some first tests. Check out Guide: Executing a test case that will use the setup you completed here to run a first test session.

When expanding your currently limited test setup you would typically want to create additional test cases to express further testing scenarios and potentially extend the test bed’s capabilities to cover domain-specific needs. The following resources offer information to help with this: