How do I set up the “Test Automation Tool” in SAP S/4HANA Cloud?

SAP S/4HANA Cloud provides a test tool that can help customers automate their testing during various phases of the projects and also during quarterly upgrade. This blog will help you understand the steps to be followed for set-up of the test tool.

The test automation tool is available only in customer’s quality systems(Q systems).You can start using test automation tool from the realize phase as soon as you are provisioned with the “Q” system.

Recommendation is to use the test automation tool starting from the realize phase. This helps customers to automate the regression testing phase after quarterly upgrade in run phase.

To use the test automation tool, you need access to test automation tool apps which are “Test Your Process”, “Manage Your Test Process” and “Analyze Automated Test Results”. The apps “Test Your Process”, “Manage Your Test Process” are accessible via role “SAP_BR_BPC_EXPERT” or“SAP_BR_ADMIN_TEST_AUTOMATION”. The app “Analyze Automated Test Results” is only accessible via role “SAP_BR_ADMIN_TEST_AUTOMATION”. The recommended browser is Chrome.

SAP_BR_BPC_EXPERT – Access to test automation tool app

SAP_BR_ADMIN_TEST_AUTOMATION – Access to test automation tool apps

To use the test automation tool, you need to first set up the test tool via app “test your process”. You need to add a test user to the manage user section of the app. Open the app test your process and click on the manage user icon appearing at the footer of the screen.

The initials landing page would be empty as no user has been set up. Then click on the add button to add the test user.

This will open a pop-up window displaying the fields Role, Description, User Name and Password. Let’s see details of each field.

Role:

The first entry should be with “DEFAULT”. This is mandatory for the test tool to execute. The role here does not mean you need to create a role name called DEFAULT. This role is only linked with standard automate for test execution purpose. To execute the standard automates this entry needs to exist. To do a role based testing you can create more roles and add user. The same role name should be added to the standard automate for test execution.

Description:

You can define the purpose of this role like test user or test administrator.

User Name:

The user name here needs to be an active business user with which user can log into SAP S/4HANA Cloud using the same user name. This field is a search help to select the users available in the system. Ensure the test users exist in identity provider.The maintenance of test user is mandatory for the test tool execution.

The recommendation is to create a generic test user specifically for the testing purpose with all the application specific role because if this user does not have roles then the test plans would fail due to no authorization to access the apps.

Currently test automation tool is supporting SAP Cloud Identity and Microsoft ADFS (Supports only basic authentication with login credentials on the one screen).Please note only single factor authentication is supported for the test automation tool to work. The single factor authentication is in which the user provides only one factor – typically a password.The test automation tool does not support a two-factor authentication methods which rely on users providing a password as well as a second factor, usually either a security token. 

Any other IDP configurations can be evaluated for technical feasibility, please raise a request via mail to saps4hanacloudtesttool@sap.com.

In some customer IdP´s 2 factor-authentication is being used. Test automation tool currently does not support the 2-factor-authentification as stated in SAP note 2129147. Some customers could solve this issue via a workaround by:

1) Getting an internal exception from the 2-factor-authentication for a dedicated test user in Q-system

2) Disabling 2-factor-authentication for this dedicated test user within Q-system

3) Maintaining this test user in “test your processes” app as DEFAULT user

Below are the example screen shots:

Password:

The test user which you assign should have the same password with which test user log into SAP S/4HANA Cloud. If you change the password for SAP S/4HANA Cloud, then the password here should also be manually updated as the system does not update the password automatically. If the password is not updated or incorrectly entered, then the test execution will not happen.Based on the customer password policy the system passwords changes frequently depending on customers, it could a month or every quarter. Each time the password changes, it needs to be updated here as well.

For more information on how to set up the tool please refer the guide Testing Tool Admin Guides.