Test Case Execution Result Report

After completing the execution, Int4 IFTT displays the overview report:

 

You can use the “permanent link” button on the top to display the report in the browser.

If you want to see only information about scenarios, press the “HIDE DETAILS” button.

 

You can display the test case detailed execution report by clicking at any place in the row with the information about the test case:

 

Before we explain the details, please note that to return to the report overview, you need to press the highlighted icon, not the SAP GUI classical control, as that one will move you back to the cockpit.

 

Or, in the “new” SAP GUI:

 

Each detail section starts with the information about integration platform processing. In this case, details of the SAP CPI message are displayed.


The next part of the report might differ depending on the test type and the automation object content. We can compare the middleware outcome or the outcome of the SAP Backend system.

Comparison of SAP Backend (S/4HANA, ECC, others) business documents

The next part of the report might differ depending on the test type and the automation object content. We can compare the middleware outcome or the outcome of the SAP Backend system.

Int4 IFTT reads field values from the database and displays the reference document values in a lighter color (upper row in the cell). The newly created document is shown in a darker color (second row in the cell). Green means that the values are the same, orange that the values are different, but the result is acceptable, and finally, red means the difference.

In the below screenshot, we have a sales order comparison. The automation object contains the definition of VBAK (sales order header) and VBAP (sales order items).

In this example, we can see a lot of differences. However, the primary issue is that some of the sales documents were not created by the same interface message as the reference one.

 

icon represents a null or empty value in the field.

As a default, the report displays two compared values only for erroneous cells (marked red). In other cases, only a newly created value will be presented. To see the whole reference document, press the checkbox “Show reference document”.
To see technical field names of the column and tables, press the checkbox “Show technical field names”.

Comparison of output messages

The message diff tool automatically compares all the fields of the two XML messages: the reference message and the new test outcome. By default, if the value of the compared field differs, it is marked in red. To apply the different rules to a field, see Payload Validation Ignore List section.

 

In case if one interface message generates few outputs, there are display alltogether and the content is available after pressing the respective button:

 

 

it is also possible to compare the flat files, for example, EDIFACT messages:

In this view, similarly to the backend document comparison, in the same table row, the upper rows contain the reference message, and the lower rows extract from current execution.

 

 

 

© 2017 - 2022 Int4 AG All rights reserved