Running a Soap Test and Viewing Results
Once the test is created it can be replayed and the reports
can be generated for analysis. Following are the details on how a soap test is replayed.
Overview:
Replaying a Test
You can replay test using one of the following option:
- Toolbar:Clicking the Start button from the
toolbar..
- Menu
option: Selecting Project -> Run from menubar.
When you replay a test, application creates required soap envelope and executes test. The progress of the
Web Test can be seen in the Status tab where the currently executing task is highlighted.
While the test is replaying, you can pause it for a while by clicking Pause. You can stop the test
anytime while replaying by clicking Stop button..
When there are multiple groups in the test, there are a few things to note:
- All groups will be replayed by default.
- You can choose to 'Ignore' a group by selecting the 'Ignore Group' checkbox.
- You can run only the selected group by selecting 'Run Selected' from the Project menu option.
Once the test completes replaying, results of the execution can be seen in the Results tab.
In the Web Test Status tab you can see the
progress of replaying of the test through the test tree. Each node in the test
tree is visited as and when that particular task is replayed. Once the replay is over,
the results can be seen in the Results tab on the navigation frame.
The Results tab shows the results tree. The frame on the right-hand side will show the result at a:
- Project level: You can see the Project
Summary which is an overall result for the project including a combined
view of all the machines on which test is executed.
- Machine level: In case you are executing test on multiple machines simultaneously then you can see summary of execution of project on each machine. When running test on single machine application shows machine as localhost.
- Iteration level: You can see the
Iteration Summary which shows the results for the selected Iteration
within the project.
- Group level: You can see the Group
Summary which shows the results for the selected Group within an
Iteration.
- Task level: This is the result
for the selected Task within the selected Group within an
Iteration.
Project Summary
Project Summary shows the overall results of the test. The right hand side frame shows following
:
- Machine Summary: This section graphically
represents the status of all the Machines on which the project was executed.
A table also shows the same status data in a table, which is used to
draw the pie-chart.
- Machine Replay Status Table: This section
shows details of the Machines. All the Machines on which the project
has run, are shown in this table along with their status (whether failed
or succeeded or Not Played or Stopped) and the Machine names are
hyperlinked to the details of that Machine.
Machine Summary
Machine Summary shows the overall results of execution of test on single machine. The right hand side frame shows following
:
- Iteration Summary: This section graphically
represents the status of all the Iterations for which the project has
run. A table also shows the same status data in a table, which is used to
draw the pie-chart.
- Iteration Replay Status Table: This section
shows details of the Iterations. All the Iterations for which the project
has run, are shown in this table along with their status (whether failed
or succeeded or Not Played or Stopped) and the Iteration names are
hyperlinked to the details of that Iteration.
Iteration Summary
The Iteration Summary shows results for that iteration in terms of the
success or failure status of the groups replayed within the iteration. The right hand side frame shows following:
- Group Summary: A pie chart shows the success
or failure status of Groups in the selected Iteration. A table
accompanies the pie chart.
- Group Replay Status Table: This table lists
the groups in the iteration. You can click a group name to view its
detailed status - the Group Summary.
Group Summary
The Group Summary shows results for the selected Group. The right hand side frame shows following:
- Group Summary: This section has shows pie
charts for tasks.
- Task Replay Status table: This table lists the
Tasks with their status.
Task Summary
The Task Summary shows results for the selected Task. The right hand side frame shows following tabs:
- Status tab: This tab shows details of the Task that was replayed including its status -
successful or failed and reason for failure if failed.
- Validations tab: If you have validations configured for this Task, you can see the results of the
same here. This view will show the validation tree for each type of validation along with the status (Successful or Failed).
- Browser Control: The web control at bottom shows the response saved during replaying