You are implementing a TAS for a system that has been live for over three years, using a hybrid waterfall and agile lifecycle. Live updates are made on a monthly basis.
There is no test team, with developers designing and executing unit and integration tests with some degree of automation and business analysts designing and executing manual tests at the system level. No formal test process exists, although the system has proved relatively stable for most of the time.
Unfortunately, the last two monthly releases were problematic with regression defects found in production. Your priority is the automation of functional regression tests at the system level, the budget for this has been approved by project stakeholders.
The Business Analysts have identified which test cases are most suitable for regression. You must use the organisation's long standing commercial automation tool which has passed a proof of concept in the platform for the system in question.
Which of the following suitability criteria needs the MOST attention for the TAS?
A major component of your organisation's Test Automaton Solution (TAS) is a popular open-source third-party capture-replay tool for automated functional testing.
Which two of the following must the Test Automation Engineer (TAE) ensure happens for this TAS?
a) The third party tool is placed under configuration management control.
b) The annual support and maintenance costs are agreed with the tool's vendor.
c) It is Important to obtain information about updates and new versions of the tool so that the third party tool is kept up to date.
d) Ensure that the TAS test scripts are integrated into the tool's framework.
e) Ensure that no changes are made to the tool, because modifications are not allowed for third party products.
When the SUT provides insight into the behaviour of the system, providing the users the with the status of the various actions performed so that they can check that expected behaviour equals actual behaviour, what is this called?
Your organisation has successfully implemented a Test Automaton Solution (TAS) for a new project which has since been delivered into production via a number of sprints. A series of maintenance releases are now planned.
Some improvements were made to the Test Automation Architecture (TAA) as a result of feedback from the early sprints. The TAA improvements affected the TA, and the TAS was changed for the final sprint.
The new version of the TAS was generally well received but some performance and usability issues were encountered with the TAS which have yet to be addressed.
The test automation engineers supporting the maintenance releases must decide whether to use the enhanced TAS or the version that was used successfully for previous sprints.
What is the BEST action to take next?
You are executing the first test run of a test automation suite of 200 tests. All the relevant information related to the state of the SUT and to the automated test execution is stored in a small database. During the Automated test run you observe that the first 10 test pass, while an abnormal termination occurs when executing the 11th test. This test does not complete its execution and the overall execution of the suite is aborted. An immediate analysis of the abnormal termination is expected to be time consuming and you have been asked to produce a detailed report of the execution results for the first test run, as soon as possible.
What is the MOST important FIRST step to be taken immediately after the abnormal occurred when executing the 11th test?
Which of the following metrics could suggest, under certain condition that an automated regression test suite has NOT been updated for new functionalities added to the SUT?
Which of the following CORRECTLY describes how automation SHOULD be applied to confirmation testing?
You are testing a major enhancement to an air traffic control user interface. You have use of a sophisticated pre-production test environment, created specifically for large scale automated regression, performance and security testing. The window for regression testing is limited and
must successfully conclude, with no major regressions remaining, before the non-functional testing starts.
You have been using the same version of the TAS for the last few releases, each time completing the automated regression test suite in a single overnight run. However, due to the latest enhancements for the SUT, you believe there is a risk that the test suite may no longer complete
overnight and therefore delay performance and security testing.
Which option would be the BEST and MOST cost-efficient approach to mitigate this risk?
You are implementing test automation for a project and you want to be able to generate test cases automatically using a series of test design tools which use a variety of test design techniques such as decision tables, pairwise testing and boundary value analysis.
You also want to generate test data automatically which can then be used by the tests.
Initially these tests will be run manually to verify their correctness and ultimately you want to include them in the test execution tool so that they can run unattended.
Which layer of the gTAA will be used to support the specification of the test cases and preparation of the test data?
Which of the following statements does NOT describe good practice for maintaining the TAS?