Which of the following attributes should NOT be included in a test execution report associated with a suite of automated tests?
You are implementing a TAS for a system that has been live for over three years, using a hybrid waterfall and agile lifecycle. Live updates are made on a monthly basis.
There is no test team, with developers designing and executing unit and integration tests with some degree of automation and business analysts designing and executing manual tests at the system level. No formal test process exists, although the system has proved relatively stable for most of the time.
Unfortunately, the last two monthly releases were problematic with regression defects found in production. Your priority is the automation of functional regression tests at the system level, the budget for this has been approved by project stakeholders.
The Business Analysts have identified which test cases are most suitable for regression. You must use the organisation's long standing commercial automation tool which has passed a proof of concept in the platform for the system in question.
Which of the following suitability criteria needs the MOST attention for the TAS?
You are using a gTAA to create a TAS for a project. The TAS is aimed specifically at automating a suit of existing manual test cases for standalone desktop applications. All the interfaces between the TAS and SUT will be from the CUI of the application.
Which of the following layers of the gTAA should you focus on for the TAS?
Your organisation has successfully implemented a Test Automaton Solution (TAS) for a new project which has since been delivered into production via a number of sprints. A series of maintenance releases are now planned.
Some improvements were made to the Test Automation Architecture (TAA) as a result of feedback from the early sprints. The TAA improvements affected the TA, and the TAS was changed for the final sprint.
The new version of the TAS was generally well received but some performance and usability issues were encountered with the TAS which have yet to be addressed.
The test automation engineers supporting the maintenance releases must decide whether to use the enhanced TAS or the version that was used successfully for previous sprints.
What is the BEST action to take next?
A project consists of distributed teams working in a 24-hour environment, where activities happen at all hours of the day. This project adopts a CI (Continuous Integration) process when developer check-in code and consists of automated activities that include generating a build and deploying it to a test environment. Automated integration tests are run multiple times a day. The project have asked for a report containing the automation test results for every build, which must be available 24/7 to the project team.
Which of the following would be the BEST way to automatically provides this report?
The Test Automation Manager has asked you to provide a solution for collecting metrics from the TAS that measures code coverage every time the automated regression test pack is run. The metrics must be trend based to ensure that the scope of the regression test pack continues to reflect enhancements made to the SUT - coverage must not drop and should ideally increase. The solution must be as automated as possible to avoid unnecessary manual overheads and errors.
Which of the following approaches would BEST meet these requirements?
Your TAS has been running successfully on a Windows/GUI based SUT for some years. The SUT has undergone minimal change over the years to maintain business as usual, deploying six-monthly releases for minor enhancements and bug fixes using a waterfall lifecycle.
The TAS has not changed at all during this period. The current project for the SUT will be using the Scrum methodology to deliver a more modern, competitive, user interface. It is in the release planning stage with an agreed release backlog and set of sprints outlined.
The move from lengthy waterfall releases to shorter sprints has led you to conduct a review of the current TAS to make sure it is robust and fully optimised for the timescale challenges of the new project.
What two steps would be BEST to undertake during the review?
a) Ensure that new automation code is using the same naming conventions as existing code.
b) Perform a full regression run in Sprint 1 to identify what improvements could be made to the TAS for future sprints.
c) Ensure that the TAS is using the latest libraries for the operating system.
d) Review the functions that act upon the controls for the GUI for possible consolidation.
e) Involve the test team to see what ease-of-use improvements they would like to see made to the TAS.
Consider a SUT that small run on multiple platform during the execution of automated test runs. In each test run an automated test suite needs to be executed, with the same version of the TAF, against the same version of the SUT of each platform. Each platform shall have its own dedicated test environment. Your goal is to implement a process as automated as possible ( i.e with minimal manual intervention) that allows implementing a consistent setup of the TAS across the multiple test environments.
Which two of the following aspects are MOST relevant for achieving your goal in this scenario?
A) The configuration of the TAS uses automated installation scripts
B) The TAF saves the logs needed to debug errors in XML format
C) Features of the TAF not used by the automated tests have been tested
D) All the automated test cases contain the expected results
E) The TAS components are under configuration management
You are testing a major enhancement to an air traffic control user interface. You have use of a sophisticated pre-production test environment, created specifically for large scale automated regression, performance and security testing. The window for regression testing is limited and
must successfully conclude, with no major regressions remaining, before the non-functional testing starts.
You have been using the same version of the TAS for the last few releases, each time completing the automated regression test suite in a single overnight run. However, due to the latest enhancements for the SUT, you believe there is a risk that the test suite may no longer complete
overnight and therefore delay performance and security testing.
Which option would be the BEST and MOST cost-efficient approach to mitigate this risk?
When the SUT provides insight into the behaviour of the system, providing the users the with the status of the various actions performed so that they can check that expected behaviour equals actual behaviour, what is this called?