Exam 6: ISTQB-BCS Certified Tester Advanced Level- Test Manager (2012)

The main objectives the senior management team wants to achieve are: - to reduce the costs associated with dynamic testing - to use reviews to ensure that the project is on course for success and following the plan - to use reviews as a well-documented and effective bug-removal activity following a formal process with well-defined roles - to determine the effectiveness of reviews in terms of phase containment - to improve phase containment effectiveness Which of the following answers would you expect to describe the best way to achieve these objectives? Number of correct responses: 1

Assume you are the Test Manager for a new software release of an e-commerce application. The server farm consists of six servers providing different capabilities. Each capability is provided through a set of web services. The requirements specification document contains several SLAs (Service Level Agreements) like the following: SLA-001: 99.5 percent of all transactions shall have a response time less than five seconds under a load of up-to 5000 concurrent users The main objective is to assure that all the SLAs specified in the requirements specification document will be met before system release. You decide to apply a risk-based testing strategy and an early risk analysis confirms that performance is high risk. You can count on a well-written requirements specification and on a model of the system behavior under various load levels produced by the system architect. Which of the following test activities would you expect to be the less important ones to achieve the test objectives in this scenario?

The following chart plots the cumulative number of defects opened against the cumulative number of defects closed during system testing of a software product. Which of the following statements is true? Number of correct responses: 1

You are the Test Manager of a project that adopts a V-model with four formal levels of testing: unit, integration, system and acceptance testing. On this project reviews have been conducted for each development phase prior to testing, which is to say that reviews of requirements, functional specification, high-level design, low-level design and code have been performed prior to testing. Assume that no requirements defects have been reported after the release of the product. Which TWO of the following metrics do you need in order to evaluate the requirements reviews in terms of phase containment effectiveness? Number of correct responses: 2

Consider the following test strategies:

Assume you are managing the system testing execution phase of a project. The system test execution period for that project is scheduled for eighteen weeks and the release date is scheduled at the end of system testing. During the sixth week of system test execution, at the staff meeting, the project manager informs you that the project deadlines are changed and the release date that is only three weeks ahead. This new release will not allow the completion of the system tests. Suppose also that you have followed a risk-driven test approach for this project. Which of the following statements represents the worst way to lead your test team in the next three weeks? Number of correct responses: 1

Which of the following statements describing the consequences of specifying test conditions at a detailed level is NOT true?

After a selection process you have selected a test management tool that is going be introduced in your organization and used by your test team in a pilot project. You have already identified the member of your test team who will be the administrator of the tool, since he/she has a significant experience with the administration of test management tools and so he/she is able to make effective and efficient up-front decisions about "how" the tool will be used. You have also developed a training plan for the other members of your test team. In collaboration with the administrator of the tool you have also devised standard ways of managing, storing and maintaining the tool and its assets including backup/restore procedures. You have also analyzed standard formats supported by the tool (CSV, XLS, XML, etc.) to export, import and archive all the information managed by the tool itself (requirements, test case specifications, test plans etc.) for compliance with the most important test management tools, in order to minimize the impacts of migrating this information to a new tool that could replace the existing one in the future. Which of the following phases in the lifecycle of the new tool has NOT been adequately considered in this description?

Which of the following statements best describes an appropriate approach for managing exploratory testing?

You are following a risk-based testing strategy. The test execution time is very limited. Assume that all the product risk items require more or less the same level of test effort. Which of the following answers describes the best execution schedule in this scenario? Number of correct responses: 1

Which of the following is an example of the test closure activity indicated as "lessons learned"? Number of correct responses: 1

Assume you are the Test Manager in charge of independent testing for avionics applications. You are in charge of testing for a project to implement three different CSCI (Computer Software Configuration Item): - a BOOT-X CSCI that must be certified at level B of the DO-178B standard - a DIAG-X CSCI that must be certified at level C of the DO-178B standard - a DRIV-X CSCI that must be certified at level A of the DO-178B standard These are three different software modules written in C language to run on a specific hardware platform. You have been asked to select a single code coverage tool to perform the mandatory code coverage measurements, in order to meet the structural coverage criteria prescribed by the DO-178B standard. This tool must be qualified as a verification tool under DO-178B. Since there are significant budget constraints to purchase this tool, you are evaluating an open-source tool that is able to provide different types of code coverage. This tool meets perfectly your technical needs in terms of the programming language and the specific hardware platform (it supports also the specific C-compiler). The source code of the tool is available. Your team could easily customize the tool to meet the project needs. This tool is not qualified as a verification tool under the DO-178B. Which of the following are the three main concerns related to that open-source tool selection? Number of correct responses: 3 (2 credits out of 3 credits correct, 1 credit point)

Which one of the following metrics to be produced needs traceability between the test cases and each item in a proper test basis?

You are a Test Manager working for a software organization where reviews have never been applied. After a meeting with your managers examining a business case for reviews, (including their costs, benefits, and potential issues), the management finally decides to adopt formal reviews for future projects. You have been given a budget that you have spent to provide training in the review process and to introduce the review process on a pilot project. On that pilot project the introduction of reviews has been very positive in terms of positive involvement from all the participants. All the reviews applied to different documents have been very effective for their purposes (especially at revealing defects). Which of the following answers describes an important success factor for the introduction of formal reviews which is missing in this scenario?

Which of the following statements represents the most effective contribution of the stakeholders to the completion of the failure mode analysis table?

A chart showing the trend in the lag time from defect reporting to resolution during system testing is also available. The chart shows that the daily closure period is consistently and significantly above the rolling closure period for a long period of the system testing phase. Almost all defects found during system testing have been related to the system as a whole, not related to single units or integrations issues. Almost all quality risks have been addressed during the unit and integration testing phase and no residual quality risks were present in the integrated system. This has been confirmed by exploratory testing sessions performed during system testing, targeted at finding defects in these quality risk areas. Based on the given information only, which one of the following areas would you expect to be considered more in the retrospective meeting in order to be improved?

During the system testing phase, a tester from your test team observes a failure in the system under test and he/she decides to create an incident report. The incident report is currently in a "new" state, indicating it needs to be investigated. Which THREE of the following information items can't yet be present in the incident report? (Choose three.)

Consider the following statements describing the importance of improving the test process:

The following are the exit criteria described in the test plan of a software product: EX1. The test suite for the product must ensure that at least each quality risk item is covered by at least one test case (a quality risk item can be covered by more test cases). EX2. All test cases in the test suite must be run during the execution phase. EX3. Defects are classified into two categories: "C" (critical defect) and "NC" (non-critical defect). No known C defects shall exist in the product at the end of the test execution phase. Which of the following information is useless when the specified exit criteria is evaluated? Number of correct responses: 1

Assume you are currently working on a project developing a system where functional requirements are very well specified. Unfortunately, non-functional requirements do almost not exist. You are the Test Manager. You have to choose a technique for test selection that allows testing of non-functional characteristics, especially reliability. Which of the following techniques for test selection do you expect being most useful in this scenario?