Deck 6: ISTQB-BCS Certified Tester Advanced Level- Test Manager (2012)

Question 1

Which of the following statements, about the test reporting activities for a project adopting an iterative lifecycle model with very short iterations (e.g. two weeks iterations), is correct? Number of correct responses: 1

A) Test reporting activities can't be influenced by the use of an iterative lifecycle model with short iterations
B) Test reporting activities are not important for projects adopting an iterative lifecycle model with short iterations
C) Test reporting activities are less important for projects adopting an iterative life cycle model with short iterations. They should be performed at the end of the last iteration
D) Test reporting activities are still important with an iterative lifecycle. The reports can be used to conduct post-iteration review sessions before starting with the next iteration

Answer 1

D

Question 2

Which of the following statements describing the consequences of specifying test conditions at a detailed level is NOT true? Number of correct responses: 1

A) In an environment where the test basis is continuously changing, it is recommended to specify test conditions at a detailed level in order to achieve a better maintainability
B) The specification of test conditions at a detailed level can be effective when no formal requirements or other development work products are available
C) The specification of test conditions at a detailed level can require the implementation of an adequate level of formality across the team
D) For system testing, the specification of test conditions at a detailed level, carried out early in the project as soon as the test basis is established, can contribute to defect prevention

Answer 2

A

Question 3

The main objectives the senior management team wants to achieve are: - to reduce the costs associated with dynamic testing - to use reviews to ensure that the project is on course for success and following the plan - to use reviews as a well-documented and effective bug-removal activity following a formal process with well-defined roles - to determine the effectiveness of reviews in terms of phase containment - to improve phase containment effectiveness Which of the following answers would you expect to describe the best way to achieve these objectives? Number of correct responses: 1

A) You should plan for lightweight exit-phase reviews at the end of each development and testing phase, and plan for a process of gathering information from testing to perform an analysis aimed at identifying the larger cluster of defects
B) You should plan for formal exit-phase reviews at the end of each development and testing phase, and plan for a process of gathering information from testing to perform an analysis aimed at identifying the larger cluster of defects
C) You should plan for formal exit-phase reviews at the end of each development phase and testing phase, and plan for a process of gathering information from testing to perform an analysis of the bugs found during testing to determine the people responsible for those bugs
D) You should plan for formal exit-phase reviews at the end of each development and testing phase, and plan for a process of gathering information from testing to perform an analysis of the bugs found during testing to determine the phase in which they have been introduced

Answer 3

D

Question 4

Consider an agile team adopting Extreme Programming (XP) with five developers and one tester without any coding experience. To which of the following activities would you expect the tester will contribute most? Number of correct responses: 1

A) Developing unit tests
B) Executing unit tests
C) Planning and executing tests during the integration test phase to detect interface defects
D) Supporting the customer in the execution of acceptance testing

Question 5

For which of the following activities would the costs be classified as a cost of detection? Number of correct responses: 1

A) Writing test specifications according to the test design
B) Training developers to better understand the new features of the coding language they will use on the project
C) Re-running a test case, during the system testing phase, to verify that a fix eliminates a previously found defect
D) Fixing field failures

Question 6

After the presentation, you are asked to explain the chart. Assume you have applied a full risk-based testing strategy. Which of the following answers would you expect to best describe the pie chart? Number of correct responses: 1

A) All the risk items have been covered with tests. No more risk items remain to test
B) According to the full risk-based testing strategy applied, it is very likely that the highest-risk items, tests and bugs remain in the blue and red areas. Therefore, it is very risky to release the application
C) Only the lowest-risk items, tests and bugs should remain in the blue and red areas. Therefore the application can be released at any time subject to management of the items identified in those areas
D) 97 percent of the risk items has been tested. No open bugs or test failures remain. Only 3 percent of risk items remains to be covered by the remaining test

Question 7

The following are the requirements identified as "critical": REQ-SEL-001. The user shall be able to combine all the three products with all the four durations to define an item to purchase REQ-SEL-002. The user shall be able to add a maximum of six different items to the shopping cart REQ-PUR-001. The user shall be able to purchase all the items in the shopping cart using a credit voucher REQ-PUR-002. The user shall be able to purchase all the items in the shopping cart using the available credit already charged on the smartcard REQ-PUR-003. The user shall be able to purchase all the items in the shopping cart using all the accepted credit cards (Visa, MasterCard and Great Wall Card) REG-LOGO-001. The user shall be able to logout (by clicking the logout button) from both the "select" and "purchase" pages going back to the "browse" page (anonymous navigation) Moreover the following quality risk item has been identified as "critical": QR-P1. The web customer portal might not be able to provide the expected response time (less than 10 sec) for the purchase transactions under a load of up-to 1000 concurrent users Test analysis for system testing has just begun and the following test conditions have been identified: TC-SEL-01. Test the combinations of products and durations to define an item to purchase TC-SEL-02. Test the maximum number of items, which can be added to the shopping cart TC-PUR-01. Test the purchase of an item TC-PUR-02. Test the purchase of an item with the credit charged on the smartcard Assume that you have used traceability to determine the logical test cases that cover all the requirements and the single risk item identified in that scenario. Which of the following is a positive logical test that is complete, is correct, and covers the REG-LOGO-001 requirement? Number of correct responses: 1

A) On the purchase page ("purchase state"), click the logout button; verify that the browse page ("browse state") is displayed
B) On the select page ("select state"), click the logout button
C) On the purchase page ("purchase state"), click the logout button; verify that the "Impossible to logout - complete or cancel the current transaction" message is displayed
D) On the browse page ("browse state"), click the logout button

Question 8

The following are the exit criteria described in the test plan of a software product: EX1. The test suite for the product must ensure that at least each quality risk item is covered by at least one test case (a quality risk item can be covered by more test cases). EX2. All test cases in the test suite must be run during the execution phase. EX3. Defects are classified into two categories: "C" (critical defect) and "NC" (non-critical defect). No known C defects shall exist in the product at the end of the test execution phase. Which of the following information is useless when the specified exit criteria is evaluated? Number of correct responses: 1

A) A traceability matrix showing the relationships between the product risk items and the test cases
B) A list of all the open defects with the associated classification information extracted from the defect tracking system
C) A chart, showing the trend in the lag time from defect reporting to resolution, extracted from the defect tracking system
D) The execution status of all the test cases extracted from the test management tool

Question 9

You are following a risk-based testing strategy. The test execution time is very limited. Assume that all the product risk items require more or less the same level of test effort. Which of the following answers describes the best execution schedule in this scenario? Number of correct responses: 1

A) 1- Test the acceptance of transactions coming from the IVR channel 2- Test the correct charge of the Smart Card with the required contents 3- Test the correct pre-activation of the Smart Card 4- Test the correct activation of the Smart Card
B) 1- Test the correct pre-activation of the Smart Card 3- Test the correct activation of the Smart Card 4- Test the acceptance of transactions coming from the IVR channel
C) 1- Test the correct activation of the Smart Card 2- Test the correct pre-activation of the Smart Card 3- Test the correct charge of the Smart Card with the required contents
D) 2- Test the correct activation of the Smart Card

Question 10

You are the Test Manager of a new project that will have three formal levels of testing: unit, integration and system testing. The testing strategy you decide to adopt a blend of risk-based testing and reactive testing strategies. Which of the following answers describes the most consistent example of implementation of this test strategy during the execution of the system tests? Number of correct responses: 1

A) Your test team executes exploratory tests following a session-based test management approach throughout the system test phase
B) Your test team executes system tests under the guidance of a sample of users throughout the system test phase
C) Your test team executes scripted tests designed and implemented before the execution of the system test phase, to cover the identified product risks. It also performs exploratory testing sessions throughout the system test phase
D) Your test team autonomously performs some exploratory testing sessions and, at the very end of the system testing phase, it also executes more system tests under the guidance of a sample of users

Question 11

Assume that no additional product risks have been identified during the first week of test execution. Which of the following answers would you expect to best describe the residual risks associated with the identified product risks, at the end of the first week of test execution? Number of correct responses: 1

A) Since R3 is the only risk for which all test cases have passed, the risk has been reduced by 20%
B) The test execution status table indicates that the risk has been reduced by 56%
C) The residual risk level can't be determined, because it requires that all the test cases have been executed
D) The test execution table doesn't give an indication of the risk level of the open defects and the test cases that failed or are not run yet

Question 12

You are the Test Manager of a project that adopts a V-model with four formal levels of testing: unit, integration, system and acceptance testing. On this project reviews have been conducted for each development phase prior to testing, which is to say that reviews of requirements, functional specification, high-level design, low-level design and code have been performed prior to testing. Assume that no requirements defects have been reported after the release of the product. Which TWO of the following metrics do you need in order to evaluate the requirements reviews in terms of phase containment effectiveness? Number of correct responses: 2

A) Number of defects found during the requirements review
B) Total number of defects attributable to requirements found during unit, integration, system and acceptance testing
C) Total number of defects found during functional specification review, high-level design review, low-level design review, code review, unit testing, integration testing, system testing and acceptance testing
D) Time to conduct the requirements review
E) Total number of defects attributable to requirements, found during functional specification review, high-level design review, low-level design review, code review, unit testing, integration testing, system testing and acceptance testing

Question 13

The following chart plots the cumulative number of defects opened against the cumulative number of defects closed during system testing of a software product. Which of the following statements is true? Number of correct responses: 1

A) The chart indicates that you have plenty of problems left to find
B) The chart can be used to reveal test progress problems
C) The chart seems to indicate that the defect management process is not working well
D) The chart seems to indicate that the defect management process is working well

Question 14

Which of the following statements represents the most effective contribution of the stakeholders to the completion of the failure mode analysis table? Number of correct responses: 1

A) The aircraft pilot and the customer representative should contribute to assess the detection. The chief software engineer, the system architect and the expert tester should contribute to assess the priority.
B) The aircraft pilot and the customer representative should contribute to assess the priority. The chief software engineer, the system architect and the expert tester should contribute to assess the detection.
C) The system architect and the chief software engineer should contribute to assess the priority. The expert tester is the only one who should contribute to assess the detection.
D) The aircraft pilot is the only one qualified to contribute to assess the priority and thus should be assigned this task. The customer representative should contribute to assess the detection.

Question 15

Assume you are working on a defect management process to be used by a software organization to track the current status of the defects reports for several projects. When a defect is found for investigation a defect report is created in "Opened" state that is the unique initial state. The defect report status has also a unique finale state that is the "Closed" state. The following state transition diagram describes the states of this defect management process: where only the initial ("Opened") and final ("Closed") states are indicated while the remaining states (V, W, X, Y, Z) have yet to be named. Which of the following assignments would you expect to best complete the defect management process? Number of correct responses: 1

A) V=Rejected , W=Corrected , X=Validated, Y=Re-Opened, Z=Assigned
B) V=Assigned, W=Validated , X=Corrected, Y=Re-Opened, Z=Rejected
C) V=Assigned, W=Corrected , X=Validated, Y=Re-Opened, Z=Rejected
D) V= Corrected, W=Assigned, X=Validated, Y=Corrected, Z=Rejected

Question 16

Which of the following information would you expect to be the most useful to perform a defect clustering analysis? Number of correct responses: 1

A) The trend in the lag time from defect reporting to resolution
B) The defect component information
C) The lifecycle phase in which the defect has been introduced
D) The defect removal efficiency information

Question 17

Which of the following is an example of the test closure activity indicated as "lessons learned"? Number of correct responses: 1

A) Archive all the test results of the acceptance testing phase
B) Deliver a list of the open defects of a software product released into production to the service desk team
C) Participate in a meeting at the end of a project aimed at better managing the events and problems of future projects
D) Deliver an automated regression test suite, used during the system test phase of a software product released into production, to the team responsible for maintenance testing

Question 18

Which of the following factors could negatively influence a review? Number of correct responses: 1

A) Include people with the adequate level of knowledge, both technical and procedural
B) Include people who are detail-oriented and scrupulous at finding issues
C) Include as many people as possible in order to have more viewpoints about possible problems on the item under review
D) Include people able to contribute to a clear, thoughtful, constructive and objective discussion

Question 19

Consider a defect report and assume that a part of its lifecycle includes the following states: New: Is the initial state Working: Means that the developers are addressing the defect in order to produce a fix for the defect Clarification: Means that the developers need more information from the tester to address the defect and produce a fix for the defect and the tester is working to provide this information to the developers Verification: Means that a fix for the defect has been produced and the tester is running the adequate tests to verify whether the fix solves the defect Closed: is the final state Which of the following answers represents an invalid sequence of states that can't lead the bug report to the "Closed" state? Number of correct responses: 1

A) New, Working, Verification, Working, Clarification, Working, Verification, Closed
B) New, Working, Clarification, Working, Verification, Closed
C) New, Working, Verification, Working, Clarification, Working, Closed
D) New, Working, Verification, Closed

Question 20

Which of the following statements about the STEP test process improvement model is true? Number of correct responses: 1

A) In the STEP model, tests validate the requirements and use cases when they are developed
B) The STEP model stresses defect detection and demonstration of capability, whereas the defect prevention is a secondary potential goal of testing
C) The STEP model assures that the system requirements specification and the test design specification processes don't overlap
D) In the STEP model, testware design occurs after coding

Question 21

You can count on well-written requirements, but you can't count on an adequate contribution of the stakeholders to the quality risk analysis. You have to mitigate the insufficient contribution of the stakeholders because the risk-based testing approach shall minimize the product risks. Your test team has one expert tester in security testing. Which of the following test activities would you expect to be the less important in this context?

A) Extract from the defect tracking system of the previous project all the security defects and failures, and classify them to support design and execution of specific tests.
B) Automate all functional and non-functional system tests.
C) Apply systematic and exploratory testing for integration and system test.
D) Perform exploratory testing sessions with adequate charters covering security aspects.

Question 22

Assume you are the Test Manager for a new software release of an e-commerce application. The server farm consists of six servers providing different capabilities. Each capability is provided through a set of web services. The requirements specification document contains several SLAs (Service Level Agreements) like the following: SLA-001: 99.5 percent of all transactions shall have a response time less than five seconds under a load of up-to 5000 concurrent users The main objective is to assure that all the SLAs specified in the requirements specification document will be met before system release. You decide to apply a risk-based testing strategy and an early risk analysis confirms that performance is high risk. You can count on a well-written requirements specification and on a model of the system behavior under various load levels produced by the system architect. Which of the following test activities would you expect to be the less important ones to achieve the test objectives in this scenario?

A) Perform unit performance testing for each single web service.
B) Monitor the SLAs after the system has been released into the production environment.
C) Perform system performance testing, consisting of several performance testing sessions, to verify if all the SLAs have been met.
D) Perform static performance testing by reviewing the architectural model of the system under various load levels.

Question 23

The following is the unique "critical" quality risk item that has been identified: CR-RSK-1. The GUI of the application might accept non-integer values for the input field designed to get the number of bottles from the user. Test analysis for system testing has just begun and the following test conditions have been identified: TC-SEL-2. Test the selection of the package sizes TC-SEL-4. Test wrong numbers of bottles for an order TC-CR-RSK-1. Test the accepted values from the input field designed to get the number of bottles from the user Assume that you have used traceability to determine the logical test cases that cover all the requirements and the single risk item identified in that scenario. Which of the following is a positive logical test that is complete and correct, and covers the REQ-SEL-4 requirement?

A) Select a 6-bottles package, then try to insert 5 bottles; verify that no error messages are displayed.
B) Select a 6-bottles package, then try to insert 7 bottles; verify that no error messages are displayed.
C) Select a 6-bottles package, then try to insert 7 bottles; verify that the "Invalid number of bottles" message is displayed.
D) Select a 6-bottles package, then try to insert 7 bottles.

Question 24

Assume you are managing the system testing phase of a project. The system test execution period is scheduled to twenty weeks. All tests are manual tests. You are following a risk-driven test approach. During the last staff meeting the project manager tells you new deadlines that will not allow completion of all the system tests. Which of the following would you expect to be the best way to respond to this situation?

A) Prioritize executing the tests for the highest product risks and track these risks.
B) Remove testers from your test team, so that they can be assigned to other projects.
C) Automate all remaining tests.
D) No action is needed, test as much as possible in the remaining time period.

Question 25

The following is the unique "critical" quality risk item that has been identified: CR-RSK-1. The GUI of the application might accept non-integer values for the input field designed to get the number of bottles from the user. Test analysis for system testing has just begun and the following test conditions have been identified: TC-SEL-2. Test the selection of the package sizes TC-SEL-4. Test wrong numbers of bottles for an order TC-CR-RSK-1. Test the accepted values from the input field designed to get the number of bottles from the user What is the MINIMUM number of test conditions that must be added to fulfill both the EXCR1 and EXCR2 exit criteria?

A) 4
B) 3
C) 2
D) 1

Question 26

You are the Test Manager on a project following an iterative life-cycle model. The project should consist of nine iterations of one month duration each. It is planned to develop the most important features to have a stable core of the application in the first three iterations and to add the additional features in the last six iterations. At the beginning of the first iteration, only a draft version of the requirements specification document for the core features is available. Assume that during each of the first three iterations, the chosen features are fully completed and unit tested. Which of the following statements is true in this context?

A) The system test phase should start when all the requirements are frozen.
B) You should allocate a large effort for system testing during the first three iterations.
C) You should allocate all the effort for the system test phase only in the last iteration.
D) You should apply the same test strategy as used in a sequential life cycle model.

Question 27

Assume you are the Test Manager in charge of independent testing for avionics applications. You are in charge of testing for a project to implement three different CSCI (Computer Software Configuration Item): - a BOOT-X CSCI that must be certified at level B of the DO-178B standard - a DIAG-X CSCI that must be certified at level C of the DO-178B standard - a DRIV-X CSCI that must be certified at level A of the DO-178B standard These are three different software modules written in C language to run on a specific hardware platform. You have been asked to select a single code coverage tool to perform the mandatory code coverage measurements, in order to meet the structural coverage criteria prescribed by the DO-178B standard. This tool must be qualified as a verification tool under DO-178B. Since there are significant budget constraints to purchase this tool, you are evaluating an open-source tool that is able to provide different types of code coverage. This tool meets perfectly your technical needs in terms of the programming language and the specific hardware platform (it supports also the specific C-compiler). The source code of the tool is available. Your team could easily customize the tool to meet the project needs. This tool is not qualified as a verification tool under the DO-178B. Which of the following are the three main concerns related to that open-source tool selection? Number of correct responses: 3 (2 credits out of 3 credits correct, 1 credit point)

A) Does the tool support all the types of code coverage required from the three levels A, B, C of the DO-178B standard?
B) Does the tool have a good general usability?
C) What are the costs to qualify the tool as a verification tool under the DO-178B?
D) Is the installation procedure of the tool easy?
E) Does the tool require a system with more than 4GB of RAM memory?
F) Is the licensing scheme of the tool compatible with the confidentiality needs of the avionics company?

Question 28

You are performing a quality risk analysis for a CSCI (Computer Software Configuration Item) used to implement a CBIT (Continuous Built-In Test) module of a safety-critical system. During the quality risk analysis, you are trying to identify the ways in which failures of the CBIT module can occur, for each of them trying to determine the potential causes and likely effects, and the risk level (calculated as the product of three factors: severity, occurrence and detection). Which of the following risk analysis techniques are you working with?

A) A lightweight product risk analysis technique
B) Failure Mode and Effect Analysis
C) Wide Band Delphi
D) Cost of Exposure

Question 29

Assume that the following test cases have been executed at the end of the first week of test execution: TC-001, TC-002 and TC-007. All these tests are 'passes'. What is the MINIMUM number of the remaining test cases that must be successfully executed to fulfill the EX1 exit criteria?

A) 4
B) 5
C) 6
D) 7

Question 30

Which of the following statements represents the most effective contribution of the stakeholders to the completion of the failure mode analysis table?

A) The aircraft pilot and the customer representative should contribute to assess the detection. The chief software engineer, the system architect and the expert tester should contribute to assess the priority.
B) The aircraft pilot and the customer representative should contribute to assess the priority. The chief software engineer, the system architect and the expert tester should contribute to assess the detection.
C) The system architect and the chief software engineer should contribute to assess the priority. The expert tester is the only one who should contribute to assess the detection.
D) The aircraft pilot is the only one qualified to contribute to assess the priority and thus should be assigned this task. The customer representative should contribute to assess the detection.

Question 31

Consider an agile team adopting Extreme Programming (XP) with five developers and one tester without any coding experience. To which of the following activities would you expect the tester will contribute most?

A) Developing unit tests
B) Executing unit tests
C) Planning and executing tests during the integration test phase to detect interface defects
D) Supporting the customer in the execution of acceptance testing

Question 32

Which of the following statements best describes an appropriate approach for managing exploratory testing?

A) Define very detailed mission statements, which allow testing work to be broken into sessions of up to 10 minutes duration in which testing is guided by these mission statements.
B) Break the testing work in 30 to 120 minutes sessions and use properly defined mission statements consisting of two or three sentences to guide testing during these sessions.
C) Define very generic charters to drive exploratory testing sessions of 2 days where testers are completely free to decide what to test.
D) Exploratory testing should not be managed because such testing is inherently unmanageable and not measurable.

Question 33

Which of the following would you expect to be most likely an example of a motivating factor for testers? Number of correct responses: 1

A) The resources allocated for the testing activities are not sufficient and don't allow the testers to contribute to the quality of the product
B) The testers contribution to the quality of the software products developed from an organization is recognized with increased responsibilities
C) The same regressions tests are executed manually by the same testers, for every product release, without any progression in content
D) The testers are asked to perform, in parallel with their testing tasks, other tasks unrelated to their testing responsibilities

Question 34

Assume you are a Test Manager involved in system testing of a CRM application for a Pay-TV company. Currently the application is able to support a proper number of users assuring the required responsiveness. Since the business is expected to grow, you have been asked to evaluate the ability of the application to grow to support more users while maintaining the same responsiveness. Which of the following tools would you expect to be the most useful at performing this evaluation? Number of correct responses: 1

A) Coverage tools
B) Test management tools
C) Static analysis tools
D) Performance tools

Question 35

A chart showing the trend in the lag time from defect reporting to resolution during system testing is also available. The chart shows that the daily closure period is consistently and significantly above the rolling closure period for a long period of the system testing phase. Almost all defects found during system testing have been related to the system as a whole, not related to single units or integrations issues. Almost all quality risks have been addressed during the unit and integration testing phase and no residual quality risks were present in the integrated system. This has been confirmed by exploratory testing sessions performed during system testing, targeted at finding defects in these quality risk areas. Based on the given information only, which one of the following areas would you expect to be considered more in the retrospective meeting in order to be improved?

A) The requirements review
B) The defect management process
C) The quality risk analysis process
D) The system design and architecture design reviews

Question 36

You are not confident with the assessment of the risk level and you suspect that it will be possible to find high-priority bugs in low-risk areas. Furthermore, the period for test execution is very short. Your goal is to test all the product risks in a risk-based way, while assuring that each product risk gets at least some amount of testing. Which of the following answers describes the best test execution schedule in this scenario?

A) T1, T2, T3, T4, T5, T6, T7, T8, T9, T10
B) T1, T3, T5, T7, T9, T2, T4, T6, T8, T10
C) T10, T9, T8, T7, T6, T5, T4, T3, T2, T1
D) T10, T8, T6, T4, T2, T9, T7, T5, T3, T1

Question 37

You are following a risk-based testing strategy. The test execution time is very limited. Assume that all the product risk items require more or less the same level of test effort. Which of the following answers describes the best execution schedule in this scenario?

A) 1- Test the acceptance of transactions coming from the IVR channel 2- Test the correct charge of the Smart Card with the required contents 3- Test the correct pre-activation of the Smart Card 4- Test the correct activation of the Smart Card
B) 1- Test the correct pre-activation of the Smart Card 3- Test the correct activation of the Smart Card 4- Test the acceptance of transactions coming from the IVR channel
C) 1- Test the correct activation of the Smart Card 2- Test the correct pre-activation of the Smart Card 3- Test the correct charge of the Smart Card with the required contents
D) 2- Test the correct activation of the Smart Card

Question 38

Assume you are managing the system testing execution phase of a project. The system test execution period for that project is scheduled for eighteen weeks and the release date is scheduled at the end of system testing. During the sixth week of system test execution, at the staff meeting, the project manager informs you that the project deadlines are changed and the release date that is only three weeks ahead. This new release will not allow the completion of the system tests. Suppose also that you have followed a risk-driven test approach for this project. Which of the following statements represents the worst way to lead your test team in the next three weeks? Number of correct responses: 1

A) Neglect your management activities and work side-by-side with your test team executing tests
B) Considering the executed tests, you should reduce the test coverage back on the risk analysis and adjust downward the priority of the associated risk items
C) Convince all the people of your test team that each of them is an important and needed member, and that their contribution is fundamental to the success of the team
D) Favor and encourage a proactive attitude where people ask for new tasks as soon as they finish their current tasks

Question 39

In your organization the following tools of the same vendor are currently in use: a requirements management tool, a test management tool and a bug tracking tool. You are the Test Manager. You are currently evaluating a test automation tool of the same vendor (to complete the vendor's tool suite) against an interesting open-source test automation tool under the GNU GPL (General Public License). There are no initial costs associated to that open-source tool. Which of the following statements associated to the selection of the open-source tool is correct in this scenario? Number of correct responses: 1

A) The open-source tool can be modified but only if the community of developers of that tool gives you the formal permission to modify it
B) There are no initial costs for the open-source tool but you should carefully consider the costs associated to the integration with the existing tools and also evaluate the recurring costs
C) There are no initial costs for the open-source tool because open-source tools are usually low-quality, while vendor tools have always a better quality than the corresponding open-source tools
D) The open-source tool can be modified but it can't be distributed further in any way

Question 40

Which of the following statements describing the consequences of specifying test conditions at a detailed level is NOT true?

A) In an environment where the test basis is continuously changing, it is recommended to specify test conditions at a detailed level in order to achieve a better maintainability.
B) The specification of test conditions at a detailed level can be effective when no formal requirements or other development work products are available.
C) The specification of test conditions at a detailed level can require the implementation of an adequate level of formality across the team.
D) For system testing, the specification of test conditions at a detailed level, carried out early in the project as soon as the test basis is established, can contribute to defect prevention.

Question 41

During the system testing phase, a tester from your test team observes a failure in the system under test and he/she decides to create an incident report. The incident report is currently in a "new" state, indicating it needs to be investigated. Which THREE of the following information items can't yet be present in the incident report? (Choose three.)

A) The type of defect that caused the failure
B) The actual and the expected result highlighting the failure
C) The lifecycle phase in which the defect has been introduced
D) What really caused the failure (actual cause)
E) Steps to reproduce the failure, including screenshots, database dumps and logs where applicable

Question 42

Consider the following statements describing the importance of improving the test process:

A) Test process improvement is important because being focused only on the test process it can provide recommendations to improve the test process itself, but it can't indicate or suggest improvement to areas of the development process. II. Test process improvement is important because it is much more effective than software process improvement to improve the quality of a software system. III. Test process improvement is important because several process improvement models (STEP, TPI Next, TMMi) have been developed over the years. IV. Test process improvement is important because every organization, regardless of the context, should always achieve the maximum level of maturity of testing described in the test improvement models such as TMMi. Which of the following answers is correct?
B) I and IV are true; II and III are false.
C) I, II, III and IV are false.
D) I, II, and III are true; IV is false.
E) I, II, and III are false; IV is true.

Question 43

In the next two months some new features will be constantly added to new releases of a project you are working on as Test Manager. You have identified as one of the main project risks, that the requirements specification will still be incomplete when your team starts the test design and implementation phase. Some requirements will most likely be completed too late to allow a proper test preparation. You and your test team have already worked on several similar past projects in the same organization. Which one of the following options would you expect to be the most effective at mitigating this risk?

A) Don't prepare any test and just run the regression test suite to check that the new features don't introduce regression.
B) Make reasonable assumptions about the missing details and design lightweight tests that can be easily updated during test execution.
C) Don't design any test until the test execution starts, then communicate that test execution is blocked due to incomplete requirements.
D) Even if there are only few details missing, escalate the risk to the project manager without preparing any tests.

Question 44

Which of the following information would you expect to be the most useful to perform a defect clustering analysis?

A) The trend in the lag time from defect reporting to resolution
B) The defect component information
C) The lifecycle phase in which the defect has been introduced
D) The defect removal efficiency information

Question 45

During the follow-up phase the following conditions are checked: X1. The code has been completely reviewed. X2. All the identified defects have been correctly fixed and the modified code has been compiled successfully and run through all the static analyzers used by the project without warnings and errors. X3. The modified code is available under the configuration management system with a new version number for the specified CI. If these conditions are fulfilled then the review process terminates. Which of the following characteristics of a formal review is missing in this description?

A) Defined entry and exit criteria
B) Checklists to be used by the reviewers
C) Deliverables such as reports, evaluation sheets or other review summary sheets
D) Metrics for reporting on the review effectiveness, efficiency, and progress

Question 46

Which of the following statements about the STEP test process improvement model is true?

A) In the STEP model, tests validate the requirements and use cases when they are developed.
B) The STEP model stresses defect detection and demonstration of capability, whereas the defect prevention is a secondary potential goal of testing.
C) The STEP model assures that the system requirements specification and the test design specification processes don't overlap.
D) In the STEP model, testware design occurs after coding.

Question 47

For which of the following activities would the costs be classified as a cost of detection?

A) Writing test specifications according to the test design.
B) Training developers to better understand the new features of the coding language they will use on the project.
C) Re-running a test case, during the system testing phase, to verify that a fix eliminates a previously found defect.
D) Fixing field failures.

Question 48

After a selection process you have selected a test management tool that is going be introduced in your organization and used by your test team in a pilot project. You have already identified the member of your test team who will be the administrator of the tool, since he/she has a significant experience with the administration of test management tools and so he/she is able to make effective and efficient up-front decisions about "how" the tool will be used. You have also developed a training plan for the other members of your test team. In collaboration with the administrator of the tool you have also devised standard ways of managing, storing and maintaining the tool and its assets including backup/restore procedures. You have also analyzed standard formats supported by the tool (CSV, XLS, XML, etc.) to export, import and archive all the information managed by the tool itself (requirements, test case specifications, test plans etc.) for compliance with the most important test management tools, in order to minimize the impacts of migrating this information to a new tool that could replace the existing one in the future. Which of the following phases in the lifecycle of the new tool has NOT been adequately considered in this description?

A) Acquisition
B) Support and maintenance
C) Evolution
D) Retirement

Question 49

Assume you are currently working on a project developing a system where functional requirements are very well specified. Unfortunately, non-functional requirements do almost not exist. You are the Test Manager. You have to choose a technique for test selection that allows testing of non-functional characteristics, especially reliability. Which of the following techniques for test selection do you expect being most useful in this scenario?

A) A model-based technique based on the creation of operational profiles
B) Ambiguity reviews
C) Test condition analysis
D) Cause-effect graphing

Question 50

Which one of the following metrics to be produced needs traceability between the test cases and each item in a proper test basis?

A) Requirements coverage
B) Trends in the lag time from defect reporting to resolution
C) Mean time between failures for the system
D) Cumulative number of reported defects versus cumulative number of resolved defects

Question 51

Which of the following statements describing how identified product quality risks should be mitigated and managed, is true?

A) The extent of re-testing and regression testing activities should be based on the risk level.
B) The identification of new risks, the re-assessment of the level of existing risks and the evaluation of the effectiveness of risk mitigation activities should only occur at the very beginning of a project.
C) Risk mitigation of product quality risks can be effective only after starting test execution.
D) The priority of the development and execution of tests should not be based on the risk level but only on the likelihood.

Question 52

Your test team consists of four members (Mary, Bob, Mark, Dave) with different interpersonal skills. The following skills assessment spreadsheet shows the characteristics of the team members with respect to a list of interpersonal-skills (for each characteristic only the member with the highest level of that characteristic is indicated and marked with 'X'): On the next project a member of your test team will have to perform some routine tasks requiring collaboration with other teams. Who in your test team would you expect to be most suitable at doing these tasks?

A) Mary
B) Bob
C) Mark
D) Dave

Question 53

You are a Test Manager working for a software organization where reviews have never been applied. After a meeting with your managers examining a business case for reviews, (including their costs, benefits, and potential issues), the management finally decides to adopt formal reviews for future projects. You have been given a budget that you have spent to provide training in the review process and to introduce the review process on a pilot project. On that pilot project the introduction of reviews has been very positive in terms of positive involvement from all the participants. All the reviews applied to different documents have been very effective for their purposes (especially at revealing defects). Which of the following answers describes an important success factor for the introduction of formal reviews which is missing in this scenario?

A) Management support
B) Participant support
C) Definition and use of metrics to measure the ROI (Return On Investment)
D) Training in the review process

Question 54

Assume you have some data related to confirmation testing during system testing of a past project. In that project 240 bug reports have been opened once, 80 were opened twice, 10 were opened three times and no bug reports have been opened more than three times. You estimate that a bug report, which has failed its confirmation test, costs, on average, 3 person-hours. Which of the following statements correctly describe the value of these confirmatory testing activities based on cost of quality?

A) 300 person-hours have been spent on the project during the system testing phase, because of the failed confirmation tests and this cost belongs to the costs of internal failure.
B) 340 person-hours have been spent on the project during the system testing phase, because of the failed confirmation tests and this cost belongs to the costs of external failure.
C) 340 person-hours have been spent on the project during the system testing phase, because of the failed confirmation tests and this cost belongs to the costs of internal failure.
D) 300 person-hours have been spent on the project during the system testing phase, because of the failed confirmation tests and this cost belongs to the costs of detection.

Question 55

Consider a defect report and assume that a part of its lifecycle includes the following states: New: Is the initial state Working: Means that the developers are addressing the defect in order to produce a fix for the defect Clarification: Means that the developers need more information from the tester to address the defect and produce a fix for the defect and the tester is working to provide this information to the developers Verification: Means that a fix for the defect has been produced and the tester is running the adequate tests to verify whether the fix solves the defect Closed: is the final state Which of the following answers represents an invalid sequence of states that can't lead the bug report to the "Closed" state?

A) New, Working, Verification, Working, Clarification, Working, Verification, Closed
B) New, Working, Clarification, Working, Verification, Closed
C) New, Working, Verification, Working, Clarification, Working, Closed
D) New, Working, Verification, Closed

Question 56

Consider the following analysis of testing skills performed on four people: Alex, Robert, John and Mark (all the skills have been rated on an ascending scale: The higher the score, the better the skill): Which of these people, based on this analysis, would you expect to be most suitable to work specifically as test designer?

A) Alex
B) Roberta
C) John
D) Mark

Question 57

Consider the following test strategies:

A) Consultative test strategy II. Reactive test strategy III. Analytical test strategy IV. Process-compliant test strategy Consider also the following examples of test activities: Prioritize the test cases, based on the results of a FMEA analysis, to ensure early coverage of the most important areas and discovery of the most important defects during test execution Execute usability testing driven by the guidance of a sample of users (external to the test team) Perform exploratory testing sessions throughout the system test phase On an Agile project, execute tests that cover the test conditions identified for each user story of a feature planned for iteration Which of the following correctly matches each test strategy with an appropriate example?
B) I-2; II-3; III-4; IV-1
C) I-3; II-2; III-1; IV-4
D) I-1; II-2; III-3; IV-4
E) I-2; II-3; III-1; IV-4

Question 58

In the test strategy document your organization declares: to adopt a V-model development lifecycle, with three formal levels of testing: unit, integration and system testing to use a blended risk-based and regression-averse testing strategy for each level of testing The following is an excerpt of the "approach" section for the system test plan document of a new project: "Testing will only use manual tests. Due to the short period of time for test execution, the following activities will be performed in parallel with test execution: Test planning, test analysis and test design. Basic metrics will be taken for test effort (i.e. person-hours), test cases executed (passed/failed), and incidents (no more metrics, such as code coverage, will be collected)." In the system test plan, no deviations from the test strategy are described. Based only on the given information, which of the following statements is true?

A) The approach described in the system test plan document is consistent with the test strategy.
B) The approach described in the system test plan document is consistent with the risk-based testing strategy, but it is inconsistent with the regression testing strategy.
C) The approach described in the system test plan document is consistent with the regression testing strategy, but it is inconsistent with the risk-based testing strategy.
D) The approach described the system test plan document is inconsistent with both the risk-based and regression testing strategies.

Question 59

You are the Test Manager of a new project aimed at developing a software system that must be certified at level B of the DO-178B standard. The project will follow a V-Model software development life cycle and it will have four formal levels of testing: component, integration, system and acceptance testing. You must produce the test plan documentation for this project by providing an adequate coordination across the four levels of testing in order to assure auditability. Which of the following answers would you expect to best describe how to organize the test plan?

A) Produce a single master test plan that covers in detail all four levels, describing the particular activities for all test levels.
B) Produce a master test plan that covers three levels (component, integration, system test) and a separate acceptance test plan.
C) Produce a master test plan describing the relationship between the four levels, and four separate detailed level test plans, one for each level.
D) Produce four separate detailed level test plans, one for each level, without a master test plan.

Question 60

Assume you are managing a test automation project for a mission-critical system. Because vendor provided tools and open source solutions don't meet the needs of this project, you ask your test team to develop a custom automation framework. Which of the following management issues associated to the development of this custom automation framework is least likely to manage?

A) Proper testing for the custom automation framework must be performed.
B) The custom automation framework will require an adequate documentation.
C) The changes to the custom automation framework should be communicated to all external users of this tool under the GNU license.
D) The custom automation framework will need proper maintenance.

Question 61

You are using this skills assessment spreadsheet in order to define a training development plan for your test team. Your objective is to fill the skill gaps by having at least a team member rated as an expert for each skill identified for the "technical expertise" and "testing skills" sections, and with the ability to train the other team members. Considering the budget constraints you can send only one person to a training course. Based only on the given information, which of the following answers would you expect to be the best option to achieve your objective?

A) Send Robert to a performance testing training course.
B) Send Alex to a performance testing training course.
C) Send John to a performance testing training course.
D) Send Mark to a test automation training course.

Question 62

Which of the following would you expect to be most likely an example of a demotivating factor for testers? (Choose two.)

A) The management asks the testers to be kept informed about the intensity, quality and results of testing.
B) The testers' recommendations to improve the system or its testability are adopted by the development team.
C) The same regressions tests are manually executed by the same testers, for every product release, without regression test tools.
D) The testers are assessed on whether and how often they detect important and critical failures.
E) Test quality is measured by counting the number of customer / user reported problems.

Question 63

Which of the following would you expect to be most likely an example of a motivating factor for testers?

A) The resources allocated for the testing activities are not sufficient and don't allow the testers to contribute to the quality of the product.
B) The testers contribution to the quality of the software products developed from an organization is recognized with increased responsibilities.
C) The same regressions tests are executed manually by the same testers, for every product release, without any progression in content.
D) The testers are asked to perform, in parallel with their testing tasks, other tasks unrelated to their testing responsibilities.