ISO_IEC_IEEE_29119-12022_ed.2_-_id.81291_Publication_PDF_en.pdf

Software and systems engineering Software testing Part 1:General conceptsIngnierie du logiciel et des systmes Essais du logiciel Partie 1:Concepts gnrauxINTERNATIONAL STANDARDISO/IEC/IEEE 29119-1Second edition 2022-01Reference number ISO/IEC/IEEE 29119-1:2022(E)ISO/IEC 2022 IEEE 2022iiISO/IEC/IEEE 29119-1:2022(E)COPYRIGHT PROTECTED DOCUMENT ISO/IEC 2022 IEEE 2022All rights reserved.Unless otherwise specified,or required in the context of its implementation,no part of this publication may be reproduced or utilized otherwise in any form or by any means,electronic or mechanical,including photocopying,or posting on the internet or an intranet,without prior written permission.Permission can be requested from either ISO or IEEE at the respective address below or ISOs member body in the country of the requester.ISO copyright office Institute of Electrical and Electronics Engineers,IncCP 401 Ch.de Blandonnet 8 3 Park Avenue,New YorkCH-1214 Vernier,Geneva NY 10016-5997,USAPhone:+41 22 749 01 11 Fax:+41 22 749 09 47 Email:copyrightiso.org Email:stds.iprieee.orgWebsite:www.iso.org Website:www.ieee.orgPublished in Switzerland ISO/IEC 2022 All rights reserved IEEE 2022 All rights reservedForeword.vIntroduction.vii1 Scope.12 Normative references.13Termsanddefinitions.14 Software testing concepts.164.1 Introduction to software testing.164.1.1 Overview.164.1.2 Relationship to quality management.164.1.3 Verification and validation.164.1.4 Test item.174.1.5 Static and dynamic testing.174.1.6 Exhaustive testing and sampling.184.1.7 Testing as a heuristic.184.1.8 Purpose of testing.184.1.9 Test basis.194.1.10 Test oracle.194.1.11 Test independence.194.2 Test plans and test strategies.194.2.1 General.194.2.2 Risks and risk management.204.2.3 Risks and requirements as the basis of a test strategy.204.2.4 Test approaches.214.2.5 Testing in development and maintenance life cycles.224.2.6 Domains and system characteristics.234.2.7 Test strategy contents.234.3 Test frameworks.244.3.1 Test processes.244.3.2 Test documentation.284.3.3 Documentation requirements.304.3.4 Configuration management and testing.304.3.5 Tool support.304.3.6 Process improvement and testing.304.3.7 Test metrics.314.4 Test design and execution.314.4.1 Test model.314.4.2 Model-based testing.324.4.3 Scripted and exploratory testing.334.4.4 Test design techniques.334.4.5 Experience-based testing.344.4.6 Retesting and regression testing.354.4.7 Manual and automated testing.354.4.8 Continuous testing.354.4.9 Back-to-back testing.354.4.10 A/B testing.364.4.11 Mathematical-based and fuzz testing.364.4.12 Test environments.364.4.13 Test data management.374.5 Project management and testing.374.6 Communication and reporting.374.7 Defects and incident management.38Annex A(informative)System characteristics and testing examples.39ISO/IEC/IEEE 29119-1:2022(E)iii ISO/IEC 2022 All rights reserved IEEE 2022 All rights reservedContents PageISO/IEC/IEEE 29119-1:2022(E)Annex B(informative)Testing roles.46Bibliography.47IEEE Notices and Abstract.48 ISO/IEC 2022 All rights reserved IEEE 2022 All rights reservedivForewordISO(the International Organization for Standardization)and IEC(the International Electrotechnical Commission)form the specialized system for worldwide standardization.National bodies that are members of ISO or IEC participate in the development of International Standards through technical committees established by the respective organization to deal with particular fields of technical activity.ISO and IEC technical committees collaborate in fields of mutual interest.Other international organizations,governmental and non-governmental,in liaison with ISO and IEC,also take part in the work.The procedures used to develop this document and those intended for its further maintenance are described in the ISO/IEC Directives,Part 1.In particular,the different approval criteria needed for the different types of ISO/IEC documents should be noted.This document was drafted in accordance with the rules given in the ISO/IEC Directives,Part 2(seewww.iso.org/directives or www.iec.ch/members_experts/refdocs).IEEE Standards documents are developed within the IEEE Societies and the Standards Coordinating Committees of the IEEE Standards Association(IEEE-SA)Standards Board.The IEEE develops its standards through a consensus development process,approved by the American National Standards Institute,which brings together volunteers representing varied viewpoints and interests to achieve the final product.Volunteers are not necessarily members of the Institute and serve without compensation.While the IEEE administers the process and establishes rules to promote fairness in the consensus development process,the IEEE does not independently evaluate,test,or verify the accuracy of any of the information contained in its standards.Attention is drawn to the possibility that some of the elements of this document may be the subject of patent rights.ISO and IEC shall not be held responsible for iden