Testing Practitioner Handbook - Renu Rajani - E-Book

Testing Practitioner Handbook E-Book

Renu Rajani

0,0
34,79 €

-100%
Sammeln Sie Punkte in unserem Gutscheinprogramm und kaufen Sie E-Books und Hörbücher mit bis zu 100% Rabatt.

Mehr erfahren.
Beschreibung

The book is based on the author`s experience in leading and transforming large test engagements and architecting solutions for customer testing requirements/bids/problem areas. It targets the testing practitioner population and provides them with a single go-to place to find perspectives, practices, trends, tools, and solutions to test applications as they face the evolving digital world.

This book is divided into five parts where each part explores different aspects of testing in the real world. The first module explains the various testing engagement models. You will then learn how to efficiently test code in different life cycles. The book discusses the different aspects of Quality Analysis consideration while testing social media, mobile, analytics, and the Cloud. In the last module, you will learn about futuristic technologies to test software.

By the end of the book, you will understand the latest business and IT trends in digital transformation and learn the best practices to adopt for business assurance.

Das E-Book können Sie in Legimi-Apps oder einer beliebigen App lesen, die das folgende Format unterstützen:

EPUB
MOBI

Seitenzahl: 354

Veröffentlichungsjahr: 2017

Bewertungen
0,0
0
0
0
0
0
Mehr Informationen
Mehr Informationen
Legimi prüft nicht, ob Rezensionen von Nutzern stammen, die den betreffenden Titel tatsächlich gekauft oder gelesen/gehört haben. Wir entfernen aber gefälschte Rezensionen.



Table of Contents

Testing Practitioner Handbook
Credits
About the Author
Acknowledgement
About the Reviewer
www.PacktPub.com
eBooks, discount offers, and more
Why subscribe?
Customer Feedback
Preface
What this book covers
What you need for this book
Who this book is for
Conventions
Reader feedback
Customer support
Errata
Piracy
Questions
1. State of Digital Transformation – What Has Changed in the Last Four Years (2013-16)?
Renewed focus on efficiency and effectiveness
QA and testing transformation focus
QA and testing transformation drivers
State of digital maturity
Spends for digital QA
Predictions on the level of cloud-based applications
Increased challenges in mobile and IoT multichannel testing
Reduction in customer experience testing challenges
Conclusion
2. Future of Testing Engagement Models – Are Predictions of Increased QA Spends Justified?
How is QA effort spread
Split of QA effort between development and production support
Increased QA efforts for new development – point of view
Increase of QA effort in the design phase
Increased QA effort in the design phase – point of view
QA organizations would follow hybrid QA teams (centralized and decentralized)
Trend towards Hybrid QA teams – point of view
What will be the future of testing engagement models?
Future of testing engagement models – point of view
Conclusion
References
3. The Benefits of Replacing Testing Subcontractors with Managed Testing Services
Findings from the World Quality Report 2016 on industrialization and testing centers of excellence
Use of direct subcontractors remains prevalent
Key challenges associated while working with subcontractors
How replacing testing subcontractors with managed testing services helps
Knowledge retention
Handover
Cost of resourcing
Economies of scale
Illustration of benefits
A saving calculator
Conclusion
4. Digital Quality Assurance in a Factory Model
Services factories
A digital factory model for industrializing digital QA delivery
Key Elements for Onboarding in DQAF
DQAF enablement functions
DQAF service delivery functions
Benefits delivered through DQAF model
Conclusion
5. Crowdsourcing – Enabling Flexible, On-Demand Testing COEs
Trends - crowdsourced testing
What is crowdtesting and how does it work?
Crowdtesting operating models
Crowdtesting as part of Testing Center of Excellence (TCOE)
Key challenges of adopting crowdtesting
The benefits of crowdtesting
Conclusion
References
6. Testing Goes an Extra Mile over Weekends
Weekend testing – modus operandi
Advantages
Disadvantages
Trends in the use of crowdsourced testing
How can large IT organizations ride the weekend testing bandwagon?
Conclusion
References
7. Testing in Agile Development and the State of Agile Adoption
What do agile projects promise compared to traditional waterfall?
Flavors of agile
Scrum
Kanban
How is testing done in agile sprints?
Agile in distributed environments
State of agile adoption – findings from the World Quality Report 2016-2017
Challenges in applying agile methodology
Approaches to testing in agile development environments
Skills needed from QA and testing professions for agile
Conclusion
8. Agile and DevOps Adoption are Gaining Momentum
Increased use of agile/DevOps principles
Increased complexity of testing in the agile landscape
Challenges cited in setting up agile test COEs
How is QA transforming to meet the demands of agile/DevOps life cycles
What is the difference between testing in DevOps and traditional life cycle?
Conclusion
9. Does the Rise of DevOps Undermine Agile?
Agile is about speed
DevOps removes the boundaries between dev, QA, and operations
Agile versus DevOps
Conclusion
10. Role of Automation in DevOps Life Cycle
The importance of automation in DevOps
Early integration automation
Automation – the default practice
Deployment automation
Automation – metrics and measurements
Automation coverage
Automation index
Framework and scripts reusability
Automation scripting and execution productivity
Automation ROI
Automation progress tracking
Best practices to adopt early and continuously automate
Treating automation as any other development work
Quality engineering
Coupling of development, automation, and test teams
Selecting the right solution
Conclusion
11. Assessing the State of Your DevOps Adoption with DevOps Benchmarking Approach
Why DevOps – the drivers
Challenges organizations face in implementing DevOps
DevOps QA benchmarking — why and what?
DevOps QA benchmarking assessment areas
Outcome of DevOps QA benchmarking assessment
Conclusion
12. Accelerating DevOps – ChatOps is the New Cool
DevOps trends from World Quality Report
ChatOps – How does it work?
Application of ChatOps as a collaboration platform
Benefits of ChatOps
Conclusion
13. Behavior-Driven Development (BDD) Using Gherkin in Agile/DevOps Environment
Background – Behavior-Driven Development (BDD)
Gherkin – basic syntax and illustration
Roles of members involved
Benefits of using Gherkin
Conclusion
14. Automating Configuration Management for DevOps Test Environments
Background
Types of test environments
Configuration and environment management services on cloud and related challenges
Potential solutions for automated configuration management
The benefits of automating configuration management
Conclusion
15. Automated Test Data Management in the DevOps Environment
Background
TDM in DevOps environment – key challenges
Automated TDM solution for DevOps environment
Typical TDM services and TDM architecture
Benefits of automated TDM
Best practices in TDM
Conclusion
16. Testing in DevOps Life Cycle Using Microservices Architecture
What is microservices architecture?
Testing in agile/DevOps life cycle using Microservices Architecture
Performance testing of Microservices
Monitoring Microservices
Conclusion
17. Automated Test Environments for DevOps
Test Environment Management – key challenges
Test environment automation approach for DevOps
Benefits of test environment automation
Test environment metrics to consider in release management
Test environment automation tools
Conclusion
18. Service Virtualization as an Enabler of DevOps
Service virtualization and DevOps
Role of service virtualization in DevOps
Service virtualization – research input
Service virtualization automation tools used in DevOps
Conclusion
19. Best Practices in Identifying Regression Test Cases
Background – software regression testing
Software regression process
How should one choose test cases for regression?
Conclusion
20. Accessibility Test Automation in DevOps Environment
Background – Accessibility (AX)
AX and DevOps
AX test automation in DevOps
Standard AX tools
Conclusion
21. Performance Tuning of Java Applications
Performance bottlenecks – key challenges and solutions
Reusing objects
Managing pool of objects
Canonicalizing objects
Enumerating constants
Comparison versus identity
Avoiding excess garbage collection
Delayed initialization
Java performance tuning tools
NetBean profiler for analyzing Java applications
Thread state
CPU Performance
Memory Usage
Conclusion
22. Testing Mobile Applications – Key Challenges and Considerations
User expectations
Key challenges encountered in testing mobile applications
User experience
Contextual appropriateness
Varied mobile user interfaces
Device diversity and availability
Device based testing approach
Automated testing of layouts
Test automation challenges with non-standardized tools
Reduced time to market
Recommendations to enhance mobile applications usability
Conclusion
23. Testing Analytics Applications – What Has Changed in SMAC World
Understanding your customers, gathering data and analyzing it
Testing the data
Testing the BI/BA applications
How is testing done differently for big data/Hadoop applications?
Conclusion
24. Migrating Applications to Cloud Environments – Key Testing Considerations
Need for validating applications for cloud migration
Key testing focus areas in cloud migration of applications
Key challenges in validation during cloud migration of applications
Application migration validation – a holistic approach
Conclusion
25. How Should a Tester Adapt to Cloud – Call for Change of Mindset among Testers
What must testers prepare for when testing applications on cloud
Testing the invisible
Understanding the distance
Breaking the communication barriers
Securing the application
Replicating the platform
Using the right tools
Conclusion
26. On-Demand Performance Testing on Self-Service Environments
On-demand performance testing environments — key challenges and solutions
Need for a cloud platform to build end-to-end performance testing
On-demand self-service environments for carrying out performance testing
Key scenarios for on-demand performance testing – proposed architecture
Scenario-1 — Architecture and how performance testing is carried out
Scenario-2 — Architecture and how performance testing is carried out
Conclusion
27. Quality Assurance for Digital Marketing Initiatives
Evolution of digital marketing
Challenges of implementing digital marketing
Need for quality focus in digital marketing initiatives
QA of digital marketing applications – key validations
Conclusion
28. Security Dashboard for the Board
Why security threats need to be monitored and reported?
What should be monitored and reported?
Application security/vulnerability management
Specific metrics to be reported in dashboard
Consequences of security lapses
Key challenges in implementing a dashboard
Conclusion
29. Applying Robotic Automation to Mobile Applications Testing
Software robot and their applicability
The benefits of Robotic Process Automation (RPA)
Implementing RPA for mobile testing
Conclusion
References
30. Key Considerations in Testing Internet of Things (IoT) Applications
Need for a robust IoT test strategy
IoT Revolution – key findings from the World Quality Report 2016
IoT Testing Considerations
IoT testing types
Conclusion
References
31. Algorithmic Business – In Need of Model-Based Testing
Introduction and journey of analytics
Algorithmic business – an illustration
Implications of testing – the need for model-based testing
Conclusion
32. Making Testing Adaptive, Interactive, Iterative, and Contextual with Cognitive Intelligence
Background – cognitive intelligence
What is cognitive testing all about?
Evolution of cognitive technology and available platforms
Methodologies involved in cognitive testing
Advantages of cognitive testing compared to the current methods
Sector specific use cases
Technologies supported
Costs involved
Challenges associated in implementing cognitive technologies
Conclusion
33. FinTech – A New Disruptor in Industry and Implications for Testing and QA
FinTech ecosystem
FinTech services and their impact on various sectors
Testing for FinTech applications or solutions
Conclusion
34. Blockchain Technology – Assuring Secure Business
Introduction to blockchain
The blockchain process
Popular blockchains
Implication for testing
Conclusion
35. Technologies for Digital Supply Chains and QA Considerations
Understanding the customer buying process
Industry trends in supply chain management
New technologies in supply chain management
An illustration – new technologies in retail
Focus of QA in supply chain
Conclusion
36. Potential Innovations in eHealth-Care – Implications for Testing and QA
Digital transformation trends in the healthcare sector
Applications of digital eHealth-Care care
Digital eHealth-Care care ecosystem
Typical challenges in digital eHealth-Care care
Need for robust digital QA
An illustrative customer journey validation of patient using wearables
Conclusion
37. Trends in the Global Automotive Sector – Implications for Testing and QA
Business drivers for global automotive evolution
Key highlights from the growing Chinese automotive market
Influence of global automotive trends on the Chinese market
How are trends in automotive segments shaping software testing?
Conclusion
38. Digital Transformation in Consumer Products and Retail Sector – QA Considerations
Current challenges in the consumer products and retail sector
Physical versus online stores – key trends
Brick-and-mortar – physical stores
Online stores
Digital transformation in CPR industry
Customer journey of a digital shopper in an omni-channel environment – an illustration
Being digital – what value levers can it offer to CPR industry
Factors considered by digital shoppers
Multi/omni-channel CPR – quality considerations
Inventory visibility
Web-ready products
Predictive customer analysis
Fulfillment strategy
Digital transformation in CPR - tests required
Conclusion
39. Digital Transformation Trends in Energy and Utilities – QA Considerations
Technology trends in utilities industry
Key technology blocks of digital transformation in the EUC sector
Challenge of multichannel and the need for a unified customer journey
Testing considerations in an EUC customer journey – an illustration
Testing considerations in smart metering infrastructure – an illustration
Digital transformation QA trends in EUC
Conclusion
References
40. Smart Energy and Smart Grids – in Need of Effective Testing
Background
Trends in Energy and Utilities (E&U)
E&U Trends – References from WQR 2016
Typical challenges in the E&U segment
Smart Meters and Smart Grids
Testing process for Smart Metering Infrastructure (SMI)
Conclusion
41. Testing Airline Digital Applications – Case for Responsive Design
Background – the state of the airline business
Role of digitization
QA and testing in the airline industry
Testing business rules implementation
Systems integration testing
Non-functional testing
Testing responsive web designs
Conclusion
42. Orthogonal Array Testing (OAT) – an Application in Healthcare Industry
Background
Challenges in H&LS applications testing
How can Orthogonal Array Testing Strategy (OATS) help?
Conclusion
43. Future of Consulting in the Era of Digital Disruption
Digital driving a shift in the way consulting worked
The digital age consultant
Future of consulting
What would I do differently as a consultant now?
Engage with my clients more through the life cycle
Don't drop a bomb of travel costs
Solving the consultant utilization problem with Crowd-Source
Flexible operating model of consulting firms
Conclusion
44. Future of Testing in the Digital World
Key technology trends that would shape the future of Information Technology
Pervasive technologies and predictive analytics for customer experience
Cognitive Intelligence in Connected Autonomous Vehicle (CAV)
Multi-channel customer connect – wearable technology
Disintermediation – business platform to connect new partners
Changing workplaces of future – Robotic Process Automation (RPA)
Testing considerations for new technologies
Pervasive technologies and predictive analytics
Cognitive intelligence – Connected Autonomous Vehicle (CAV)
Multi-channel customer connect – wearable technology
Disintermediation – business platform
Changing workplaces of the future – robotic process automation
Conclusion
45. Future of Testing – Career Opportunities
Career options in testing services
Typical roles in testing services
The importance of industry and domain, technology and tools, and process skills in testing careers
Required skills for agile and DevOps testing
New breed of testers in DevOps
Conclusion
46. Robotics and Machine Learning Combined with Internet of Things – What Could This Mean for Indian Services Industries
Understanding the context – robotics, machine learning, and IoT
What does advancement of technology mean for the Indian economy?
Learning from the global oil price crash
Learning from the economic slowdown of China–what caused the slowdown in China?
Outlook for the the services sector in India – a point of view
Conclusion
A. References
Across Chapters – World Quality Report 2016 (Capgemini, Sogeti, HPE):
Chapter 2 – Future of Testing Engagement Models – Are Predictions of increased QA Spends Justified?
Chapter 3 – The Benefits of Replacing Testing Subcontractors with Managed Testing Services
Chapter 18 – Service Virtualization as an Enabler of DevOps
Chapter 30 – Key Considerations in Testing Internet of Things (IOT) Applications
Chapter 31 – Algorithmic Business – In Need of Model-Based Testing
Chapter 46 – Robotics and Machine Learning Combined with Internet of Things – What could this mean for Indian Services Industries
Index

Testing Practitioner Handbook

Testing Practitioner Handbook

Copyright © 2017 Packt Publishing

All rights reserved. No part of this book may be reproduced, stored in a retrieval system, or transmitted in any form or by any means, without the prior written permission of the publisher, except in the case of brief quotations embedded in critical articles or reviews.

Every effort has been made in the preparation of this book to ensure the accuracy of the information presented. However, the information contained in this book is sold without warranty, either express or implied. Neither the author, nor Packt Publishing, and its dealers and distributors will be held liable for any damages caused or alleged to be caused directly or indirectly by this book.

Packt Publishing has endeavored to provide trademark information about all of the companies and products mentioned in this book by the appropriate use of capitals. However, Packt Publishing cannot guarantee the accuracy of this information.

First published: March 2017

Production reference: 1170317

Published by Packt Publishing Ltd.

Livery Place

35 Livery Street

Birmingham B3 2PB, UK.

ISBN 978-1-78829-954-1

www.packtpub.com

Credits

Author

Renu Rajani

Reviewer

Jorge Armin Garcia Lopez

Commissioning Editor

Ashwin Nair

Acquisition Editor

Denim Pinto

Content Development Editor

Anurag Ghogre

Technical Editor

Rutuja Vaze

Copy Editor

Shaila Kusanale

Proofreader

Safis Editing

Indexer

Tejal Daruwale Soni

Graphics

Abhinash Sahu

Production Coordinator

Deepika Naik

About the Author

Renu Rajani is a seasoned IT services/consulting leader with 27 years of experience. She has worked with reputed tier-1 IT services companies. Renu's experience spans across delivery, transformation, providing technical solutions, outsourcing governance, and consulting.

She has served Tier-1 organizations including IBM, Citi, Capgemini, KPMG Consulting in key leadership roles.

Renu is an active blogger on digital quality assurance, technology, and managed services and has a follower base of over 15K on social media. She has been a key contributor to Capgemini/Sogeti/HPE World Quality Report during 2015-17. She has led the creation of go-to-market offerings in the area of digital, DevOps, and business assurance.

Renu has been recipient of the Testing Thought Leadership award in 2008 by PureTesting and Testing Leader of the year award by Unicom in 2015.

This book brings together some of her popular blogs on latest technologies and QA considerations in a book form. Renu authored her first book on software testing in 2003 with McGrawHill.

Renu holds an MS from the Krannert Graduate School of Management, Purdue University USA, an MBA in Finance from DAVV Indore, and a B Tech in Computer Science from IET, Lucknow University. She is an IBM Sr PM certified with DPE/SM discipline, and holds the ITIL V3, CAIIB, and PMP Certifications.

Acknowledgement

I would like to thank my family for putting up with my blogging/social media activities that I have been deeply entrenched into and have led to this book. I would like to thank several colleagues who have contributed to the authoring of my blogs. A list of contributors for the supporting content of respective chapters is provided in the following table:

Contributors Name

Chapter Number

Vamsi Venkata Ch

39

Sripriya CP

6, 45

Ranganath Gomatham

16, 17, 18, 19, 20, 36

Manish Goyal

7,8, 10, 14, 32

Sabyasachi Guharay

30, 44

Sunil Hs

15

Vaishali Jayade

27

Varun Khanna

38, 45

Sharad Kumar

24

Pulkit Mathur

12, 31, 33, 34, 35

Jyotirmay Mishra

15

Sumanth Murthy

22

Manojkumar Nagaraj

4, 26, 29, 37, 42

Vidya Prasanna

9

Vishal Rai

29

Rohit Sharan

2, 5

Prashanth SP

13

Shyam Sridhar

3

Palaniappan Subramanian

38

Mukund Thaker

39,40

Rajesh Thakker

41

Ashish Velankar

25

Bhaskar Venkataraman

21, 26

About the Reviewer

Jorge Armin Garcia Lopez is a very passionate Information Security Consultant from Mexico with more than 8 years of experience in computer security, penetration testing, intrusion detection/prevention, malware analysis, and incident response. He is the head of GCS-CERT. He is also a security researcher at Cipher Storm Ltd Group and is the cofounder and CEO of the most important security conference in Mexico, called BUGCON. He holds important security industry certifications, such as OSCP, GCIA, and GPEN. He loves to review code and books about information security and programming languages. He has worked on Penetration Testing with Blackbox, Penetration Testing with the Bash Shell, Learning OpenStack Networking (Neutron), Django Essentials, and Getting Started with Djando all by Packt.

www.PacktPub.com

eBooks, discount offers, and more

Did you know that Packt offers eBook versions of every book published, with PDF and ePub files available? You can upgrade to the eBook version at www.PacktPub.com and as a print book customer, you are entitled to a discount on the eBook copy. Get in touch with us at <[email protected]> for more details.

At www.PacktPub.com, you can also read a collection of free technical articles, sign up for a range of free newsletters and receive exclusive discounts and offers on Packt books and eBooks.

https://www.packtpub.com/mapt

Get the most in-demand software skills with Mapt. Mapt gives you full access to all Packt books and video courses, as well as industry-leading tools to help you plan your personal development and advance your career.

Why subscribe?

Fully searchable across every book published by PacktCopy and paste, print, and bookmark contentOn demand and accessible via a web browser

Customer Feedback

Thanks for purchasing this Packt book. At Packt, quality is at the heart of our editorial process.

If you'd like to join our team of regular reviewers, you can e-mail us at <[email protected]>. We award our regular reviewers with free eBooks and videos in exchange for their valuable feedback. Help us be relentless in improving our products!

Preface

The book is based on my experience of leading and transforming large test engagements and architecting solutions for customer testing requirements, bids, or problem areas. I have been actively blogging in the area of Managed Testing Services, various emerging technologies in the digital world, and how these impact the way quality assurance is carried out.

My continued blogging activity over the last two years, and the inputs and encouragement from my follower base have encouraged me to author this Quality Assurance (QA) practitioners handbook. With each blogpost, I provided a point of view on emerging areas before others.

This book would help QA and other IT professionals keep abreast of industry and technology changes and better adapt to digital transformation. This book would be a valuable source to find points of view, practices, trends, tools, and solutions for QA professionals involved in new-age testing.

What this book covers

Chapter 1, State of Digital Transformation – What Has Changed in the Last Four Years (2013-16)? to Chapter 5, Crowdsourcing – Enabling Flexible, On-Demand Testing COEs: We start with trends in digital transformation in Chapter 1, State of Digital Transformation – What Has Changed in the Last Four Years (2013-16)?. Through Chapter 2, Future of Testing Engagement Models – Are Predictions of Increased QA Spends Justified?, to Chapter 5, Crowdsourcing – Enabling Flexible, On-Demand Testing COEs, we cover the evolution of testing engagement and operating models such as Managed Services, Testing Center of Excellence (TCOE), Digital Factory QA Model, crowd sourcing, weekend testing, and various value levers available through emerging QA engagement operating models.

Chapter 6, Testing Goes an Extra Mile over Weekends, to Chapter 20, Accessibility Test Automation in DevOps Environment, cover testing and automation in Agile/DevOps engagements, covering functional and non-functional (performance, TDM, Test Environment Management, virtualization, and so on) areas. The following are covered in these chapters:

Testing in Agile/DevOps engagements, Trends in agile adoption, (Chapters 6, Testing Goes an Extra Mile over Weekends to Chapter 8, Agile and DevOps Adoption are Gaining Momentum).We will cover how agile and DevOps complement each other in Chapter 9, Does the Rise of DevOps Undermine Agile?We discuss the role of automation in DevOps life cycle, present a framework, and analyze the spending in QA as against design, development, and production support. We will cover how agile and DevOps complement each other in Chapter 10, Role of Automation in DevOps Life Cycle, we present a method to assess the state of DevOps adoption through a baselining and benchmarking approachChapter 11, Assessing State of Your DevOps Adoption with DevOps Benchmarking Approach, we present a method to assess the state of DevOps adoption through a baselining and benchmarking approach.Chapter 12, Accelerating DevOps – ChatOps Is the New Cool covers Chat-Ops, an emerging technique to collaborate/communicate in the DevOps environmentChapter 13, Behavior-Driven Development (BDD) Using Gherkin in Agile/DevOps Environment covers Behavior-Driven Development (BDD), a tool (for example, Gherkin) to script in an English-like language, and the basic features of GherkinChapter 14, Automating Configuration Management for DevOps Test Environments covers automating in DevOps life cycle, for example, automating configuration managementChapter 15, Automated Test Data Management in the DevOps Environment covers microservice architectureChapter 16, Testing in DevOps Life Cycle Using Microservices Architecture covers test environmentsChapter 17, Automated Test Environments for DevOps covers automating in DevOps life cycle, for example, automating configuration managementIn Chapter 18, Service Virtualization as an Enabler of DevOps, we cover service virtualization as an enabler of DevOpsChapter 19, Best Practices in Identifying Regression Test Cases covers guidelines and best practices in identifying regression test casesChapter 19, Accessibility Test Automation in DevOps Environment covers automating accessibility testsChapter 20, Accessibility Test Automation in DevOps Environment covers test automation in DevOps enviornment

Chapter 21, Performance Tuning of Java Applications to Chapter 34, Blockchain Technology – Assuring Secure Business cover the trends in social media, mobility, analytics, and cloud (SMAC) applications, and the QA considerations for these. The key trends and QA considerations pertain to the following:

Chapter 21, Performance Tuning of Java Applications discusses the need for performance tuning in digital applications and covers tuning using Java utilities for Java applicationsChapter 22, Testing Mobile Applications – Key Challenges and Considerations covers mobile applicationsChapter 23, Testing Analytics Applications – What Has Changed in SMAC World covers analytics applicationsChapter 24, Migrating Applications to Cloud Environments – Key Testing Considerations covers covers migration to the cloudChapter 25, How Should a Tester Adapt to Cloud – Call for Change of Mindset among Testers calls for a change of mindset, which is needed for testing applications in the cloud, and the need to understand and prepare for the distance, break communication barriers, application security, platform replication, and the use of appropriate toolsChapter 26, On-Demand Performance Testing on Self-Service Environments presents performance testing as a service framework with built-in tools, data management, and environments in the cloud for cloud and enterprise applicationsChapter 27, Quality Assurance for Digital Marketing Initiatives presents digital marketing as one of the emerging applications in the digital revolution and QA considerations for the readiness of content, media, and messaging involved in digital marketing applicationsChapter 28, Security Dashboard for the Board emphasizes the importance of securing IT in a digital world and board-level attention being placed on the topic. A security dashboard for the board is presented

Chapter 29, Applying Robotic Automation to Mobile Applications Testing to Chapter 35, Technologies for Digital Supply Chains and QA Considerations cover futuristic technologies, IoT, machine learning, cognitive applied to the business, and how the QA discipline is preparing to test for these technologies and apply these in testing:

Chapter 29, Applying Robotic Automation to Mobile Applications Testing covers the application of robotics technologies to test mobile applicationsChapter 30, Key Considerations in Testing Internet of Things (IoT) Applications covers covers the key considerations in testing IoT applicationsChapter 31, Algorithmic Business – In Need of Model-Based Testing discusses businesses being driven by algorithms and introduces Algorithmic Business and how Model-based Testing is leveraged in these businessesChapter 32, Making Testing Adaptive, Interactive, Iterative, and Contextual with Cognitive Intelligence covers applying cognitive intelligence to testing in order to carry out testing in an adaptive, interactive, iterative, and contextual mannerChapter 33, FinTech – A New Disruptor in Industry and Implications for Testing and QA presents FinTech as a disrupter in the Financial Services industry and the QA considerations for thisChapter 34, Blockchain Technology – Assuring Secure Business presents Blockchains to assure a secured business and the QA considerationsChapter 35, Technologies for Digital Supply Chains and QA Considerations presents the upcoming technologies in the supply chain domain (connected autonomous vehicles, drones, AR/VR, 3D printing), and the QA considerations

Chapter 36, Potential Innovations in eHealth-Care – Implications for Testing and QA to Chapter 41, Testing Airline Digital Applications – Case for Responsive Design covers specific domains—how digital transformation is impacting these domains, specific business challenges, QA challenges, and a way to address them. Specific industries/domains covered include e-healthcare:

Chapter 36, Potential Innovations in eHealth-Care – Implications for Testing and QA covers testing and QA implicationsChapter 37, Trends in the Global Automotive Sector – Implications for Testing and QA, covers consumer products and retailChapter 38, Digital Transformation in Consumer Products and Retail Sector – QA Considerations covers Energy and UtilitiesChapter 39, Digital Transformation Trends in Energy and Utilities – QA Considerations covers Smart Meters and Smart GridsChapter 40, Smart Energy and Smart Grids – In Need of Effective Testing covers AirlinesChapter 41, Testing Airline Digital Applications – Case for Responsive Design covers testing airline digital applications.

Chapter 42, Orthogonal Array Testing (OAT) – an Application in Healthcare Industry to Chapter 46, Robotics and Machine Learning Combined with Internet of Things – What Could This Mean for Indian Services Industries conclude the book with four chapters on the impact of digital transformation, robotics, machine learning, IoT, and other emerging technologies presented in this book on IT, consulting, and testing:

Chapter 42, Orthogonal Array Testing (OAT) – an Application in Healthcare Industry we will discuss challenges facing the H&LS industry, the need for robust testing, and use of the Orthogonal Array Testing (OAT) technique to optimize testing, and use of the OAT toolChapter 43, Future of Consulting in the Era of Digital Disruption covers the future of the consulting industryChapter 44, Future of Testing in the Digital World covers the future of testingChapter 45, Future of Testing – Career Opportunities covers the future of testing careers in the face of a digital transformationChapter 46, Robotics and Machine Learning Combined with Internet of Things – What Could This Mean for Indian Services Industries concludes with a point of view on what robotics and machine learning, combined with IoT, have in store for the future of the services industry

What you need for this book

There are no supplementary aids in addition to this book.

Who this book is for

This book is meant for practicing population in QA and testing area, but other professionals in IT services and businesses would equally benefit. It covers the latest trends and practices that testing and QA professionals should keep abreast of, given the advancements in digital technologies. The book does not contain the basics of testing that a QA professional practices in daily life, for example, how to write a test plan or test case, and so on.

Reader feedback

Feedback from our readers is always welcome. Let us know what you think about this book—what you liked or disliked. Reader feedback is important for us as it helps us develop titles that you will really get the most out of.

To send us general feedback, simply e-mail <[email protected]>, and mention the book's title in the subject of your message.

If there is a topic that you have expertise in and you are interested in either writing or contributing to a book, see our author guide at www.packtpub.com/authors.

Customer support

Now that you are the proud owner of a Packt book, we have a number of things to help you to get the most from your purchase.

Errata

Although we have taken every care to ensure the accuracy of our content, mistakes do happen. If you find a mistake in one of our books—maybe a mistake in the text or the code—we would be grateful if you could report this to us. By doing so, you can save other readers from frustration and help us improve subsequent versions of this book. If you find any errata, please report them by visiting http://www.packtpub.com/submit-errata, selecting your book, clicking on the Errata Submission Form link, and entering the details of your errata. Once your errata are verified, your submission will be accepted and the errata will be uploaded to our website or added to any list of existing errata under the Errata section of that title.

To view the previously submitted errata, go to https://www.packtpub.com/books/content/support and enter the name of the book in the search field. The required information will appear under the Errata section.

Piracy

Piracy of copyrighted material on the Internet is an ongoing problem across all media. At Packt, we take the protection of our copyright and licenses very seriously. If you come across any illegal copies of our works in any form on the Internet, please provide us with the location address or website name immediately so that we can pursue a remedy.

Please contact us at <[email protected]> with a link to the suspected pirated material.

We appreciate your help in protecting our authors and our ability to bring you valuable content.

Questions

If you have a problem with any aspect of this book, you can contact us at <[email protected]>, and we will do our best to address the problem.

Chapter 1. State of Digital Transformation – What Has Changed in the Last Four Years (2013-16)?

The year 2015 was the first time significant trends in digital transformation were spotted in the World Quality Report (WQR). The upward trend continued in 2016 with the growing adoption of digital. In this chapter, we have will discuss the specific changes we witnessed in the last 4 years in QA transformation. Some of the trends I have observed are discussed further on.

Renewed focus on efficiency and effectiveness

In the last 4 years, the focus of QA transformation has evolved from centralizing QA to focus on the increased use of Social Media, Mobility, Analytics and Cloud (SMAC) and digital initiatives to improved customer experience.

In 2015, security and protecting corporate image were cited as the key IT objectives in line with an organization's desire to secure their digital presence and reduce the damage to their corporate reputation.

In 2016, the key strategic IT drivers included security, customer experience, and corporate image. Additionally, there was renewed focus on efficiency and effectiveness as important QA and testing objectives.

QA and testing transformation focus

The focus of the QA transformation agenda has undergone a shift over the last few years from focus on centralizing QA to addressing vulnerabilities in digital business, to increased QA spends, to increased customer, and user experience combined with security and a renewed focus on efficiency. Refer to the following table:

2013

2014

2015

2016

Centralizing and streamlining testing functions indicating continuing maturing of the QA function.

Digital business transformation programs using SMAC technologies and Internet of Things (IoT) changed the focus and importance of QA and testing.Focus on addressing vulnerabilities—network performance, security, and cloud service availability.
Organizations that are more mature and advanced in digital transformation spend the most in QA and testing and have established a direct connection between quality and achieving business outcomes.Focus of testing on usability, customer experience, and performance.
The strategic IT drivers include security, customer experience, and corporate image.In addition, there is a renewed focus on efficiency and effectiveness.

QA and testing transformation drivers

The key driver for QA and testing transformation has changed from cost optimization in 2013 to the need for instant access to information in 2014, to focusing on customer value and end user experience in 2015. Customer experience has stayed the focus in 2016 as well:

2013

2014

2015

2016

Cost optimization

People's need for instant connectivity and access to information

Focus on customer value and the impact of IT quality on end user experience

Protect corporate image and enhance customer experience

State of digital maturity

We define digital maturity based on whether an organization has appointed or is in the process of appointing a Chief Digital Officer (CDO). The year 2016 has seen the automotive (76% respondents mention having a CDO or in the process of appointing one) and public sectors (73%) at the top of the leaderboard in digital maturity based on this criteria. These sectors had been laggards in 2015. Increased adoption of digital for citizen services and inclusion justifies the top rank for the public sector.

Spends for digital QA

About 63% of the QA budget (versus 53% in 2015) is used in QA for new developments in mobile, cloud, Business Intelligence (BI)/Business Analytics (BA), and IoT areas.

There is less correlation between digital maturity and QA spend in 2016. Organizations with the absence of a digital strategy seem to have a higher QA spend than the ones with digital maturity. Why do organizations with digital strategy have lower QA spend? It is likely that in a hurry to move ahead in digital transformation, organizations have progressed in development with inadequate QA.

Predictions on the level of cloud-based applications

Cloud-based applications are set to increase over the next 3 years. There has been an overall drop in the use of the public, private, and hybrid cloud. However, the use of on premise cloud has seen a significant increase.

A surprise finding is that despite the data privacy concerns, the use of public and hybrid cloud has increased in Europe.

Also, the findings suggest that focus on functional validation while migrating to the cloud was ignored and only performance testing was considered adequate. This again suggests that in a hurry to progress in digital transformation, organizations have ignored quality.

Increased challenges in mobile and IoT multichannel testing

In 2016, the WQR findings suggest increased challenges in mobile, IoT, and multichannel testing in all the categories:

The challenge areas probed are as follows:

Lack of right testing process or methodLack of expertsLack of an in-house test environmentLack of the right toolsInadequate time spentLack of device availability to test

It is difficult to accept that there can be increased challenges given that digital has matured since 2015. The possible reasons for increased challenges could be the sheer size and complexity of digital transformation.

Reduction in customer experience testing challenges

In 2016, there was a decline cited for all the challenge areas relating to customer experience testing, namely, the following ones:

Designing the test casesImplementing test toolsEstablishing test dataIdentifying end user expectationsEstablishing environmentsGetting the right coverageIdentifying the systemsApps to be covered

Refer to the following graph:

Conclusion

Is QA transformation dependent on the existence of a central Testing Center of Excellence (TCOE)? With increased use of SMAC technologies, organizations started abandoning centralized TCOE model in 2015 in pursuit of agile delivery models and focused on customer experience and business assurance.

Do we conclude that we witness that quality is ignored in digital transformation initiatives? Otherwise, do we conclude that quality is so embedded in digital transformations that there is a less specific need for quality? Given the evidence of increased challenges cited in 2016 in mobile, IoT, and multichannel applications, we will say there indeed is a decline in quality. The organizations will soon realize the need for focus on quality or pay the price.

For an in-depth look at the key trends in testing and QA, download the World Quality Report 2016 from http://ow.ly/PvMd304ynId.

Chapter 2. Future of Testing Engagement Models – Are Predictions of Increased QA Spends Justified?

In this chapter, we will discuss the future of testing engagement models in light of current developments in digital space and increased adoption of Agile/DevOps models.

Would Dev-Ops shrink the amount of testing that is done in current world? If so, what would be the impact? As per WQR2016 findings, testing spend would increase up to 40% by organizations. How does this increased spend prediction align to the fact that more engagements would follow decentralized QA in Agile/DevOps life cycle?

How is QA effort spread

Let's discuss the following topics:

How QA effort is split between development and production supportReasons for increase of QA effort in the design phase

Split of QA effort between development and production support

Share of QA spend in new development projects (as against enhancements/maintenance projects) has grown from 2012-13 to 2013-14 to 2014-15, from 41% to 46% to 52% respectively.

In 2015-16, the QA spend was split 50:50 between new development and production support.

In 2014-15, for the first time, the QA spend for Development exceeded the QA spend for production support. This is in line with more development projects with organizations undertaking more digital transformation related development work. Refer to the following graph:

Increased QA efforts for new development – point of view

It is evident that when QA is done for new code (as against QA for maintaining/enhancing the existing code), QA effort will be higher.

Organizations are practicing Agile/DevOps to achieve cycle time reduction (faster time to production or achieving time to market objective to gain competitive advantage) and not necessarily with a QA cost reduction objective. If code is released more often and tested in shorter cycles, one will achieve the objective of cycle time, and not necessarily cost reduction.

Continuous integration and continuous deployment are practiced. One can't integrate or deploy less-tested faulty code, so continuous testing means more iterations of testing.

The testers are carrying out executions up until production deployment and in live environment aligning to extreme right. Analysts, such as Forrester and Gartner, recommend not only shift-left to test early in life cycle, but also shift-right to extend tester involvement till deployment.

Increase of QA effort in the design phase

2014-15 WQR report highlighted an increased involvement of QA in high-level design phase to 14% (as against 6% in the previous year).

What is being achieved by QA involvement in the design phase?

Increased QA effort in the design phase – point of view

Shift-left practices are being leveraged to have testers contribute their domain expertise in the design phase.

In line with the trend of continuous testing to support continuous integration and deployment, there is increased automation in silo phases of test design and development (to match the software design phase).

With automated tools supporting test models and test script generation, and their integration with automated test execution, reporting and deployment tools have further pushed the shift left practice to the requirement phase.