Software testing and verification Books

Book SynopsisLisa Crispin is dedicated to helping agile teams and testers discover good ways to deliver the best possible product. She specializes in showing testers and agile teams how testers can add value and how to guide development with business-facing tests. Since 2003, she's been a tester on a Scrum/XP team at ePlan Services, Inc., and frequently leads tutorials and workshops on agile testing at conferences. Lisa regularly contributes articles about agile testing to publications such as Better Software magazine, I EEE Software, and Methods and Tools. Lisa also coauthored Testing Extreme Programming (Addison-Wesley, 2002) with Tip House. Janet Gregory is the founder of DragonFire, Inc., an agile quality process consultancy and training firm. Her passion is helping teams build quality systems. Since 1998, she has worked as a coach and tester introducing agile practices into both large and small companies. Her focus is working with business usTrade Review“As Agile methods have entered the mainstream, we’ve learned a lot about how the testing discipline fits into Agile projects. Lisa and Janet give us a solid look at what to do, and what to avoid, in Agile testing.” –Ron Jeffries, www.XProgramming.com “An excellent introduction to agile and how it affects the software test community!” –Gerard Meszaros, Agile Practice Lead and Chief Test Strategist at Solution Frameworks, Inc., an agile coaching and lean software development consultancy “In sports and music, people know the importance of practicing technique until it becomes a part of the way they do things. This book is about some of the most fundamental techniques in software development–how to build quality into code–techniques that should become second nature to every development team. The book provides both broad and in-depth coverage of how to move testing to the front of the development process, along with a liberal sprinkling of real-life examples that bring the book to life.” –Mary Poppendieck, Author of Lean Software Development and Implementing Lean Software Development “Refreshingly pragmatic. Chock-full of wisdom. Absent of dogma. This book is a gamechanger. Every software professional should read it.” –Uncle Bob Martin, Object Mentor, Inc. “With Agile Testing, Lisa and Janet have used their holistic sensibility of testing to describe a culture shift for testers and teams willing to elevate their test effectiveness. The combination of real-life project experiences and specific techniques provide an excellent way to learn and adapt to continually changing project needs.” –Adam Geras, M.Sc. Developer-Tester, Ideaca Knowledge Services “On Agile projects, everyone seems to ask, ‘But, what about testing?’ Is it the development team’s responsibility entirely, the testing team, or a collaborative effort between developers and testers? Or, ‘How much testing should we automate?’ Lisa and Janet have written a book that finally answers these types of questions and more! Whether you’re a tester, developer, or manager, you’ll learn many great examples and stories from the real-world work experiences they’ve shared in this excellent book.” –Paul Duvall, CTO of Stelligent and co-author of Continuous Integration: Improving Software Quality and Reducing Risk “Finally a book for testers on Agile teams that acknowledges there is not just one right way! Agile Testing provides comprehensive coverage of the issues testers face when they move to Agile: from tools and metrics to roles and process. Illustrated with numerous stories and examples from many contributors, it gives a clear picture of what successful Agile testers are doing today.” –Bret Pettichord, Chief Technical Officer of WatirCraft and Lead Developer of Watir Table of ContentsForeword by Mike Cohn xxiiiForeword by Brian Marick xxvPreface xxviiAcknowledgments xxxviiAbout the Authors xli Part I: Introduction 1Chapter 1: What Is Agile Testing, Anyway? 3 Agile Values 3 What Do We Mean by “Agile Testing”? 4 A Little Context for Roles and Activities on an Agile Team 7 How Is Agile Testing Different? 9 Whole-Team Approach 15 Summary 17 Chapter 2: Ten Principles for Agile Testers 19 What’s an Agile Tester? 19 The Agile Testing Mind-Set 20 Applying Agile Principles and Values 21 Adding Value 31 Summary 33 Part II: Organizational Challenges 35Chapter 3: Cultural Challenges 37 Organizational Culture 37 Barriers to Successful Agile Adoption by Test/QA Teams 44 Introducing Change 49 Management Expectations 52 Change Doesn’t Come Easy 56 Summary 58 Chapter 4: Team Logistics 59 Team Structure 59 Physical Logistics 65 Resources 66 Building a Team 69 Summary 71 Chapter 5: Transitioning Typical Processes 73 Seeking Lightweight Processes 73 Metrics 74 Defect Tracking 79 Test Planning 86 Existing Processes and Models 88 Summary 93 Part III: The Agile Testing Quadrants 95Chapter 6: The Purpose of Testing 97 The Agile Testing Quadrants 97 Knowing When a Story Is Done 104 Managing Technical Debt 106 Testing in Context 106 Summary 108 Chapter 7: Technology-Facing Tests that Support the Team 109 An Agile Testing Foundation 109 Why Write and Execute These Tests? 112 Where Do Technology-Facing Tests Stop? 119 What If the Team Doesn’t Do These Tests? 121 Toolkit 123 Summary 127 Chapter 8: Business-Facing Tests that Support the Team 129 Driving Development with Business-Facing Tests 129 The Requirements Quandary 132 Thin Slices, Small Chunks 144 How Do We Know We’re Done? 146 Tests Mitigate Risk 147 Testability and Automation 149 Summary 150 Chapter 9: Toolkit for Business-Facing Tests that Support the Team 153 Business-Facing Test Tool Strategy 153 Tools to Elicit Examples and Requirements 155 Tools for Automating Tests Based on Examples 164 Strategies for Writing Tests 177 Testability 183 Test Management 186 Summary 186 Chapter 10: Business-Facing Tests that Critique the Product 189 Introduction to Quadrant 3 190 Demonstrations 191 Scenario Testing 192 Exploratory Testing 195 Usability Testing 202 Behind the GUI 204 Testing Documents and Documentation 207 Tools to Assist with Exploratory Testing 210 Summary 214 Chapter 11: Critiquing the Product Using Technology-Facing Tests 217 Introduction to Quadrant 4 217 Who Does It? 220 When Do You Do It? 222 “ility” Testing 223 Performance, Load, Stress, and Scalability Testing 233 Summary 238 Chapter 12: Summary of Testing Quadrants 241 Review of the Testing Quadrants 241 A System Test Example 242 Tests Driving Development 244 Automation 245 Critiquing the Product with Business-Facing Tests 248 Documentation 251 Using the Agile Testing Quadrants 252 Summary 253 Part IV: Automation 255Chapter 13: Why We Want to Automate Tests and What Holds Us Back 257 Why Automate? 258 Barriers to Automation—Things that Get in the Way 264 Can We Overcome These Barriers? 270 Summary 271 Chapter 14: An Agile Test Automation Strategy 273 An Agile Approach to Test Automation 274 What Can We Automate? 279 What Shouldn’t We Automate? 285 What Might Be Hard to Automate? 287 Developing an Automation Strategy—Where Do We Start? 288 Applying Agile Principles to Test Automation 298 Supplying Data for Tests 304 Evaluating Automation Tools 311 Implementing Automation 316 Managing Automated Tests 319 Go Get Started 324 Summary 324 Part V: An Iteration in the Life of a Tester 327Chapter 15: Tester Activities in Release or Theme Planning 329 The Purpose of Release Planning 330 Sizing 332 Prioritizing 338 What’s in Scope? 340 Test Planning 345 Test Plan Alternatives 350 Preparing for Visibility 354 Summary 366 Chapter 16: Hit the Ground Running 369 Be Proactive 369 Advance Clarity 373 Examples 378 Test Strategies 380 Prioritize Defects 381 Resources 381 Summary 382 Chapter 17: Iteration Kickoff 383 Iteration Planning 383 Testable Stories 393 Collaborate with Customers 396 High-Level Tests and Examples 397 Summary 403 Chapter 18: Coding and Testing 405 Driving Development 406 Tests that Critique the Product 412 Collaborate with Programmers 413 Talk to Customers 414 Completing Testing Tasks 415 Dealing with Bugs 416 It’s All about Choices 419 Facilitate Communication 429 Regression Tests 432 Resources 434 Iteration Metrics 435 Summary 440 Chapter 19: Wrap Up the Iteration 443 Iteration Demo 443 Retrospectives 444 Celebrate Successes 449 Summary 451 Chapter 20: Successful Delivery 453 What Makes a Product? 453 Planning Enough Time for Testing 455 The End Game 456 Customer Testing 464 Post-Development Testing Cycles 467 Deliverables 468 Releasing the Product 470 Customer Expectations 475 Summary 476 Part VI: Summary 479Chapter 21: Key Success Factors 481 Success Factor 1: Use the Whole-Team Approach 482 Success Factor 2: Adopt an Agile Testing Mind-Set 482 Success Factor 3: Automate Regression Testing 484 Success Factor 4: Provide and Obtain Feedback 484 Success Factor 5: Build a Foundation of Core Practices 486 Success Factor 6: Collaborate with Customers 489 Success Factor 7: Look at the Big Picture 490 Summary 491 Glossary 493Bibliography 501Index 509

Read more less

Book SynopsisTrade Review“What you hold in your hands is a treasure trove of hard-won knowledge about what works and what doesn’t in test automation. It can save you untold hours and costs by steering you away from paths that lead nowhere and guiding you towards those that lead to success.” –Linda Hayes “From tools to methodology, Dorothy Graham and Mark Fewster weave a compelling set of stories that provide a learning experience in automation. This comprehensive tome is the first of its kind to take the reader deep into the world of automated testing, as depicted by case studies that show the realities of what happened across a multitude of projects spanning a wide variety of industries and technology environments. By identifying similarities and repeated themes, the authors help the reader focus on the essential learning lessons and pitfalls to avoid. Read this book cover to cover for inspiration and a realization of what it takes to ultimately succeed in test automation.” –Andrew L. Pollner, President & CEO of ALP International Corporation “Many years after their best-seller Software Test Automation, Mark Fewster and Dorothy Graham have done it again. Agile methodologies have given test automation a dominant presence in today’s testing practices. This is an excellent, highly practical book with many well-documented case studies from a wide range of perspectives. Highly recommended to all those involved, or thinking about getting involved, in test automation.” – Erik van Veenendaal, Founder of Improve Quality Services and vice-chair of TMMi Foundation “This book is like having a testing conference in your hand, with a wealth of case studies and insights. Except that this book is much cheaper than a conference, and you don’t have to travel for it. What impressed me in particular was that it is all tied together in a concise ‘chapter zero’ that efficiently addresses the various aspects I can think of for automation success. And that is something you will not get in a conference.” –Hans Buwalda “An exciting, well-written, and wide-ranging collection of case studies with valuable realworld experiences, tips, lessons learned, and points to remember from real automation projects. This is a very useful book for anyone who needs the evidence to show managers and colleagues what works–and what does not work–on the automation journey.” –Isabel Evans, FBCS CITP, Quality Manager, Dolphin Computer Access “Experiences of Test Automation first describes the essence of effective automated testing. It proceeds to provide many lifetimes worth of experience in this field, from a wide variety of situations. It will help you use automated testing for the right reasons, in a way that suits your organization and project, while avoiding the various pitfalls. It is of great value to anyone involved in testing–management, testers, and automators alike.” –Martin Gijsen, Independent Test Automation Architect “This offering by Fewster and Graham is a highly significant bridge between test automation theory and reality. Test automation framework design and implementation is an inexact science begging for a reusable set of standards that can only be derived from a growing body of precedence; this book helps to establish such precedence. Much like predecessor court cases are cited to support subsequent legal decisions in a judicial system, the diverse case studies in this book may be used for making contemporary decisions regarding engagement in, support of, and educating others on software test automation framework design and implementation.” –Dion Johnson, Software Test Consultant and Principle Adviser to the Automated Testing Institute (ATI) “Even with my long-established ‘test automation won’t work’ stance, this book did make me pause and ponder. It opened my mind and gave me a few ‘oh, I hadn’t thought of that’ moments. I would recommend this book as an initial reference for any organization wanting to introduce test automation.” –Audrey Leng “This book is a stunning achievement. I believe that it is one of the best books ever written in test automation. Dot and Mark’s approach presenting 28 case studies is a totally new concept including eye-catching tips, good points, and lessons learned. The case studies are coming from life experiences, successes and failures, including several aspects of automation, different environments, and a mixture of solutions. Books are ‘the’ source of wisdom, and what a good idea for using storytelling to increase our learning through triggering our memories. This book is a must for everyone who is thinking of or involved in test automation at all levels. It is truly unique in its kind.” –Mieke GeversTable of ContentsForeword xxix Preface xxxi Reflections on the Case Studies (by Dorothy Graham and Mark Fewster ) 1 A Management Issues 2 B Technical Issues 8 C Conclusion 16 Chapter 1: An Agile Team’s Test Automation Journey: The First Year (by Lisa Crispin) 17 1.1 Background for the Case Study 18 1.2 Whole Team Commitment 19 1.3 Setting Up the Automation Strategy 20 1.4 Applying Acceptance Test-Driven Development (ATDD) to Test behind the GUI Using FitNesse 24 1.5 Use an Incremental Approach 26 1.6 The Right Metrics 27 1.7 Celebrate Successes 28 1.8 Incorporate Engineering Sprints 28 1.9 Team Success 29 1.10 Continuous Improvement 31 1.11 Conclusion 32 Chapter 2: The Ultimate Database Automation (by Henri van de Scheur) 33 2.1 Background for the Case Study 33 2.2 Software under Test 35 2.3 Objectives for Test Automation 36 2.4 Developing Our Inhouse Test Tool 37 2.5 Our Results 40 2.6 Managing Our Automated Tests 40 2.7 Test Suites and Types 41 2.8 Today’s Situation 43 2.9 Pitfalls Encountered and Lessons Learned (the Hard Way) 43 2.10 How We Applied Advice from the Test Automation Book 45 2.11 Conclusion 47 2.12 Acknowledgments 48 Chapter 3: Moving to the Cloud: The Evolution of TiP, Continuous Regression Testing in Production (by Ken Johnston and Felix Deschamps) 49 3.1 Background for the Case Study 50 3.2 Moving Our Testing into the Cloud 52 3.3 How We Implemented TiP 55 3.4 Sample of Monthly Service Review Scorecards 58 3.5 Exchange TiP v2–Migrating TiP to the Windows Azure Cloud 62 3.6 What We Learned 63 3.7 Conclusion 67 3.8 Acknowledgments 67 Chapter 4: The Automator Becomes the Automated (by Bo Roop) 69 4.1 Background for the Case Study: My First Job 69 4.2 My Great Idea . . . 72 4.3 A Breakthrough 74 4.4 Conclusion 80 Chapter 5: Autobiography of an Automator: From Mainframe to Framework Automation (by John Kent) 83 5.1 Background for the Case Study 84 5.2 A Mainframe Green-Screen Automation Project 88 5.3 Difference between Mainframe and Script-Based Tools 89 5.4 Using the New Script-Based Tools 91 5.5 Automating Tests for IBM Maximo 97 5.6 Conclusion 102 5.7 Additional Reading 103 Chapter 6: Project 1: Failure!, Project 2: Success! (by Ane Clausen) 105 6.1 Background for the Case Study 105 6.2 Project 1: Failure! 107 6.3 Project 2: Success! 109 6.4 The Next Time Period: Testing for Real 118 6.5 Conclusion 127 Chapter 7: Automating the Testing of Complex Government Systems (by Elfriede Dustin) 129 7.1 Background for the Case Study 129 7.2 Our Requirements for Automation 131 7.3 Automated Test and Re-Test (ATRT), Our Automated Testing Solution–What Is It? 132 7.4 Automated Testing Solution Applied 140 7.5 Conclusion 142 Chapter 8: Device Simulation Framework (by Alan Page) 143 8.1 Background for the Case Study 143 8.2 The Birth of Device Simulation Framework (DSF) 145 8.3 Building the DSF 146 8.4 Automation Goals 148 8.5 Case Studies 149 8.6 No Silver Bullets 153 8.7 Conclusion 154 8.8 Acknowledgments 154 Chapter 9: Model-Based Test-Case Generation in ESA Projects (by Stefan Mohacsi and Armin Beer) 155 9.1 Background for the Case Study 155 9.2 Model-Based Testing and Test-Case Generation 157 9.3 Our Application: ESA Multi-Mission User Services 161 9.4 Experience and Lessons Learned 168 9.5 Conclusion 173 9.6 References 174 9.7 Acknowledgments 175 Chapter 10: Ten Years On and Still Going (by Simon Mills) 177 10.1 Background for the Case Study: “Before” 177 10.2 Insurance Quotation Systems Tested Automatically Every Month 179 10.3 What Happened Next? 193 10.4 Conclusion 193 Chapter 11: A Rising Phoenix from the Ashes (by Jason Weden) 197 11.1 Background for the Case Study 197 11.2 The Birth of the Phoenix 199 11.3 The Death of the Phoenix 202 11.4 The Rebirth of the Phoenix 203 11.5 The New Life of the Phoenix 207 11.6 Conclusion 212 Chapter 12: Automating the Wheels of Bureaucracy (by Damon Yerg [A Pseudonym]) 217 12.1 Background for the Case Study 217 12.2 The Agency Automation 219 12.3 From 2000 to 2008 223 12.4 An Alignment of Planets 226 12.5 Building Capability within Test Teams 231 12.6 Future Directions: The Journey Continues 233 12.7 Conclusion 235 Chapter 13: Automated Reliability Testing Using Hardware Interfaces (by Bryan Bakker) 237 13.1 Background for the Case Study 238 13.2 The Need for Action 239 13.3 Test Automation Startup (Incremental Approach) 240 13.4 Buy-In from Management 242 13.5 Further Development of Test Framework 244 13.6 Deployment and Improved Reporting 248 13.7 Conclusion 250 Chapter 14: Model-Based GUI Testing of Android Applications (by Antti Jääskeläinen, Tommi Takala, and Mika Katara) 253 14.1 Background for the Case Study 253 14.2 MBT with TEMA Toolset 256 14.3 Modeling Application Behavior 261 14.4 Generation of Tests 266 14.5 Connectivity and Adaptation 268 14.6 Results 272 14.7 Conclusion 273 14.8 Acknowledgments 274 14.9 References 274 Chapter 15: Test Automation of SAP Business Processes (by Christoph Mecke, Melanie Reinwarth, and Armin Gienger) 277 15.1 Background for the Case Study 278 15.2 Standards and Best Practices 282 15.3 eCATT Usage Examples 286 15.4 Conclusion 292 15.5 Acknowledgments 293 Chapter 16: Test Automation of a SAP Implementation (by Björn Boisschot) 295 16.1 Background for the Case Study 295 16.2 Project Overview 298 16.3 Phase 1: Proof of Concept 299 16.4 Phase 2: Project Start 307 16.5 Conclusion 319 Chapter 17: Choosing the Wrong Tool (by Michael Williamson) 321 17.1 Background for the Case Study 321 17.2 Our Preexisting Automation (or Lack Thereof) 324 17.3 Decision Needed: New Tool or Major Maintenance Effort? 326 17.4 Moving Forward with eggPlant 328 17.5 What Did We Do after eggPlant? 336 17.6 Conclusion 336 Chapter 18: Automated Tests for Marketplace Systems: Ten Years and Three Frameworks (by Lars Wahlberg) 339 18.1 Background for the Case Study 340 18.2 Automated Test Frameworks 341 18.3 Test Roles 344 18.4 Abstraction Layer 345 18.5 Configuration 348 18.6 Cost and ROI 349 18.7 Conclusion 352 Chapter 19: There’s More to Automation Than Regression Testing: Thinking Outside the Box (by Jonathan Kohl) 355 19.1 Background for the Case Study 355 19.2 Two Tales of Task Automation 357 19.3 Automation to Support Manual Exploratory Testing 362 19.4 Automating Data Interactions 364 19.5 Automation and Monitoring 368 19.6 Simulating Real-World Loads by Combining Simple Tools 370 19.7 Conclusion 372 19.8 References 372 Chapter 20: Software for Medical Devices and Our Need for Good Software Test Automation (by Albert Farré Benet, Christian Ekiza Lujua, Helena Soldevila Grau, Manel Moreno Jáimez, Fernando Monferrer Pérez, and Celestina Bianco) 375 20.1 Background for the Case Study 376 20.2 Comparison of the Different Approaches to Each Project 381 20.3 Project hamlet 385 20.4 Project phoenix 386 20.5 Project doityourself 388 20.6 Project miniweb 391 20.7 Test Execution 392 20.8 Result Reporting 393 20.9 Conclusion 396 Chapter 21: Automation through the Back Door (by Supporting Manual Testing) (by Seretta Gamba) 401 21.1 Background for the Case Study 401 21.2 Our Technical Solution 403 21.3 Implementing Test Automation with ISS Test Station 406 21.4 Implementing Test Automation 409 21.5 Supporting Manual Testing 413 21.6 The New Manual Test Process 417 21.7 Conclusion 422 21.8 References 423 Chapter 22: Test Automation as an Approach to Adding Value to Portability Testing (by Wim Demey) 425 22.1 Background for the Case Study 427 22.2 Portability Testing: Love or Hate It 428 22.3 Combination of Both Worlds as a Solution 428 22.4 Conclusion 435 22.5 Acknowledgment 435 Chapter 23: Automated Testing in an Insurance Company: Feeling Our Way (by Ursula Friede) 437 23.1 Background for the Case Study 437 23.2 The Application 439 23.3 Objectives 440 23.4 The Work 441 23.5 Lessons 443 23.6 Conclusion 444 Chapter 24: Adventures with Test Monkeys (by John Fodeh) 447 24.1 Background for the Case Study 447 24.2 Limitations of Automated Regression Testing 449 24.3 Test Monkeys 451 24.4 Implementing Test Monkeys 453 24.5 Using Test Monkeys 454 24.6 Benefits and Limitations 458 24.7 Conclusion 459 24.8 Additional Reading 460 Chapter 25: System-of-Systems Test Automation at NATS (by Mike Baxter, Nick Flynn, Christopher Wills, and Michael Smith) 461 25.1 Background for the Case Study 461 25.2 Test Execution Tool Integration 465 25.3 Pilot Project for the Tool 466 25.4 In-Service Model 467 25.5 Implementation 467 25.6 Typical Script Template 470 25.7 Lessons Learned 472 25.8 Conclusion 474 Chapter 26: Automating Automotive Electronics Testing (by Ross Timmerman and Joseph Stewart) 477 26.1 Background for the Case Study 477 26.2 Objectives for Automation Project 480 26.3 Brief History of the Automation Project 480 26.4 Results of the Automation Project 483 26.5 Conclusion 483 Chapter 27: BHAGs, Change, and Test Transformation (by Ed Allen and Brian Newman) 485 27.1 Background for the Case Study 485 27.2 Buy-In 487 27.3 The Story of Building the Automation Framework 491 27.4 Description of our Automation Framework 493 27.5 The Test Environment 497 27.6 Metrics 499 27.7 Conclusion 501 Chapter 28: Exploratory Test Automation: An Example Ahead of Its Time (by Harry Robinson and Ann Gustafson Robinson) 505 28.1 Background for the Case Study 505 28.2 What’s a Trouble Manager? 507 28.3 Testing a Trouble Manager Transaction 509 28.4 Constructing Test Cases Programmatically 510 28.5 New Ways to Think about Automated Tests 511 28.6 Testing the Trouble Manager Workflow 513 28.7 Test Generation in Action 518 28.8 Home Stretch 520 28.9 Post-Release 521 28.10 Conclusion 522 28.11 Acknowledgments 522 Chapter 29: Test Automation Anecdotes 523 29.1 Three Grains of Rice (by Randy Rice) 523 29.2 Understanding Has to Grow (by Molly Mahai) 527 29.3 First Day Automated Testing (by Jonathon Lee Wright) 528 29.4 Attempting to Get Automation Started (by Tessa Benzie) 535 29.5 Struggling with (against) Management (by Kai Sann) 536 29.6 Exploratory Test Automation: Database Record Locking (by Douglas Hoffman) 538 29.7 Lessons Learned from Test Automation in an Embedded Hardware—Software Computer Environment (by Jon Hagar) 545 29.8 The Contagious Clock (by Jeffrey S. Miller) 549 29.9 Flexibility of the Automation System (by Mike Bartley) 551 29.10 A Tale of Too Many Tools (and Not Enough Cross-Department Support) (by Adrian Smith) 552 29.11 A Success with a Surprising End (by George Wilkinson) 556 29.12 Cooperation Can Overcome Resource Limitations (by Michael Albrecht) 561 29.13 An Automation Process for Large-Scale Success (by Michael Snyman) 562 29.14 Test Automation Isn’t Always What It Seems (by Julian Harty) 567 Appendix: Tools 573 About the Case Study Authors 587 About the Book Authors 605 Index 607

Read more less

Book Synopsis

Read more less

Book SynopsisThe book is a result of the two decades of teaching experience of the author. It explains how to find faults in software before it is made available to users. The book will be a useful resource for senior undergraduate/graduate students of engineering, academics, software practitioners and researchers.Table of Contents1. Introduction; 2. Functional testing; 3. Essentials of graph theory; 4. Structural testing; 5. Software verification; 6. Creating test cases from requirements and use cases; 7. Selection, minimization and prioritization of test cases for regression testing; 8. Software testing activities; 9. Object oriented testing; 10. Metrics and models in software testing; 11. Testing web applications; 12. Automated test data generation; References; Appendix I. SRS of university registration system; Appendix II. Test cases from use cases; Appendix III. Validity checks; Answers to multiple choice questions.

Read more less

Book SynopsisUse this book to prepare for the ISTQBCertified Tester Foundation Level Performance Testingexam. The book has been designed to follow the ISTQBsyllabus, covering all of the syllabus learning objectives, with additional reference material extending beyond the syllabus. The book covers an overall methodology for managing and conducting performance testing. Performance testing has often been considered a black art. In many organizations, perhaps an individual or a small group of technical staff or contractors is given the task of load testing an extended system, network, or application. Performance testing is like any other form of testing. It follows a defined test process that is similar to other test types. It utilizes a disciplined approach to the definition of requirements and user stories, the creation of test conditions, test cases, and test procedures. It establishes measurable goals against which the success or failureof the testing can be judged. It also requires (and this cTable of ContentsIntroductionChapter 1. The Basic Concepts of Performance Testing ISTQB® Keywords Other Keywords 1.1 Principles of Performance Testing 1.2 Types of Performance Testing Performance Testing Load Testing Stress Testing Scalability Testing Spike Testing Endurance Testing Concurrency Testing Capacity Testing 1.3 Testing Activities in Performance Testing Static Testing Dynamic Testing 1.4 The Concept of Load Generation Load Generation via the User Interface Load Generation Using Crowds Load Generation via the Application Programming Interface (API) Load Generation using Captured Communication Protocols 1.5 Common Performance Efficiency Failure Modes and Their Causes Chapter 1 Questions Chapter 2. Performance Measurement Fundamentals ISTQB® Keywords Other Keywords 2.1 Typical Measurements Collected in Performance Testing Why Performance Metrics Are Needed Collecting Performance Measurements and Metrics Selecting Performance Metrics 2.2 Aggregating Results from Performance Testing 2.3 Key Sources of Performance Metrics 2.4 Typical Results of a Performance Test Chapter 2 Questions Chapter 3. Performance Testing in the Software Lifecycle ISTQB® Keywords 3.1 Principal Performance Testing Activities 3.2 Categories of Performance Risks for Different Architectures Single Computer Systems Multi-tier Systems Distributed Systems Virtualised Systems Dynamic/Cloud-based Systems Client –Server Systems Mobile Applications Embedded Real-time Systems Mainframe Applications 3.3 Performance Risks Across the Software Development Lifecycle 3.4 Performance Testing Activities Sequential Development Models Iterative and Incremental Development Models Commercial Off-the-Shelf (COTS) and other Supplier/Acquirer Models Chapter 3 Questions Chapter 4. Performance Testing Tasks ISTQB® Keywords 4.1 Planning 4.1.1 Deriving Performance Test Objectives 4.1.2 The Performance Test Plan 4.1.3 Communicating about Performance Testing 4.2 Analysis, Design and Implementation 4.2.1 Typical Communication Protocols 4.2.2 Transactions 4.2.3 Identifying Operational Profiles 4.2.4 Creating Load Profiles 4.2.5 Analysing Throughput and Concurrency 4.2.6 Basic Structure of a Performance Test Script 4.2.7 Implementing Performance Test Scripts 4.2.8 Preparing for Performance Test Execution 4.3 Execution 4.4 Analysing Results and Reporting Analysis Techniques Reporting Chapter 4 Questions Chapter 5. Tools ISTQB® Keywords 5.1 Tool Support 5.2 Tool Suitability Chapter 5 Questions Chapter 6. References 6.1 Standards 6.2 ISTQB® Documents 6.3 Books 6.4 Papers and Articles Chapter 7. Question Answers 7.1 Chapter 1 7.2 Chapter 2

Read more less

Book SynopsisThis book will help you analyze traces and logs from different software environments and communicate analysis results using a pattern language that covers everything from a small debugging log to a distributed trace with billions of messages from hundreds of computers, thousands of software components, threads, and processes. The book begins with the basic terminology of operating systems and programming, the foundation for understanding trace and log analysis. It then talks about patterns that help describe problems from a user's view and patterns for errors and failures. Then, the book covers a range of trace patterns that group messages, and explores how logs depict software activities. It even examines specific message patterns and how they connect in a single trace. Moving forward, you'll review patterns for multiple traces and logs and how to evaluate them. In this way, you can use similar methods to find problems across a wide variety of software. The book also provides guidanTable of Contents

Read more less

Book SynopsisThis practical book shows you how to apply the same response methodology to your own IT operation. You’ll learn how IMS best practices for leading people and managing time apply directly to IT incidents where the stakes are high and outcomes are uncertain.

Read more less

Book SynopsisDescription The Angular 2 framework is great for building large-scale web applications that can be maintained and extended. And when building enterprise-level apps, testing is vital to the development process. Testing improves the quality of code and reduces maintenance, saving both time and money. Even though testing is crucial, it’s sometimes neglected since there are few established resources and standards when it comes to modern JavaScript web applications. Developers who know how to build and leverage tests are highly valued by their clients and companies. Testing Angular Applications is an example-rich, hands-on guide that gives the real-world techniques needed to thoroughly test all parts of Angular 2 applications. The book starts with an introduction to Angular 2, TypeScript, testing fundamentals, and the testing frameworks and tools used in the book. Next, it explains how to set-up an Angular 2 environment, including TypeScript and the Angular 2 dependencies. The reader will then create their first component. The second part of the book focuses on the most important concepts of Angular 2, such as testing components, directives, pipes, services, and routing. This book will allow readers to confidently write unit and endto-end tests for Angular 2 applications and TypeScript. Key features • Testing components, directives, services and pipes • Real-world techniques • Hands-on examples • Foundation for writing advances tests • Provides code that can be reused in a production environment Audience This book is for readers with intermediate JavaScript skills and some experience with JavaScript frameworks. No experience with testing or Angular required. About the Technology Angular 2 is the latest version of the popular web application framework built by Google and its army of community contributors. Angular 2 is a mobile-first framework that promises to be fast, flexible, and expressive. The Angular 2 syntax is clean and easy to read, which lends itself nicely to rapid development and assists in writing tests.

Read more less

Book SynopsisWhether you’re just starting with JUnit or you want to ramp up on the new features, JUnit in Action, Third Edition has you covered. Extensively revised with new code and new chapters, JUnit in Action, Third Edition is an up-to-date guide to smooth software testing. Dozens of hands-on examples illustrate JUnit 5’s innovations for dependency injection, nested testing, parameterized tests, and more. Throughout, you’ll learn how to use JUnit 5 to automate your testing, for a process that consumes less resources and gives you more time for developing. Key Features · Introduction to unit testing · Blends JUnit with TDD, BDD, Continuous Integration, and other best practices · Unit testing of database and web applications For developers with intermediate Java 8 language skills and a basic understanding of the Apache Maven tool. About the technology JUnit is the gold standard for unit testing Java applications. JUnit 5 is a complete overhaul of this leading Java unit testing framework, boosting your productivity and helping to avoid debugging nightmares. Filled with new tools that make it easier than ever to write effective tests, JUnit 5 brings more granularity and avoids the need to import an entire library, allows multiple runners to work simultaneously and, best of all, allows developers to make full use of the new language features of Java 8 and beyond. Catalin Tudose has a PhD in Computer Science, and over 15 years experience as a Senior Java Developer and Technical Team Lead. He works as a Java and Web Technologies Expert at Luxoft Romania, and as a professor at the Faculty of Automation and Computers in Bucharest. Petar Tahchiev is a software engineer with HP and the Jakarta Cactus lead developer. Felipe Leme is a JCP member and contributor to DbUnit and Cactus. Gary Gregory is a Java developer with 20+ years of experience who currently develops application servers for legacy integration. Vincent Massol was the author of the first edition of JUnit in Action.

Read more less

Book SynopsisThis book is for everyone who needs to test the web. As a tester, you'll automate your tests. As a developer, you'll build more robust solutions. And as a team, you'll gain a vocabulary and a means to coordinate how to write and organize automated tests for the web. Follow the testing pyramid and level up your skills in user interface testing, integration testing, and unit testing. Your new skills will free you up to do other, more important things while letting the computer do the one thing it's really good at: quickly running thousands of repetitive tasks. This book shows you how to do three things: * How to write really good automated tests for the web. * How to pick and choose the right ones. * How to explain, coordinate, and share your efforts with others. If you're a traditional software tester who has never written an automated test before, this is the perfect book for getting started. Together, we'll go through everything you'll need to start writing your own tests. If you're a developer, but haven't thought much about testing, this book will show you how to move fast without breaking stuff. You'll test RESTful web services and legacy systems, and see how to organize your tests. And if you're a team lead, this is the Rosetta Stone you've been looking for. This book will help you bridge that testing gap between your developers and your testers by giving your team a model to discuss automated testing, and most importantly, to coordinate their efforts.The Way of the Web Tester is packed with cartoons, graphics, best practices, war stories, plenty of humor, and hands-on tutorial exercises that will get you doing the right things, the right way.

Read more less

Book SynopsisDoes your Rails code suffer from bloat, brittleness, or inaccuracy? Cure these problems with the regular application of test-driven development. You'll use Rails 5.1, Minitest 5, and RSpec 3.6, as well as popular testing libraries such as factory_girl and Cucumber. Updates include Rails 5.1 system tests and Webpack integration. Do what the doctor ordered to make your applications feel all better. Side effects may include better code, fewer bugs, and happier developers. Your Ruby on Rails application is sick. Deadlines are looming, but every time you make the slightest change to the code, something else breaks. Nobody remembers what that tricky piece of code was supposed to do, and nobody can tell what it actually does. Plus, it has bugs. You need test-driven development: a process for improving the design, maintainability, and long-term viability of software. With both practical code examples and discussion of why testing works, this book starts with the most basic features delivered as part of core Ruby on Rails. Once you've integrated those features into your coding practice, work with popular third-party testing tools such as RSpec, Jasmine, Cucumber, and factory_girl. Test the component parts of a Rails application, including the back-end model logic and the front-end display logic. With Rails examples, use testing to enable your code to respond better to future change. Plus, see how to handle real-world testing situations. This new edition has been updated to Rails 5.1 and RSpec 3.6 and contains full coverage of new Rails features, including system tests and the Webpack-based JavaScript setup. What You Need: Ruby 2.4, Rails 5.1

Read more less

Book SynopsisProperty-based testing helps you create better, more solid tests with little code. By using the PropEr framework in both Erlang and Elixir, this book teaches you how to automatically generate test cases, test stateful programs, and change how you design your software for more principled and reliable approaches. You will be able to better explore the problem space, validate the assumptions you make when coming up with program behavior, and expose unexpected weaknesses in your design. PropEr will even show you how to reproduce the bugs it found. With this book, you will be writing efficient property-based tests in no time. Most tests only demonstrate that the code behaves how the developer expected it to behave, and therefore carry the same blind spots as their authors when special conditions or edge cases show up. Learn how to see things differently with property tests written in PropEr. Start with the basics of property tests, such as writing stateless properties, and using the default generators to generate test cases automatically. More importantly, learn how to think in properties. Improve your properties, write custom data generators, and discover what your code can or cannot do. Learn when to use property tests and when to stick with example tests with real-world sample projects. Explore various testing approaches to find the one that's best for your code. Shrink failing test cases to their simpler expression to highlight exactly what breaks in your code, and generate highly relevant data through targeted properties. Uncover the trickiest bugs you can think of with nearly no code at all with two special types of properties based on state transitions and finite state machines. Write Erlang and Elixir properties that generate the most effective tests you'll see, whether they are unit tests or complex integration and system tests. What You Need Basic knowledge of Erlang, optionally Elixir For Erlang tests: Erlang/OTP >= 20.0, with Rebar >= 3.4.0 For Elixir tests: Erlang/OTP >= 20.0, Elixir >= 1.5.0

Read more less

Book SynopsisFearlessly change the design of your iOS code with solid unit tests. Use Xcode's built-in test framework XCTest and Swift to get rapid feedback on all your code - including legacy code. Learn the tricks and techniques of testing all iOS code, especially view controllers (UIViewControllers), which are critical to iOS apps. Learn to isolate and replace dependencies in legacy code written without tests. Practice safe refactoring that makes these tests possible, and watch all your changes get verified quickly and automatically. Make even the boldest code changes with complete confidence. Manual code and UI testing get slower the deeper your navigation hierarchy goes. It can take several taps just to reach a particular screen, never mind the actual workflow tests. Automatic unit testing offers such rapid feedback that it can change the rules of development. Bring testing to iOS development, even for legacy code. Use XCTest to write unit tests in Swift for all your code. iOS developers typically reserve unit tests for their model classes alone. But that approach skips most of the code common to iOS apps, especially with UIViewControllers. Learn how to unit test these view controllers to expand your unit testing possibilities. Since good unit tests form the bedrock for safe refactoring, you're empowered to make bold changes. Learn how to avoid the most common mistakes Swift programmers make with the XCTest framework. Use code coverage to find holes in your test suites. Learn how to identify hard dependencies. Reshape the design of your code quickly, with less risk and less fear.

Read more less

Book SynopsisProfessional testing of software is an essential task that requires a profound knowledge of testing techniques. The International Software Testing Qualifications Board (ISTQB) has developed a universally accepted, international qualification scheme aimed at software and system testing professionals, and has created the Syllabi and Tests for the Certified Tester. Today, hundreds of thousands of people have taken the ISTQB certification exams. The authors of Software Testing Foundations, 5th Edition, are among the creators of the Certified Tester Syllabus and are currently active in the ISTQB. This thoroughly revised and updated fifth edition covers the Foundations Level (entry level) and teaches the most important methods of software testing. It is designed for self-study and provides the information necessary to pass the Certified Tester Foundations Level exam, as defined by the ISTQB. Also in this new edition, technical terms have been precisely stated according to the ISTQB glossary. Topics covered: Fundamentals of Testing Testing and the Software Lifecycle Static and Dynamic Testing Techniques Test Management Test Tools

Read more less

Book SynopsisReliable test design is important in software testing; without it, defects in software may remain undetected, making the software poor quality and causing dissatisfaction among users. This book presents the key test design techniques, in line with ISTQB, and explains when and how to use them, including in combination, with practical, real-life examples. Automated test design methods are also discussed. Tips and exercises are included throughout the book, allowing you to test your knowledge as you progress.Trade Review'A masterful tour through the most important behavioural test design techniques.' -- Rex Black * President, RBCS, Inc.; Past President ASTQB and ISTQB *'This is the testing book I've been waiting for.' -- Elaine Weyuker * University Distinguished Professor; Member, US National Academy of Engineering; ACM Fellow; IEEE Fellow *'Finally, a book that makes the test design techniques available to everybody regardless of their level of experience. It will support testers wanting to improve the quality of their service or self-study for their ISTQB Advanced Level Certifications.' -- Francisca Cano Ortiz * Head of Software Quality Assurance, The Stars Group. *'A must-read for anyone who wants more understanding of test design techniques and especially using them together...Many test design techniques take some practice, before one can use them. This book gives that practice, bringing the dedicated reader to a new skill level. My personal view as experienced software testing trainer for twenty years is that one needs really down-to-earth examples when learning new techniques. This book gives such detail via its examples and I can recommend it as further reading to any learner.' -- Kari Kakkonen * Testing Trainer and Consultant at Knowit, ISTQB Secretary and co-author of 'Agile Testing Foundations' *Table of Contents Introduction Example Specification: Ticket Vending Machine Risk Management and Test Optimisation Defect Prevention Domain-Based Testing State Transition Testing Business Rule-Based Testing Scenario-Based Testing Combinative and Combinatorial Testing On-The-Fly Test Design Model-Based Testing Gherkin-Based MBT MBT Using Graphs - GraphWalker Testing the TVM - Summary and Method Comparison Conclusions and Recommendations

Read more less

Book SynopsisThe practice of test automation is invaluable for modern software testers. Done well, it significantly increases software testing's efficiency, effectiveness and coverage and is essential for continuous testing and continuous delivery. This comprehensive guide for managers covers test automation in-depth for medium- to large-scale implementations, from the benefits of test automation to defining, building and implementing a test automation approach that is fit-for-purpose, to acquiring and executing test execution tools and frameworks. Industry examples are included throughout the book, templates and checklists can be found in the Appendix.Trade Review'With software, praise is often directed to designers and developers. More emphasis should go to the testers who ensure great, reliable, predictable, and trustable products get to market and deliver on their promise! Boby Jose provides a thorough and practical primer to the mindset and role of Test Automation as part of a holistic testing program. Perfect for anyone entering the software field, this guide explains test automation across multiple SDLCs and teaming models. A great place to start and grow in the craft of delivering great software and results.' -- Peter Borden, Digital & Technology Executive'Provides a practical overview into test automation. It gives food for thought to any manager who considers taking up that often misunderstood part of software testing. The book explains why companies typically use test automation, for what cost, and with what kind of professionals, tools, and approaches. It gives such good examples of automation processes and tools that it works also for anyone wanting to become a test automation expert.' -- Kari Kakkonen, author of software testing books 'Dragons Out!' and 'Agile Testing Foundations'This is an elegantly written book on a topic anyone who cares about quality digital products needs to understand. Boby is a master at balancing cost, quality and time and that experience shines through in the prose. Testing is not a dark art but it is an art that can darken a product lifecycle if not treated in the thoughtful way outlined by this book. -- Jonathon Carr-Brown, Chief Operating Officer, Healthily; former Managing Director of NHS ChoicesTable of ContentsPart 1: The Whats and Whys of Test Automation 1. Test Automation: A Strategic View 2. Domain-Focussed Test Automation 3. Test Automation Tool Selection 4. People and Team 5. Automation Frameworks 6. Environments 7. Candidates for Automation 8. Test Automation and Test Coverage Part 2: How and When to do Test Automation 9. Test Automation Subject Matter Expert 10. Test Automation Tools 11. Test Automation and Programming Languages 12. Automation Framework Design and Development 13. Measuring Automated Testing 14. Conclusion

Read more less