Software Test Professional serves the global software testing and quality assurance community, providing more than 50,000 professionals with information, education, training and professional networking opportunities.
Test Automation Strategies in an Agile World - Vikas Mittal - YouTube
Agile Development and Continuous Delivery are rapidly becoming the de facto standard for software development. The key business driver behind these initiatives: delivering new functionality to your customers faster. This is easy to state in theory but much harder to achieve in practice: the level of quality of your services must be maintained! If your system goes down once a week every week, your customers are unlikely to be happy.
In order to realize the desired business goals of Agile and Continuous Delivery, it is thus essential that entire team – developers, testers, and the business – have a highly accurate, near real-time measure of the risk and quality associated with the features in your delivery pipeline. This calls for extensive and accurate testing. In fact, making testing the central component of your delivery process is the most critical challenge that teams need to address.
The Need for Radical Flexibility in Test Automation
Identifying the quality and risk of new features to an acceptable level of confidence means carrying out a large number of different types of tests: code analysis, unit, functional, performance, regression and stability tests, usability analyses and more.
It also means carrying them out fast: organizations cannot afford to wait for lengthy manual tests, or complicated, manual analyses of test failures. Add in manual maintenance of the test code, the test environment parameters, and test data and it is clear why, for organizations relying only on manual testing, it is virtually impossible to implement real-time quality awareness effectively.
Test automation is a prerequisite for full-speed Continuous Delivery. But we need to go a step further: it is critical that your test automation is dynamic and flexible. The attributes of quality and risk that need to be measured will differ between projects, use cases and over time: performance in one case, security in another, usability and functionality in the next. As a result, the types of tests and test tools that need to be used will never be static.
Mind the Automation Anti-Patterns!
Vikas Mittal – Global President, Digital Assurance, Xebia
Vikas Mittal is the Head of Xebia’s distinguished Centre of Excellence—Digital Assurance (DA). The IIT Delhi alumnus joined Xebia in 2019, and his responsibilities include strategizing DA processes, optimize operations, and improve practices for seamless execution and successful deliveries of DA projects. His focus area also traverses the development of automation solutions for Software Testing Lifecycle and DevOps using the latest technological innovations in Machine Learning and Predictive Analytics.
Leader by spirit, Vikas is spearheading the team of Digital Assurance professionals at Xebia, helping and supporting them all in accomplishing their personal as well as company goals. His expertise in architecture, design, and implementation of test automation frameworks and solutions enables him to serve Xebia’s high-end customers well.
Vikas pursued various certification programmes viz; HP Mercury LoadRunner v9.0, HP Mercury LoadRunner v 9.0, HP Mercury VuGen Software 9.0, HP-Mercury Certification Quality Center 9.2, and HP-Mercury Certification Quick Test Professional 9.2 that helped him develop technical skills and competencies.
His career history of 15 years features eminent employers in the global IT industry such as Infogain, IBM Global Services India, CMS, and Fiserv. In 2002, the young and dynamic engineering graduate began his career as Quality Assurance (QA) engineer and grew up to work at senior-level positions of Global Head, Quality Assurance, Global Head of Testing Horizontal, Chief Solution Architect, and QA Lead in top-notch IT & software development companies.
Prior to joining Xebia, Vikas had worked with Infogain for four years as Chief Solution Architect and Global Head of Testing Horizontal, where he supervised the execution of largest CRM Migration testing projects for performance testing and functional test automation for Microsoft Dynamics. He also managed the largest global ERP migration to SAP S/4 Hana for a Fortune 10 company. All the company stakeholders immensely value his contribution to establishing Infogain as a thought leader with Fortune 500 companies.
Presently, Vikas is simultaneously working on Atal Innovation Mission which is an endeavor of Government of India to encourage and promote a culture of innovation and entrepreneurship, particularly in tech-driven sectors.
Besides being a tech maestro, Vikas is the keynote speaker and mentor, too who loves to empower individuals by sharing his life-learnings and impart knowledge to them.
5 Secrets for Simplifying Your Automated Test Cases - Paul Merrill - YouTube
Are you tired of spending endless hours maintaining your automated test cases? Do you dread looking at test automation reports because of the tedious tweaks you know you’ll need to make from the latest updates from dev? Has your team lost its faith in test automation?
Join us June 26 for Paul Merrill’s 5 Secrets for Simplifying Your Automated Test Cases.
Learn how to:
Speed up tests,
And get the feedback your team needs from tests quicker.
Paul Merrill – Principal SDET, Beaufort Fairmont, LLC
Paul Merrill is Principal Software Engineer in Test and founder of Beaufort Fairmont Test Automation. Frequent writer on testing and test automation in top-notch testing publications and international speaker, Paul works with clients every day to accelerate testing, mitigate risks, and increase the value of testing processes with test automation. An entrepreneur, tester, and software engineer, Paul has a unique perspective on launching and maintaining quality products. Follow Paul on twitter for testing insights. Learn more about test automation at http://beaufortfairmont.com/webinars.
Keys to Effective Test Automation in DevOps - Lee Barnes - YouTube
The ultimate goal of a DevOps approach is to deliver high-quality features to your customers at the pace they need. High performing DevOps shops point to continuous testing and test automation as key contributors to their success. However, effective testing practices have proven elusive in the DevOps journey of many organizations. They have difficulty assessing the risk of their release candidates as they move through the delivery pipeline and often resort to inefficient catch-all tests that slows their release cadence to a level that looks more like waterfall. The culprit is often the inability to incorporate stable automation into their testing practices.
In this talk, Lee will discuss how organizations can address these issues, and move towards continuous testing within their DevOps practices. Specifically, the discussion will touch on key practices and methods for implementing effective test automation in a DevOps pipeline including test suite & test scope, automation approach/methods, and test environment and data management.
Key Learning Points:
The importance of effective test automation in DevOps
Issues preventing the incorporation of test automation in DevOps processes
Techniques for effectively applying automation to DevOps testing activities
Lee Barnes – Founder & CTO, Utopia Solutions
Lee Barnes has over 25 years of experience in the Software Quality Assurance and Testing field. He has successfully implemented test automation and performance testing solutions in hundreds of environments across a wide array of industries. He is a recognized thought leader in his field and speaks regularly on related topics. As Founder and CTO of Utopia Solutions, Lee is responsible for the firm’s delivery of software quality solutions which include process improvement, test automation, and performance management.
Now, we are in the age of digital transformation 2.0 where we all are talking about artificial intelligence, machine learning, blockchain, augmented reality, virtual reality, robotics process automation, internet of things on top of digital transformation 1.0 comprised of mobile, analytics, cloud, social media, big data. Overall, digital transformation talks about accelerated delivery means release the product now or as early as possible. End-users are waiting for the product, for the new features, for the enhancements. Being a product owner or an application owner or a stakeholder- your priority should not only be accelerated delivery but also ensure accuracy in testing. This is mainly due to accelerated delivery with accuracy in testing ensures happy end-users. If you are delivering the product or adding new features but without doing testing or not doing end to end comprehensive testing, there are huge chances of errors occurring in production. This not only increases the overall product cost, but it is also not good for overall end-user experiences. In a competitive market, this is not at all desirable. So, as a product owner you need to think about both the delivery and testing to make the product successful. What I am trying to say is that both are equally important for end-users, while accelerated delivery is important to stay competitive in the market and stay ahead, accuracy in testing will help avoid any potential risk in production, resulting in less product cost and better customer experiences. By saying accuracy in testing – I mean end to end comprehensive testing results covering all types of testing (both functional & non-functional) looking at the different quality attributes to determine well in advance before the release to avoid any future surprises.
Accelerated delivery is now mandatory especially for digital transformation. That is the reason continuous delivery, low-code, no-code development is getting utilized everywhere. Application teams need to release the new features faster or update the features faster. So, accelerated delivery is not only a requirement but also important for staying competitive, or even ahead, in the market which will assist application teams in the long run. Now, assume that you are doing accelerated delivery but without accuracy in testing. Product team will not be confident to say that it is a quality product. Objective is to create speedy quality product not just speedy product. Application team should know that conducting end to end comprehensive testing is important even if it delays the schedule or plan in such a way that not only accelerates delivery but also accelerates testing conducted by project team to ensure speedy but accurate product. If you do that continuously, end-users will stay with you forever and you will be enduring in the market.
So, it is not only about accelerated delivery but also about accuracy in testing which makes your end-user happy. First end to end comprehensive testing needs to be conducted for accuracy in testing. Then you can think about making testing process to be done rapidly to ensure overall goal of an accelerated delivery is met. Fast-tracked, end-to-end comprehensive testing with more focus on automation specially for repetitive testing and regression testing, continuous testing or even shift-left testing helps deliver high-quality, high-performance and high-secure applications which can make your end-user happy. We all know that we can bolster the business in the long run by providing better customer experiences and by creating end-user happiness.
First, think about accuracy in testing to ensure a quality delivery rather than accelerated delivery without (or less) testing resulting in a poor-quality product. By saying accuracy in testing, I am trying to say both verification and validation are equally important, and their results are absolutely required to ensure end-user experiences. Functional, non-functional testing identify the potential software issues, regulatory testing ensures whether software is adhering to all software regulatory rules, standards etc. and if any issue arises then resolves them well in advance before the production release. So, it gives huge confidence ahead of the deployment and guarantees end-user experiences.
End to end comprehensive testing which covers both functional and non-functional testing ensures accuracy in testing and gives confidence ahead of the deployment. By saying comprehensive testing, I mean from unit testing to user acceptance testing- all types of testing looking at different quality attributes and ensure accuracy in testing. Start with unit testing (done by developers), then system testing, followed by integration testing and user acceptance testing or regression or re-testing, if any issues-these are from functional point of view. Then performance testing (load, stress, endurance, spike, volume, scalability, fail-over for example), security testing (penetration, vulnerability for example) from non-functional point of view. You also must do compatible testing (different browsers, OS, devices), protocol testing (Network, IP testing), compliance testing & ensuring with software quality standards, conduct legally compliant testing or checklists like GDPR. End to end comprehensive testing- I mean all of the above types of testing needs to be conducted to ensure accuracy in testing, make the product better with new or updated features & to avoid any potential surprises in production.
Application team always thinks about accelerated delivery, creates proper strategy and plan to implement that and ensure that too. However, if you don’t have any plan for testing or accuracy in testing then your accelerated delivery will not be beneficial even though the product will be released quickly, it will not be a quality product-it could be anything for example buggy, slow or un-secure product. So, testing must be planned carefully and with development to ensure accuracy in testing is absolutely met before the release. Now, you can’t afford to have more time in testing as your overall goal is to confirm accelerated product delivery and successful digital transformation. So, you have to think about that accelerated testing in addition with accelerated delivery like using concepts of automation testing, parallel testing to save time. Accuracy in testing always ensure less project cost for example identifying an issue in production and resolves them is always very costlier rather than finding them at the earlier phases of software development. In the same line, application team can think about shift-left testing to confirm issues and resolve them at early stages and ensure testing accuracy.
Even though you can say that accelerated delivery with accelerated testing ensure more successful digital transformation, however whether you are doing accelerated testing or speedy testing, what matters is accuracy in testing which will determine whether it is quality product in terms of all the quality attributes like functionality, performance, scalability, stability, availability, security, reliability, usability, compatibility etc. So, accelerated delivery and accuracy in testing both are requirement and we can certainly say that accelerated delivery with accuracy in testing will create successful product, ensure digital transformation 2.0 and confirms end-user happiness.
Senior Test Manager, Atos
Arun earned a degree in Computer science from Govt. Engg. College, India (college topper). He is having 13.5+ years of managing E2E testing delivery experience in different types of applications. He has a keen interest in reading and writing different technical papers. He has been selected in multiple international conferences; global webinars and his papers have been published in multiple forums and won many awards. Currently, he is working as a Senior Test Manager in Atos-NAO & Global Subdomain Leader for Atos Expert: Application-Testing.
Zero Automation to Zero Fear in ... More Than Zero Minutes! - YouTube
As automation knocks on the door once again, for many there is a continued fear, when will I be automated away? While manual testing will continue for the foreseeable future, it never hurts to get introduced to the concepts of what might come next as a manual tester! The world of software development and software testing continues to change, and as it does, testing and development come to meet in the contested territory of DevOps. While DevOps might employ some more technical aspects, it also is largely tool based, making it generally more friendly toward all users. In this webinar, we will be looking at some of the basics around transitioning to DevOps. Where to start, what sorts of strategies you will you use to approach your company, and how it will affect your workflow.
Increased familiarity with CI/CD
Tools that work well in a pipeline environment
Strategies for choosing what should be automated and what needs to remain manual
Our Speaker:Webinar Speaker:
Brian Fitzpatrick – Quality Engineer, Gannett
Brian Fitzpatrick is a quality engineer at Gannett with a focus on bringing testing and development closer together. With a major part of his responsibilities being helping others become more involved in the testing process. Along with Thomas Dale and Scott Gunther, he has developed the model-based testing software simulator to further push efforts around the union of developers and testers.
AI Test Generation. What We've Learned So Far. - Kevin Surace - YouTube
Since AI driven test generation was first introduced in 2017, much has been learned. Millions of test steps were generated and executed, finding thousands of bugs. We will dig into how the technology works, where it works and doesn’t. We will also discuss real-world challenges and what actual QA teams have found as easy, difficult, and revealing. We will show specific hard-to-find issues which AI is able to identify through real AUT examples. You will learn about the state of this technology, and when it might be of value to your team.
Kevin Surace – CEO & CTO, Appvance.ai
Kevin Surace is CEO & CTO of Appvance.ai and has been awarded 84 patents worldwide. He led pioneering work on the first cellular data smartphone (AirCommunicator), the first plastic multichip semiconductor packages, the first human-like AI virtual assistant (Portico), soundproof drywall, high R-value windows, AI-driven building management technology, AI-driven QA automation, and the window/energy retrofits of the Empire State Building and NY Stock Exchange. Kevin has been featured by Businessweek, Time, Fortune, Forbes, CNN, ABC, MSNBC, FOX News, and has keynoted hundreds of events, from INC5000 to TED to the US Congress. He was INC Magazines’ Entrepreneur of the Year, a CNBC top Innovator of the Decade, World Economic Forum Tech Pioneer, Chair of Silicon Valley Forum, Planet Forward Innovator of the Year nominee, featured for 5 years on TechTV’s Silicon Spin, and inducted into RIT’s Innovation Hall of Fame.
DevOps has introduced us to a world where the traditional boundaries between development and operations are gone. Teams own their application from that first commit, into production. But what does that mean for testing?
Join our STP Community Webinar host, Smita Mishra, as she leads this panel discussion with Theresa Neate and Hilary Weaver-Robb. These seasoned Testing Professionals will discuss their experiences with testing, development, and a leadership perspective in a DevOps world. They will also discuss how testing has evolved, and the types of testing they are focusing on now.
How our roles have evolved
What is the role of a tester (and developer!) in a DevOps world?
What skills are needed for testing in DevOps?
What kind of testing, and when, are we looking at now?
Our Speakers:Theresa Neate – Senior Developer Advocate, REA Group
Theresa Neate is a senior developer advocate, lead quality analyst and test consultant – with several years of leadership experience – who loves lean and agility and advocates for holistic system quality and systems thinking.
In her spare time, Theresa studies a Diploma of Networking, freelance blogs for TechTarget DevOpsAgenda, sits on their Advisory Board, and co-organises and contributes at DevOps Girls. She’s a lifelong and eternally curious skeptic and learner.
Hilary Weaver-Robb is a software quality architect at Detroit-based Quicken Loans. She is a mentor to her fellow testers, makes friends with developers, and helps teams level-up their quality processes, tools, and techniques. Hilary has always been passionate about improving the relationships between developers and testers and evangelizes software testing as a rewarding, viable career. She runs the Motor City Software Testers user group, working to build a community of quality advocates. Hilary tweets (a lot) as @g33klady, and you can find tweet-by-tweet recaps of conferences she’s attended, as well as her thoughts and experiences in the testing world, at g33klady.com.
Ask Me Anything (AMA) with Michael Bolton - YouTube
Here is your opportunity to ask any questions to Michael Bolton. Michael is a consulting software tester and testing teacher who helps people solve testing problems that they didn’t realize they could solve. He is the co-creator (along with James Bach) of Rapid Software Testing, a methodology, and mindset for testing software expertly and credibly in uncertain conditions and under extreme time pressure. The idea for the AMA is to get insights on testing as per Michael’s experiences and learnings. Fill out the provided web form with your questions for Michael and we will take them up with him during the AMA on Wednesday, February 27th!
Michael Bolton is a consulting software tester and testing teacher who helps people to solve testing problems that they didn’t realize they could solve. Since 2006, he has been co-author (with James Bach) of Rapid Software Testing (RST), a methodology and mindset for testing software expertly and credibly in uncertain conditions and under extreme time pressure, and has flown over a million miles to teach RST in 35 countries. Over the last Michael has 25 years of experience testing, developing, managing, and writing about software. For the last 18 years, he has led DevelopSense, a Toronto-based testing and development consultancy. Prior to that, he was with Quarterdeck Corporation for eight years, during which he managed the company’s flagship products and directed project and testing teams both in-house and around the world.
See Michael Bolton at STPCon Spring 2019
Michael will be delivering a two 2-part workshops, a keynote and a sessions at the Hyatt Regency San Francisco Airport Hotel – April 1-4, 2019. Join us for 4-days of all things Software Testing, QA, QE, Automation, Machine Learning and more… See the full program at www.STPCon.com/event-schedule
Workshop: Rapid Introduction to Rapid Software Testing – Part 1 & Part 2
Why do we test? What’s the point? We test to develop a comprehensive understanding of the product. We test to find problems that threaten the value of the product, or that threaten the on-time, successful completion of any kind of development work. We test to help the business, managers, and developers decide whether the product they’ve got is the product they want. [Read More]
Workshop: Critical Thinking Skills for Testers – Part 1 & Part 2
In the workshop, we’ll question the myths of software testing; examine common cognitive biases, and the critical thinking tools that can help to manage them; learn modeling and general systems approaches to manage complexity and observational challenges; and work through exercises that model difficult testing problems—and suggest approaches to solving them. [Read More]
Keynote: Testers as Their Own Worst Enemies
In this session, Michael Bolton will talk about several ways in which testers undermine their own reputations and the image of the testing profession. He will provide reframes and antidotes to help testers identify and resolve those problems, and he’ll point the way towards developing technical skills, socials skills, and most importantly thinking skills that can build respect for testing and increase testers’ effectiveness. [Read More]
Rapid Software Testing in Agile Contexts
Over the last several years, a set of ideas and activities have been dumped into a big bucket called “Agile software development”. Agile development has hit mainstream recognition. Yet there is often uncertainty and turmoil around what “Agile development” means, in theory and in practice, and the confusion affects Agile projects and the people in them. [Read More]
The QE/QA Role: Supporting DevOps the Smart Way - Melissa Tondi - YouTube
In this talk, Melissa will share the main focus areas that QA/QE should explore within DevOps. Focusing on more valuable automation, shifting traditional “right” tasks left, and tailoring refinement to account for more efficient activities are some of the topics we’ll discuss. You’ll take away practical outcomes that will be relevant no matter where you are in your DevOps implementation.
Melissa Tondi has spent most of her career working within software testing teams. She is the founder of Denver Mobile and Quality (DMAQ), board member of Software Quality Association of Denver (SQuAD), and Manager of Professional Services at Rainforest QA, where she assists teams to continuously improve the pursuit of quality software—from design to delivery and everything in between. In her software test and quality engineering careers, Melissa has focused on building and organizing teams around three major tenets—efficiency, innovation, and culture – and has created the Greatest Common Denominator (GCD) approach for determining ways in which team members can assess, implement and report on day to day activities so the gap between need and value is as small as possible.
See Melissa at STPCon Spring 2019
Melissa will be delivering a two sessions at the Hyatt Regency San Francisco Airport Hotel – April 1-4, 2019. Join us for 4-days of all things Software Testing, QA, QE, Automation, Machine Learning and more… See the full program at www.STPCon.com
Session: The “Do Nots” of Testing
Hear the five lessons learned in testing, address them, and take back valuable solutions on your journey of a modern tester! In the “Do Nots” of Testing, we explore the lessons learned in Software Testing – otherwise known as the “Do Nots”. [Read More]
Session: The QA/QE Role: Supporting DevOps the Smart Way
Focusing on more valuable automation, shifting traditional “right” tasks left, and tailoring refinement to account for more efficient activities are some of the topics we’ll discuss. You’ll take away practical outcomes that will be relevant no matter where you are in your DevOps implementation. [Read More]
Intro to Postmodern Testing - Jason Arbon - YouTube
Modern testing isn’t keeping up with Agile and DevOps. Postmodern testing, like its artistic parallel, is the acceptance of this reality and practically combines the learnings of what works and what doesn’t in today’s software engineering landscape. This webinar shares the basic Dos and don’ts of postmodern testing that save time, money and make testers awesome members of the engineering team. Postmodern testing is informed by Jason’s experiences at Google, Microsoft, uTest, and test.ai. Don’t learn the hard way, join us for an introduction to postmodern testing and avoid the mistakes, and learn from what worked testing software for billions of users and thousands of applications.
Jason Arbon – CEO, test.ai Jason Arbon is the CEO at test.ai where his mission is to test all the worlds apps. Google’s AI investment arm lead test.ai’s latest funding round. Jason previously worked on several large-scale products: web search at Google and Bing, the web browsers Chrome and Internet Explorer, operating systems such as Windows and ChromeOS, and crowd-sourced testing at auTest.com. Jason has also co-authored books such as How Google Tests Software and App Quality: Secrets for Agile App.
See Jason at STPCon Spring 2019
Jason will be delivering a Workshop, Keynote and Session at the Hyatt Regency San Francisco Airport Hotel – April 1-4, 2019. Join us for 4-days of all things Software Testing, QA, QE, Automation, Machine Learning and more… See the full program at www.STPCon.com
Workshop: Testing Software with Machine Learning
How do you train an AI bot to do your software testing? Integrating AI into your testing activities can be intimidating, but in reality, it is pretty easy–it just takes a lot of ‘grungy’ work. Learn how to directly apply AI to real-world testing problems, without having a Ph.D. in computer science. [Read More]
Keynote: Testing all the World’s Apps with AI
How can one system test all the world’s apps? Mobile and Web. Jason shares learnings from applying AI techniques for doing just that. Learn how AI can help with the problems of identifying elements in applications, and the sequencing of test steps for regression testing. [Read More]
Session: Testing AI-Based Systems
People are adding “AI” to everything these days —but the big question is how to test it. We are already seeing AI products go awry. Engineers working on AI fear the little Frankenstein minds they created might make some bad decisions. Like traditional software, this new AI-based software needs to be tested. [Read More]