{"id":35096,"date":"2022-03-08T14:28:49","date_gmt":"2022-03-08T22:28:49","guid":{"rendered":"https:\/\/app14743.cloudwayssites.com\/?p=35096"},"modified":"2023-07-07T11:34:51","modified_gmt":"2023-07-07T18:34:51","slug":"autonomous-testing-test-automations-next-great-wave","status":"publish","type":"post","link":"https:\/\/app14743.cloudwayssites.com\/blog\/autonomous-testing-test-automations-next-great-wave\/","title":{"rendered":"Autonomous Testing: Test Automation\u2019s Next Great Wave"},"content":{"rendered":"\n<p>The word \u201cautomation\u201d has become a buzzword in pop culture. It conjures things like self-driving cars, robotic assistants, and factory assembly lines. They don\u2019t think about automation for software testing. In fact, many non-software folks are surprised to hear that what I do is \u201cautomation.\u201d<\/p>\n\n\n\n<p>The word \u201cautomation\u201d also carries a connotation of \u201cfull\u201d automation with zero human intervention. Unfortunately, most of our automated technologies just aren\u2019t there yet. For example, a few luxury cars out there can parallel-park themselves, and Teslas have some cool autopilot capabilities, but fully-autonomous vehicles do not yet exist. Self-driving cars need several more years to perfect and even more time to become commonplace on our roads.<\/p>\n\n\n\n<p>Software testing is no different. Even when test execution is automated, test development is still very manual. Ironic, isn\u2019t it? Well, I think the day of \u201cfull\u201d test automation is quickly approaching. We are riding the crest of the next great wave: <em>autonomous testing<\/em>. It\u2019ll arrive long before cars can drive themselves. Like previous waves, it will fundamentally change how we, as testers, approach our craft.<\/p>\n\n\n\n<p>Let\u2019s look at the past two waves to understand this more deeply. You can watch the <a href=\"https:\/\/app14743.cloudwayssites.com\/event\/opening-keynote-test-automations-next-great-wave-autonomous-testing\/\" target=\"_blank\" rel=\"noreferrer noopener\">keynote address<\/a> I delivered at <em>Future of Testing: Frameworks 2022<\/em>, or you can keep reading below.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><a href=\"https:\/\/app14743.cloudwayssites.com\/event\/opening-keynote-test-automations-next-great-wave-autonomous-testing\/\" target=\"_blank\" rel=\"noopener\"><img loading=\"lazy\" decoding=\"async\" width=\"878\" height=\"575\" src=\"https:\/\/app14743.cloudwayssites.com\/wp-content\/uploads\/2022\/03\/test-automation-next-great-wave-andrew-knight-keynote.jpg\" alt=\"Test Automations Next Great Wave\" class=\"wp-image-35101\" srcset=\"https:\/\/app14743.cloudwayssites.com\/wp-content\/uploads\/2022\/03\/test-automation-next-great-wave-andrew-knight-keynote.jpg 878w, https:\/\/app14743.cloudwayssites.com\/wp-content\/uploads\/2022\/03\/test-automation-next-great-wave-andrew-knight-keynote-300x196.jpg 300w, https:\/\/app14743.cloudwayssites.com\/wp-content\/uploads\/2022\/03\/test-automation-next-great-wave-andrew-knight-keynote-768x503.jpg 768w\" sizes=\"(max-width: 878px) 100vw, 878px\" \/><\/a><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-before-automation\"><a><\/a>Before Automation<\/h2>\n\n\n\n<p>In their most basic form, tests are manual. A human manually exercises the behavior of the software product\u2019s features and determines if outcomes are expected or erroneous. There\u2019s nothing wrong with manual testing. Many teams still do this effectively today. Heck, I always try a test manually before automating it. Manual tests may be <em>scripted<\/em> in that they follow a precise, predefined procedure, or they may be <em>exploratory<\/em> in that the tester relies instead on their sensibilities to exercise the target behaviors.<\/p>\n\n\n\n<p>Testers typically write scripted tests as a list of steps with interactions and verifications. They store these tests in test case management repositories. Most of these tests are inherently \u201cend-to-end:\u201d they require the full product to be up and running, and they expect testers to attempt a complete workflow. In fact, testers are implicitly incentivized to include multiple related behaviors per test in order to gain as much coverage with as little manual effort as possible. As a result, test cases can become very looooooooooooong, and different tests frequently share common steps.<\/p>\n\n\n\n<p>Large software products exhibit countless behaviors. A single product could have thousands of test cases owned and operated by multiple testers. Unfortunately, at this scale, testing is slooooooooow. Whenever developers add new features, testers need to not only add new tests but also rerun old tests to make sure nothing broke. Software is shockingly fragile. A team could take days, weeks, or even months to adequately test a new release. I know \u2013 I once worked at a company with a 6-month-long regression testing phase.<\/p>\n\n\n\n<p>Slow test cycles forced teams to practice Waterfall software development. Rather than waste time manually rerunning all tests for every little change, it was more efficient to bundle many changes together into a big release to test all at once. Teams would often pipeline development phases: While developers are writing code for the features going into release X+1, testers would be testing the features for release X. If testing cycles were long, testers might repeat tests a few times throughout the cycle. If testing cycles were short, then testers would reduce the number of tests to run to a subset most aligned with the new features. Test planning was just as much work as test execution and reporting due to the difficulty in judging risk-based tradeoffs.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"628\" height=\"355\" src=\"https:\/\/app14743.cloudwayssites.com\/wp-content\/uploads\/2022\/03\/typical-waterfall-release.jpg\" alt=\"A Waterfall release schedule showing overlapping cycles of Design, Development, Testing and Release.\" class=\"wp-image-35102\" srcset=\"https:\/\/app14743.cloudwayssites.com\/wp-content\/uploads\/2022\/03\/typical-waterfall-release.jpg 628w, https:\/\/app14743.cloudwayssites.com\/wp-content\/uploads\/2022\/03\/typical-waterfall-release-300x170.jpg 300w\" sizes=\"(max-width: 628px) 100vw, 628px\" \/><figcaption class=\"wp-element-caption\"><em>Typical Waterfall release overlapping<\/em><\/figcaption><\/figure>\n\n\n\n<p>Slow manual testing was the bane of software development. It lengthened time to market and allowed bugs to fester. Anything that could shorten testing time would make teams more productive.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-the-first-wave-manual-test-conversion\"><a><\/a>The First Wave: Manual Test Conversion<\/h2>\n\n\n\n<p>That\u2019s when the first wave of test automation hit: <em>manual test conversion<\/em>. What if we could implement our manual test procedures as software scripts so they could run automatically? Instead of a human running the tests slowly, a computer could run them much faster. Testers could also organize scripts into suites to run a bunch of tests at one time. That\u2019s it \u2013 that was the revolution. Let software test software!<\/p>\n\n\n\n<p>During this wave, the main focus of automation was <em>execution<\/em>. Teams wanted to directly convert their existing manual tests into automated scripts to speed them up and run them more frequently. Both coded and codeless automation tools hit the market. However, they typically stuck with the same waterfall-minded processes. Automation didn\u2019t fundamentally change how teams developed software, it just made testing better. For example, during this wave, running automated tests after a nightly build was in vogue. When teams would plan their testing efforts, they would pick a few high-value tests to automate and run more frequently than the rest of the manual tests.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"628\" height=\"355\" src=\"https:\/\/app14743.cloudwayssites.com\/wp-content\/uploads\/2022\/03\/example-manual-test.jpg\" alt=\"A table showing &quot;interaction&quot; on one column and &quot;verification&quot; in another, with sample test steps.\" class=\"wp-image-35108\" srcset=\"https:\/\/app14743.cloudwayssites.com\/wp-content\/uploads\/2022\/03\/example-manual-test.jpg 628w, https:\/\/app14743.cloudwayssites.com\/wp-content\/uploads\/2022\/03\/example-manual-test-300x170.jpg 300w\" sizes=\"(max-width: 628px) 100vw, 628px\" \/><figcaption class=\"wp-element-caption\"><em>An example of a typical manual test that would have likely been converted to an automated test during this wave.<\/em><\/figcaption><\/figure>\n\n\n\n<p>Unfortunately, while this type of automation offered big improvements over pure manual testing, it had problems. First, testers still needed to manually trigger the tests and report results. On a typical day, a tester would launch a bunch of scripts while manually running other tests on the side. Second, test scripts were typically very fragile. Both tooling and understanding for good automation had not yet matured. Large end-to-end tests and long development cycles also increased the risk of breakage. Many teams gave up attempting test automation due to the maintenance nightmare.<\/p>\n\n\n\n<p>The first wave of test automation was analogous to cars switching from manual to automatic transmissions. Automation made the task of driving a test easier, but it still required the driver (or the tester) to start and stop the test.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-the-second-wave-ci-cd\"><a><\/a>The Second Wave: CI\/CD<\/h2>\n\n\n\n<p>The second test automation wave was far more impactful than the first. After automating the <em>execution<\/em> of tests, focus shifted to automating the <em>triggering<\/em> of tests. If tests are automated, then they can run without any human intervention. Therefore, they could be launched at any time without human intervention, too. What if tests could run automatically after every new build? What if every code change could trigger a new build that could then be covered with tests immediately? Teams could catch bugs as soon as they happen. This was the dawn of <em>Continuous Integration<\/em>, or \u201cCI\u201d for short.<\/p>\n\n\n\n<p>Continuous Integration revolutionized software development. Long Waterfall phases for coding and testing weren\u2019t just pass\u00e9 \u2013 they were unnecessary. Bite-sized changes could be independently tested, verified, and potentially deployed. Agile and DevOps practices quickly replaced the Waterfall model because they enabled faster releases, and Continuous Integration enabled Agile and DevOps. As some would say, \u201cJust make the DevOps happen!\u201d<\/p>\n\n\n\n<p>The types of tests teams automated changed, too. Long end-to-end tests that covered \u201cgrand tours\u201d with multiple behaviors were great for manual testing but not suitable for automation. Teams started automating short, atomic tests focused on individual behaviors. Small tests were faster and more reliable. One failure pinpointed one problematic behavior.<\/p>\n\n\n\n<p>Developers also became more engaged in testing. They started automating both unit tests and feature tests to be run in CI pipelines. The lines separating developers and testers blurred.<\/p>\n\n\n\n<p>Teams adopted the <a href=\"https:\/\/automationpanda.com\/2018\/08\/01\/the-testing-pyramid\/\">Testing Pyramid<\/a> as an ideal model for test count proportions. Smaller tests were seen as \u201cgood\u201d because they were easy to write, fast to execute, less susceptible to flakiness, and caught problems quickly. Larger tests, while still important for verifying workflows, needed more investment to build, run, and maintain. So, teams targeted more small tests and fewer large tests. You may personally agree or disagree with the Testing Pyramid, but that was the rationale behind it.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"628\" height=\"355\" src=\"https:\/\/app14743.cloudwayssites.com\/wp-content\/uploads\/2022\/03\/testing-pyramid.jpg\" alt=\"The Testing Pyramid, showing a large amount of unit tests at the base, integration tests in the middle and end-to-end tests at the top.\" class=\"wp-image-35109\" srcset=\"https:\/\/app14743.cloudwayssites.com\/wp-content\/uploads\/2022\/03\/testing-pyramid.jpg 628w, https:\/\/app14743.cloudwayssites.com\/wp-content\/uploads\/2022\/03\/testing-pyramid-300x170.jpg 300w\" sizes=\"(max-width: 628px) 100vw, 628px\" \/><figcaption class=\"wp-element-caption\"><em>The Classic Testing Pyramid<\/em><\/figcaption><\/figure>\n\n\n\n<p>While the first automation wave worked within established software lifecycle models, the second wave fundamentally changed them. The CI revolution enabled tests to run continuously, shrinking the feedback loop and maximizing the value that automated tests could deliver. It gave rise to the SDET, or Software Development Engineer in Test, who had to manage tests, automation, and CI systems. SDETs carried more responsibilities than the automation engineers of the first wave.<\/p>\n\n\n\n<p>If we return to our car analogy, the second wave was like adding cruise control. Once the driver gets on the highway, the car can just cruise on its own without much intervention.<\/p>\n\n\n\n<p>Unfortunately, while the second wave enabled teams to multiply the value they can get out of testing and automation, it came with a cost. Test automation became full-blown software development in its own right. It entailed tools, frameworks, and design patterns. The continuous integration servers became production environments for automated tests. While some teams rose to the challenge, many others struggled to keep up. The industry did not move forward together in lock-step. Test automation success became a gradient of maturity levels. For some teams, success seemed impossible to reach.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-attempts-at-improvement\"><a><\/a>Attempts at Improvement<\/h2>\n\n\n\n<p>Now, these two test automation waves I described do not denote precise playbooks every team followed. Rather, they describe the general industry trends regarding test automation advancement. Different teams may have caught these waves at different times, too.<\/p>\n\n\n\n<p>Currently, as an industry, I think we are riding the tail end of the second wave, rising up to meet the crest of a third. Continuous Integration, Agile, and DevOps are all established practices. The innovation to come isn\u2019t there.<\/p>\n\n\n\n<p>Over the past years, a number of nifty test automation features have hit the scene, such as screen recorders and smart locators. I\u2019m going to be blunt: those are not the next wave, they\u2019re just attempts to fix aspects of the previous waves.<\/p>\n\n\n\n<ol type=\"1\">\n<li><strong>Screen recorders and visual step builders<\/strong> have been around forever, it seems. Although they can help folks who are new to automation or don\u2019t know how to code, they produce very fragile scripts. Whenever the app under test changes its behavior, testers need to re-record tests.<\/li>\n\n\n\n<li><strong>Self-healing locators<\/strong> don\u2019t deliver much value on their own. When a locator breaks, it\u2019s most likely due to a developer changing the behavior on a given page. Behavior changes require test step changes. There\u2019s a good chance the target element would be changed or removed. Besides, even if the target element keeps its original purpose, updating its locator is a super small effort.<\/li>\n\n\n\n<li><strong>Visual locators<\/strong> \u2013 ones that find elements based on image matching instead of textual queries \u2013 also don\u2019t deliver much value on their own. They\u2019re different but not necessarily \u201cbetter.\u201d The one advantage they do offer is <a href=\"https:\/\/app14743.cloudwayssites.com\/blog\/why-visual-locators-not-selectors-in-tests\/\">finding elements that are hard to locate with traditional locators<\/a>, like a canvas or gaming objects.&nbsp; Again, the challenge is handling behavior change, not element change.<\/li>\n<\/ol>\n\n\n\n<p>You may agree or disagree with my opinions on the usefulness of these tools, but the fact is that they all share a common weakness: they are vulnerable to behavioral changes. Human testers must still intervene as development churns.<\/p>\n\n\n\n<p>These tools are akin to a car that can park itself but can\u2019t fully drive itself. They\u2019re helpful to some folks but fall short of the ultimate dream of full automation.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-the-third-wave-autonomous-testing\"><a><\/a>The Third Wave: Autonomous Testing<\/h2>\n\n\n\n<p>The first two waves covered automation for execution and scheduling. Now, the bottleneck is test design and development. Humans still need to manually create tests. What if we automated <em>that<\/em>?<\/p>\n\n\n\n<p>Consider what testing is: Testing equals interaction plus verification. That\u2019s it! You do something, and you make sure it works correctly. It\u2019s true for all types of tests: unit tests, integration tests, end-to-end tests, functional, performance, load; whatever! Testing is interaction plus verification.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"628\" height=\"355\" src=\"https:\/\/app14743.cloudwayssites.com\/wp-content\/uploads\/2022\/03\/testing-is-interaction-plus-verification.jpg\" alt=\"\" class=\"wp-image-35110\" srcset=\"https:\/\/app14743.cloudwayssites.com\/wp-content\/uploads\/2022\/03\/testing-is-interaction-plus-verification.jpg 628w, https:\/\/app14743.cloudwayssites.com\/wp-content\/uploads\/2022\/03\/testing-is-interaction-plus-verification-300x170.jpg 300w\" sizes=\"(max-width: 628px) 100vw, 628px\" \/><figcaption class=\"wp-element-caption\"><em>At its core, testing is interaction plus verification<\/em><\/figcaption><\/figure>\n\n\n\n<p>During the first two waves, humans had to dictate those interactions and verifications precisely. What we want \u2013 and what I predict the third wave will be \u2013 is <em>autonomous testing<\/em>, in which that dictation will be automated. This is where artificial intelligence can help us. In fact, it\u2019s already helping us.<\/p>\n\n\n\n<p>Applitools has already mastered <a href=\"https:\/\/app14743.cloudwayssites.com\/applitools-ai-and-deep-learning\/\">automated validation for visual interfaces<\/a>. Traditionally, a tester would need to write several lines of code to functionally validate behaviors on a web page. They would need to check for elements\u2019 existence, scrape their texts, and make assertions on their properties. There might be multiple assertions to make \u2013 and other facets of the page left unchecked. Visuals like color and position would be very difficult to check. <a href=\"https:\/\/app14743.cloudwayssites.com\/platform-overview\/\">Applitools Eyes<\/a> can replace almost all of those traditional assertions with single-line snapshots. Whenever it detects a meaningful change, it notifies the tester. Insignificant changes are ignored to reduce noise.<\/p>\n\n\n\n<p>Automated visual testing like this fundamentally simplifies functional verification. It should not be seen as an optional extension or something nice to have. It automates the dictation of verification. It is a new type of functional testing.<\/p>\n\n\n\n<p>The remaining problem to solve is dictation of interaction. Essentially, we need to train AI to figure out proper app behaviors on its own. Point it at an app, let it play around, and see what behaviors it identifies. Pair those interactions with visual snapshot validation, and BOOM \u2013 you have autonomous testing. It\u2019s testing without coding. It\u2019s like a fully-self-driving car!<\/p>\n\n\n\n<p>Some companies already offer tools that attempt to discover behaviors and formulate test cases. Applitools is also working on this. However, it\u2019s a tough problem to crack.<\/p>\n\n\n\n<p>Even with significant training and refinement, AI agents still have what I call \u201cbanana peel moments:\u201d times when they make surprisingly awful mistakes that a human would never make. Picture this: you\u2019re walking down the street when you accidentally slip on a banana peel. Your foot slides out from beneath you, and you hit your butt on the ground so hard it hurts. Everyone around you laughs at both your misfortune and your clumsiness. You never saw it coming!<\/p>\n\n\n\n<p>Banana peel moments are common AI hazards. Back in 2011, IBM created a supercomputer named Watson to compete on Jeopardy, and it handily defeated two of the greatest human Jeopardy champions at that time. However, I remember watching some of the promo videos at the time explaining how hard it was to train Watson how to give the right answers. In one clip, it showed Watson answering \u201cbanana\u201d to some arbitrary question. Oops! Banana? Really?<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"624\" height=\"351\" src=\"https:\/\/app14743.cloudwayssites.com\/wp-content\/uploads\/2022\/03\/IBM-Watson-winning-Jeopardy.jpg\" alt=\"IBM Watson is shown defeating other contestants with the correct answer of Bram Stoker in Final Jeopardy.\" class=\"wp-image-35111\" srcset=\"https:\/\/app14743.cloudwayssites.com\/wp-content\/uploads\/2022\/03\/IBM-Watson-winning-Jeopardy.jpg 624w, https:\/\/app14743.cloudwayssites.com\/wp-content\/uploads\/2022\/03\/IBM-Watson-winning-Jeopardy-300x169.jpg 300w\" sizes=\"(max-width: 624px) 100vw, 624px\" \/><figcaption class=\"wp-element-caption\"><em>Watson (center) competing against Ken Jennings (left) and Brad Rutter (right) on Jeopardy in 2011. (Image source: <\/em><a href=\"https:\/\/i.ytimg.com\/vi\/P18EdAKuC1U\/maxresdefault.jpg\"><em>https:\/\/i.ytimg.com\/vi\/P18EdAKuC1U\/maxresdefault.jpg<\/em><\/a><em>)<\/em><\/figcaption><\/figure>\n\n\n\n<p><\/p>\n\n\n\n<p>While Watson\u2019s blunder was comical, other mistakes can be deadly. Remember those self-driving cars? Tesla autopilot mistakes have killed at least a dozen people since 2016. Autonomous testing isn\u2019t a life-or-death situation like driving, but testing mistakes could be a big risk for companies looking to de-risk their software releases. What if autonomous tests miss critical application behaviors that turn out to crash once deployed to production? Companies could lose lots of money, not to mention their reputations.<\/p>\n\n\n\n<p>So, how can we give AI for testing the right training to avoid these banana peel moments? I think the answer is simple: set up AI for testing to work together with human testers. Instead of making AI responsible for churning out perfect test cases, design the AI to be a \u201ccoach\u201d or an \u201cadvisor.\u201d AI can explore an app and suggest behaviors to cover, and the human tester can pair that information with their own expertise to decide what to test. Then, the AI can take that feedback from the human tester to learn better for next time. This type of feedback loop can help AI agents not only learn better testing practices <em>generally<\/em> but also learn how to test the target app <em>specifically<\/em>. It teaches application context.<\/p>\n\n\n\n<p>AI and humans working together is not just a theory. It\u2019s already happened! Back in the 90s, IBM built a supercomputer named Deep Blue to play chess. In 1996, it lost 4-2 to grandmaster and World Chess Champion Garry Kasparov. One year later, after upgrades and improvements, it defeated Kasparov 3.5-2.5. It was the first time a computer beat a world champion at chess. After his defeat, Kasparov had an idea: What if human players could use a computer to help them play chess? Then, one year later, he set up the first \u201cadvanced chess\u201d tournament. To this day, \u201ccentaurs,\u201d or humans using computers, can play at nearly the same level as grandmasters.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"624\" height=\"404\" src=\"https:\/\/app14743.cloudwayssites.com\/wp-content\/uploads\/2022\/03\/Gary-Kasparov-and-Deep-Blue.jpg\" alt=\"Gary Kasperov staring at a chessboard across the table from an operator playing for the Deep Blue AI.\" class=\"wp-image-35113\" srcset=\"https:\/\/app14743.cloudwayssites.com\/wp-content\/uploads\/2022\/03\/Gary-Kasparov-and-Deep-Blue.jpg 624w, https:\/\/app14743.cloudwayssites.com\/wp-content\/uploads\/2022\/03\/Gary-Kasparov-and-Deep-Blue-300x194.jpg 300w\" sizes=\"(max-width: 624px) 100vw, 624px\" \/><figcaption class=\"wp-element-caption\"><em>Garry Kasparov playing chess against Deep Blue. (Image source: <\/em><a href=\"https:\/\/cdn.britannica.com\/62\/71262-050-25BFC8AB\/Garry-Kasparov-Deep-Blue-IBM-computer.jpg\"><em>https:\/\/cdn.britannica.com\/62\/71262-050-25BFC8AB\/Garry-Kasparov-Deep-Blue-IBM-computer.jpg<\/em><\/a><em>)<\/em><\/figcaption><\/figure>\n\n\n\n<p>I believe the next great wave for test automation belongs to testers who become centaurs \u2013 and to those who enable that transformation. AI can learn app behaviors to suggest test cases that testers accept or reject as part of their testing plan. Then, AI can autonomously run approved tests. Whenever changes or failures are detected, the autonomous tests yield helpful results to testers like visual comparisons to figure out what is wrong. Testers will never be completely removed from testing, but the grindwork they\u2019ll need to do will be minimized. Self-driving cars still have passengers who set their destinations.<\/p>\n\n\n\n<p>This wave will also be easier to catch than the first two waves. Testing and automation was historically a do-it-yourself effort. You had to design, automate, and execute tests all on your own. Many teams struggled to make it successful. However, with the autonomous testing and coaching capabilities, AI testing technologies will eliminate the hardest parts of automation. Teams can focus on what they want to test more than how to implement testing. They won\u2019t stumble over flaky tests. They won\u2019t need to spend hours debugging why a particular XPath won\u2019t work. They won\u2019t need to wonder what elements they should and shouldn\u2019t verify on a page. Any time behaviors change, they rerun the AI agents to relearn how the app works. Autonomous testing will revolutionize functional software testing by lowering the cost of entry for automation.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-catching-the-next-wave\"><a><\/a>Catching the Next Wave<\/h2>\n\n\n\n<p>If you are plugged into software testing communities, you\u2019ll hear from multiple testing leaders about their thoughts on the direction of our discipline. You\u2019ll learn about trends, tools, and frameworks. You\u2019ll see new design patterns challenge old ones. Something I want you to think about in the back of your mind is this: <em>How can these things be adapted to autonomous testing?<\/em> Will these tools and practices complement autonomous testing, or will they be replaced? The wave is coming, and it\u2019s coming soon. Be ready to catch it when it crests.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>&#8220;Full&#8221; test automation is approaching. We are riding the crest of the next great wave: autonomous testing. It will fundamentally change testing.<\/p>\n","protected":false},"author":89,"featured_media":35155,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[12271],"tags":[10027,16706,16658,10152,10192,12686],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v24.5 (Yoast SEO v24.5) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Autonomous Testing: Test Automation\u2019s Next Great Wave - AI-Powered End-to-End Testing | Applitools<\/title>\n<meta name=\"description\" content=\"&quot;Full&quot; test automation is approaching. We are riding the crest of the next great wave: autonomous testing. It will fundamentally change testing.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/app14743.cloudwayssites.com\/blog\/autonomous-testing-test-automations-next-great-wave\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Autonomous Testing: Test Automation\u2019s Next Great Wave\" \/>\n<meta property=\"og:description\" content=\"&quot;Full&quot; test automation is approaching. We are riding the crest of the next great wave: autonomous testing. It will fundamentally change testing.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/app14743.cloudwayssites.com\/blog\/autonomous-testing-test-automations-next-great-wave\/\" \/>\n<meta property=\"og:site_name\" content=\"AI-Powered End-to-End Testing | Applitools\" \/>\n<meta property=\"article:published_time\" content=\"2022-03-08T22:28:49+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-07-07T18:34:51+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/app14743.cloudwayssites.com\/wp-content\/uploads\/2022\/03\/Autonomous-Testing-Test-Automation-Next-Great-Wave_831x542.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"831\" \/>\n\t<meta property=\"og:image:height\" content=\"542\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Andrew Knight\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Andrew Knight\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"15 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/app14743.cloudwayssites.com\/blog\/autonomous-testing-test-automations-next-great-wave\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/app14743.cloudwayssites.com\/blog\/autonomous-testing-test-automations-next-great-wave\/\"},\"author\":{\"name\":\"Andrew Knight\",\"@id\":\"https:\/\/app14743.cloudwayssites.com\/#\/schema\/person\/a8038d2c9ccd3531090422b6172b125b\"},\"headline\":\"Autonomous Testing: Test Automation\u2019s Next Great Wave\",\"datePublished\":\"2022-03-08T22:28:49+00:00\",\"dateModified\":\"2023-07-07T18:34:51+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/app14743.cloudwayssites.com\/blog\/autonomous-testing-test-automations-next-great-wave\/\"},\"wordCount\":3102,\"publisher\":{\"@id\":\"https:\/\/app14743.cloudwayssites.com\/#organization\"},\"image\":{\"@id\":\"https:\/\/app14743.cloudwayssites.com\/blog\/autonomous-testing-test-automations-next-great-wave\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/app14743.cloudwayssites.com\/wp-content\/uploads\/2022\/03\/Autonomous-Testing-Test-Automation-Next-Great-Wave_831x542.jpg\",\"keywords\":[\"Automated Visual Testing\",\"autonomous testing\",\"future of testing\",\"Test Automation\",\"Visual AI\",\"Visual Testing Strategies\"],\"articleSection\":[\"Getting Started\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/app14743.cloudwayssites.com\/blog\/autonomous-testing-test-automations-next-great-wave\/\",\"url\":\"https:\/\/app14743.cloudwayssites.com\/blog\/autonomous-testing-test-automations-next-great-wave\/\",\"name\":\"Autonomous Testing: Test Automation\u2019s Next Great Wave - AI-Powered End-to-End Testing | Applitools\",\"isPartOf\":{\"@id\":\"https:\/\/app14743.cloudwayssites.com\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/app14743.cloudwayssites.com\/blog\/autonomous-testing-test-automations-next-great-wave\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/app14743.cloudwayssites.com\/blog\/autonomous-testing-test-automations-next-great-wave\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/app14743.cloudwayssites.com\/wp-content\/uploads\/2022\/03\/Autonomous-Testing-Test-Automation-Next-Great-Wave_831x542.jpg\",\"datePublished\":\"2022-03-08T22:28:49+00:00\",\"dateModified\":\"2023-07-07T18:34:51+00:00\",\"description\":\"\\\"Full\\\" test automation is approaching. We are riding the crest of the next great wave: autonomous testing. It will fundamentally change testing.\",\"breadcrumb\":{\"@id\":\"https:\/\/app14743.cloudwayssites.com\/blog\/autonomous-testing-test-automations-next-great-wave\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/app14743.cloudwayssites.com\/blog\/autonomous-testing-test-automations-next-great-wave\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/app14743.cloudwayssites.com\/blog\/autonomous-testing-test-automations-next-great-wave\/#primaryimage\",\"url\":\"https:\/\/app14743.cloudwayssites.com\/wp-content\/uploads\/2022\/03\/Autonomous-Testing-Test-Automation-Next-Great-Wave_831x542.jpg\",\"contentUrl\":\"https:\/\/app14743.cloudwayssites.com\/wp-content\/uploads\/2022\/03\/Autonomous-Testing-Test-Automation-Next-Great-Wave_831x542.jpg\",\"width\":831,\"height\":542},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/app14743.cloudwayssites.com\/blog\/autonomous-testing-test-automations-next-great-wave\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/app14743.cloudwayssites.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Getting Started\",\"item\":\"https:\/\/app14743.cloudwayssites.com\/blog\/category\/getting-started\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Autonomous Testing: Test Automation\u2019s Next Great Wave\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/app14743.cloudwayssites.com\/#website\",\"url\":\"https:\/\/app14743.cloudwayssites.com\/\",\"name\":\"Applitools Visual AI\",\"description\":\"Applitools delivers full end-to-end test automation with AI infused at every step.\",\"publisher\":{\"@id\":\"https:\/\/app14743.cloudwayssites.com\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/app14743.cloudwayssites.com\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/app14743.cloudwayssites.com\/#organization\",\"name\":\"Applitools\",\"url\":\"https:\/\/app14743.cloudwayssites.com\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/app14743.cloudwayssites.com\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/app14743.cloudwayssites.com\/wp-content\/uploads\/2020\/03\/applitools.png\",\"contentUrl\":\"https:\/\/app14743.cloudwayssites.com\/wp-content\/uploads\/2020\/03\/applitools.png\",\"width\":156,\"height\":28,\"caption\":\"Applitools\"},\"image\":{\"@id\":\"https:\/\/app14743.cloudwayssites.com\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/app14743.cloudwayssites.com\/#\/schema\/person\/a8038d2c9ccd3531090422b6172b125b\",\"name\":\"Andrew Knight\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/app14743.cloudwayssites.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/a1117da4074b1fd8692051ab8a3a9528?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/a1117da4074b1fd8692051ab8a3a9528?s=96&d=mm&r=g\",\"caption\":\"Andrew Knight\"},\"url\":\"https:\/\/app14743.cloudwayssites.com\/blog\/author\/andyknight\/\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Autonomous Testing: Test Automation\u2019s Next Great Wave - AI-Powered End-to-End Testing | Applitools","description":"\"Full\" test automation is approaching. We are riding the crest of the next great wave: autonomous testing. It will fundamentally change testing.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/app14743.cloudwayssites.com\/blog\/autonomous-testing-test-automations-next-great-wave\/","og_locale":"en_US","og_type":"article","og_title":"Autonomous Testing: Test Automation\u2019s Next Great Wave","og_description":"\"Full\" test automation is approaching. We are riding the crest of the next great wave: autonomous testing. It will fundamentally change testing.","og_url":"https:\/\/app14743.cloudwayssites.com\/blog\/autonomous-testing-test-automations-next-great-wave\/","og_site_name":"AI-Powered End-to-End Testing | Applitools","article_published_time":"2022-03-08T22:28:49+00:00","article_modified_time":"2023-07-07T18:34:51+00:00","og_image":[{"width":831,"height":542,"url":"https:\/\/app14743.cloudwayssites.com\/wp-content\/uploads\/2022\/03\/Autonomous-Testing-Test-Automation-Next-Great-Wave_831x542.jpg","type":"image\/jpeg"}],"author":"Andrew Knight","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Andrew Knight","Est. reading time":"15 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/app14743.cloudwayssites.com\/blog\/autonomous-testing-test-automations-next-great-wave\/#article","isPartOf":{"@id":"https:\/\/app14743.cloudwayssites.com\/blog\/autonomous-testing-test-automations-next-great-wave\/"},"author":{"name":"Andrew Knight","@id":"https:\/\/app14743.cloudwayssites.com\/#\/schema\/person\/a8038d2c9ccd3531090422b6172b125b"},"headline":"Autonomous Testing: Test Automation\u2019s Next Great Wave","datePublished":"2022-03-08T22:28:49+00:00","dateModified":"2023-07-07T18:34:51+00:00","mainEntityOfPage":{"@id":"https:\/\/app14743.cloudwayssites.com\/blog\/autonomous-testing-test-automations-next-great-wave\/"},"wordCount":3102,"publisher":{"@id":"https:\/\/app14743.cloudwayssites.com\/#organization"},"image":{"@id":"https:\/\/app14743.cloudwayssites.com\/blog\/autonomous-testing-test-automations-next-great-wave\/#primaryimage"},"thumbnailUrl":"https:\/\/app14743.cloudwayssites.com\/wp-content\/uploads\/2022\/03\/Autonomous-Testing-Test-Automation-Next-Great-Wave_831x542.jpg","keywords":["Automated Visual Testing","autonomous testing","future of testing","Test Automation","Visual AI","Visual Testing Strategies"],"articleSection":["Getting Started"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/app14743.cloudwayssites.com\/blog\/autonomous-testing-test-automations-next-great-wave\/","url":"https:\/\/app14743.cloudwayssites.com\/blog\/autonomous-testing-test-automations-next-great-wave\/","name":"Autonomous Testing: Test Automation\u2019s Next Great Wave - AI-Powered End-to-End Testing | Applitools","isPartOf":{"@id":"https:\/\/app14743.cloudwayssites.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/app14743.cloudwayssites.com\/blog\/autonomous-testing-test-automations-next-great-wave\/#primaryimage"},"image":{"@id":"https:\/\/app14743.cloudwayssites.com\/blog\/autonomous-testing-test-automations-next-great-wave\/#primaryimage"},"thumbnailUrl":"https:\/\/app14743.cloudwayssites.com\/wp-content\/uploads\/2022\/03\/Autonomous-Testing-Test-Automation-Next-Great-Wave_831x542.jpg","datePublished":"2022-03-08T22:28:49+00:00","dateModified":"2023-07-07T18:34:51+00:00","description":"\"Full\" test automation is approaching. We are riding the crest of the next great wave: autonomous testing. It will fundamentally change testing.","breadcrumb":{"@id":"https:\/\/app14743.cloudwayssites.com\/blog\/autonomous-testing-test-automations-next-great-wave\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/app14743.cloudwayssites.com\/blog\/autonomous-testing-test-automations-next-great-wave\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/app14743.cloudwayssites.com\/blog\/autonomous-testing-test-automations-next-great-wave\/#primaryimage","url":"https:\/\/app14743.cloudwayssites.com\/wp-content\/uploads\/2022\/03\/Autonomous-Testing-Test-Automation-Next-Great-Wave_831x542.jpg","contentUrl":"https:\/\/app14743.cloudwayssites.com\/wp-content\/uploads\/2022\/03\/Autonomous-Testing-Test-Automation-Next-Great-Wave_831x542.jpg","width":831,"height":542},{"@type":"BreadcrumbList","@id":"https:\/\/app14743.cloudwayssites.com\/blog\/autonomous-testing-test-automations-next-great-wave\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/app14743.cloudwayssites.com\/"},{"@type":"ListItem","position":2,"name":"Getting Started","item":"https:\/\/app14743.cloudwayssites.com\/blog\/category\/getting-started\/"},{"@type":"ListItem","position":3,"name":"Autonomous Testing: Test Automation\u2019s Next Great Wave"}]},{"@type":"WebSite","@id":"https:\/\/app14743.cloudwayssites.com\/#website","url":"https:\/\/app14743.cloudwayssites.com\/","name":"Applitools Visual AI","description":"Applitools delivers full end-to-end test automation with AI infused at every step.","publisher":{"@id":"https:\/\/app14743.cloudwayssites.com\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/app14743.cloudwayssites.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/app14743.cloudwayssites.com\/#organization","name":"Applitools","url":"https:\/\/app14743.cloudwayssites.com\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/app14743.cloudwayssites.com\/#\/schema\/logo\/image\/","url":"https:\/\/app14743.cloudwayssites.com\/wp-content\/uploads\/2020\/03\/applitools.png","contentUrl":"https:\/\/app14743.cloudwayssites.com\/wp-content\/uploads\/2020\/03\/applitools.png","width":156,"height":28,"caption":"Applitools"},"image":{"@id":"https:\/\/app14743.cloudwayssites.com\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/app14743.cloudwayssites.com\/#\/schema\/person\/a8038d2c9ccd3531090422b6172b125b","name":"Andrew Knight","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/app14743.cloudwayssites.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/a1117da4074b1fd8692051ab8a3a9528?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/a1117da4074b1fd8692051ab8a3a9528?s=96&d=mm&r=g","caption":"Andrew Knight"},"url":"https:\/\/app14743.cloudwayssites.com\/blog\/author\/andyknight\/"}]}},"_links":{"self":[{"href":"https:\/\/app14743.cloudwayssites.com\/wp-json\/wp\/v2\/posts\/35096"}],"collection":[{"href":"https:\/\/app14743.cloudwayssites.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/app14743.cloudwayssites.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/app14743.cloudwayssites.com\/wp-json\/wp\/v2\/users\/89"}],"replies":[{"embeddable":true,"href":"https:\/\/app14743.cloudwayssites.com\/wp-json\/wp\/v2\/comments?post=35096"}],"version-history":[{"count":0,"href":"https:\/\/app14743.cloudwayssites.com\/wp-json\/wp\/v2\/posts\/35096\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/app14743.cloudwayssites.com\/wp-json\/wp\/v2\/media\/35155"}],"wp:attachment":[{"href":"https:\/\/app14743.cloudwayssites.com\/wp-json\/wp\/v2\/media?parent=35096"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/app14743.cloudwayssites.com\/wp-json\/wp\/v2\/categories?post=35096"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/app14743.cloudwayssites.com\/wp-json\/wp\/v2\/tags?post=35096"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}