Test automationcan automate some repetitive, but necessary tasks. But if youre not careful, you can quickly fall into the rabbit hole of chasing failing tests and lose sight of the equally necessary exploratory questions:Can our users easily complete the user journey? Are there potential bugs with this journey? Is the quality of this journey regressing?
Tests are brittle because the underlying mechanics of XPaths, CSS selectors, element IDs, and other descriptors are often tightly coupled with automated tests. This is particularly painful when you have apps with dynamic locators or locators that arent necessarily unique, such as can be the case with Angular and React apps.
A machine-learning-driven testing solution like mabl handles apps with dynamic UIs to help testers focus on the human side of testing, which makes the testing role so unique and powerful in the first place.
How does mabl do this? Its all built into her test adaptation ability.
As testers interact with themabl trainerto create a test, under the covers, mabl captures your user journeys using our own proprietary domain-specific language. She also gathers a great deal of DOM element attributes, properties, and visual details (like XPaths, tag names, class attributes, text, and various contextual identifiers) to help identify conceptually equivalent elements in future test runs of the journey.
So now that she has an understanding of the user journey, as well as all this additional information, mabl knows enough about each action in the journey to identify the appropriate element again, or find likely replacements for it as the UI changes.When theres only one likely candidate available, mabl will incrementally update her models for the corresponding step of the journey, so tests will stay up to date even after several successive UI changes.
Much of this information can even be applied to the same journey in other environments, so tests running through the same app will run consistently. As mabl gathers more information about replacement candidates across many apps, this will ultimately be used in more advanced models to prioritize future candidates across journeys and even across apps.
But the question is regardingrobustchanges; can mabl still adapt? What does mabl do when theres no obvious right answer?
mabl uses the collected information to be experimental. Based on past identifications of elements, she can rank partial and uncertain matches.To verify if the experimental action was correct, mabl evaluates how the remainder of the journey unfolds.
For example, she considers whether assertions pass, whether she can complete subsequent actions, and the visual appearance of the resulting app state compared to previous runs. If mabl determines that her fix for the test was successful,shell let you know what the proposed fix was.From here, you can simply reject mabls fix for the journey if it was incorrect, and mabl will remember that for future runs.
As mentioned at the onset, one of the difficulties with handling a variety of modern web frameworks like Angular and React is that they rely heavily on DOM manipulation and JavaScript execution. In particular, the DOM elements generated by these frameworks often include minimal and opaque attributes, making them hard to distinguish.
However,humansmust be able to recognize how to take a particular action across iterations of the UI; mabl gathers some of the same contextual clues.Although element attributes may be insufficient to identify a particular element for interaction during a journey, there are a variety of other dynamic or computed properties to be used, like inner text and rendered location or size.
Consider a simple example of a dynamically generated list in an Angular app withngFor(similarly withng-repeatin AngularJS 1.x or an array of generated list elements in React):
In this example, we have a screen that shows a list of user roles in a hypothetical app where each role can be clicked to get a detailed description of the role. This gets instantiated as a series of list (
We can train mabl to click on the roles in a specific order. On the bottom right is themabl trainer,recording each step as we interact with our Angular app:
Below youll find the test output from the mabl app. You can see her collecting information at each step of the journey, then completing the test successfully (accompanying screenshots that mabl collects of the app at each step are shown on the right):
So when our hypothetical app adds an A.3 role in the list ahead of B.0, mabl is still able to identify the Role B.0 anchor element by using the inner text properties of the anchor elements, and updates what she knows about that element.
If the names of the roles were later changed (e.g., B.0 becomes Beta-Zero), mabl would know that the correct element was last seen in the 4th position of the list (both by visual location and by last known XPath). So she would rank the Beta-Zero link as the most likely candidate and evaluate the rest of the journey to determine that she had made a correct choice and update her knowledge about the new text for the element.
With machine intelligence, mabl makes automated testing easy, low-maintenance, and available to every QA team.
You can try mabl out in your own apps for free, atapp.mabl.com.
Public link to Angular example:https://stackblitz.com/edit/mabl-angular-list-example?file=app%2Fapp.component.ts
Public link to corresponding React example:https://stackblitz.com/edit/mabl-react-generated-array-example?embed=1&file=index.js
Excerpt from:
Execute Automation Automation Testing Automated (5.5 ...
- The Automation Conference [Last Updated On: December 9th, 2016] [Originally Added On: December 9th, 2016]
- The Best Home Automation Systems of 2016 | Top Ten Reviews [Last Updated On: December 24th, 2016] [Originally Added On: December 24th, 2016]
- Compact Automation - Actuators, Hydraulic Cylinders, Linear ... [Last Updated On: December 24th, 2016] [Originally Added On: December 24th, 2016]
- What is Home Automation? | Home Automation Systems [Last Updated On: December 24th, 2016] [Originally Added On: December 24th, 2016]
- Job Seekers - Automation Personnel Services [Last Updated On: December 24th, 2016] [Originally Added On: December 24th, 2016]
- iAutomation [Last Updated On: December 25th, 2016] [Originally Added On: December 25th, 2016]
- Beyond Automation - hbr.org [Last Updated On: December 25th, 2016] [Originally Added On: December 25th, 2016]
- Automation The Car Company Tycoon Game on Steam [Last Updated On: December 25th, 2016] [Originally Added On: December 25th, 2016]
- Automation - Wikipedia [Last Updated On: December 25th, 2016] [Originally Added On: December 25th, 2016]
- Build automation - Wikipedia [Last Updated On: December 26th, 2016] [Originally Added On: December 26th, 2016]
- Home - Enerwave Home Automation [Last Updated On: December 27th, 2016] [Originally Added On: December 27th, 2016]
- Automation | Technologies | Systems | Integrator ... [Last Updated On: December 27th, 2016] [Originally Added On: December 27th, 2016]
- Automation - DESHAZO [Last Updated On: December 27th, 2016] [Originally Added On: December 27th, 2016]
- Custom Automation & Machine Design | Automation GT [Last Updated On: December 27th, 2016] [Originally Added On: December 27th, 2016]
- IT Automation - BMC [Last Updated On: December 27th, 2016] [Originally Added On: December 27th, 2016]
- Werner Electric | Automation [Last Updated On: January 28th, 2017] [Originally Added On: January 28th, 2017]
- Automationtechies | Automation Engineering Recruiting [Last Updated On: January 28th, 2017] [Originally Added On: January 28th, 2017]
- Automation - Mazak Corporation [Last Updated On: January 28th, 2017] [Originally Added On: January 28th, 2017]
- Automation | Food Engineering [Last Updated On: January 28th, 2017] [Originally Added On: January 28th, 2017]
- Test Automation Services for Development of Regression ... [Last Updated On: January 28th, 2017] [Originally Added On: January 28th, 2017]
- UI Automation Overview - msdn.microsoft.com [Last Updated On: February 5th, 2017] [Originally Added On: February 5th, 2017]
- The Evolution of Automation and What It Means for the Integration Industry - Commercial Integrator [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Automation, robots could replace 250000 public sector workers in the next 15 years - Computer Business Review [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- New telecom transformation goals require service automation - TechTarget [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Automation expected to displace insurance underwriters, real estate brokers - CIO Dive [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- The Perks Of Automation And The Risks: Why To Think Twice About Getting Into That Driverless Uber - Forbes [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Voices Reinventing enterprise finance by overhauling AP automation - Accounting Today [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- DFLabs Launches the First Security Automation and Orchestration Platform based Upon Supervised Active Intelligence - Business Wire (press release) [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- VIDEO: Going Big on Automation in a Small Footprint Facility - ENGINEERING.com [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Building a better model of human-automation interaction - Phys.org - Phys.Org [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Cruise Automation Is Testing an App For Hailing Self-Driving Cars - Fortune [Last Updated On: February 8th, 2017] [Originally Added On: February 8th, 2017]
- AlixPartners examines automation in manufacturing and logistics management - Logistics Management [Last Updated On: February 8th, 2017] [Originally Added On: February 8th, 2017]
- Women need to look out for each other in automated workplaces - The Guardian [Last Updated On: February 8th, 2017] [Originally Added On: February 8th, 2017]
- Automation vs. the H-1B visa program: Which matters to employees? - TechTarget [Last Updated On: February 8th, 2017] [Originally Added On: February 8th, 2017]
- Automation is the unavoidable future of the economy - The Daily Cougar [Last Updated On: February 8th, 2017] [Originally Added On: February 8th, 2017]
- Speeders beware: Legislation would allow automation crackdown ... - SFGate [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- Robots versus bureaucrats: Why public sector work is ripe for automation - Financial Post [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- Rockwell Automation Surged 10% in January as Growth Picked Up Steam - Motley Fool [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- Global Medical Automation Market to Reach Approximately $75.6 Billion by 2025 - By End User, Application ... - PR Newswire (press release) [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- Automation 'key' to advancing Thai production - The Nation [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- WorkWave Releases New Lead Management And Marketing ... - PR Newswire (press release) [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- 'We employ insane levels of automation' Kris Canekeratne - Times of India [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- Most people are optimistic about workplace automation, social data suggests - ZDNet [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- Yes, there's a job creation argument for automation and technology ... - The Hill (blog) [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- Technobabble: Automation and the modern worker - CIO Dive [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- Improving Behavior Through Automation of Vehicle Systems - School Transportation News (blog) [Last Updated On: February 11th, 2017] [Originally Added On: February 11th, 2017]
- Automation Nightmare: Philosopher Warns We Are Creating a World Without Consciousness - Big Think [Last Updated On: February 11th, 2017] [Originally Added On: February 11th, 2017]
- Why Don't We See More Automation in Federal Networks? - Nextgov [Last Updated On: February 11th, 2017] [Originally Added On: February 11th, 2017]
- Automation can revitalize the US workforce - Fox News [Last Updated On: February 11th, 2017] [Originally Added On: February 11th, 2017]
- Readers Write (Feb. 12): The moose population; jobs, start-ups and automation; diversity in the funny pages - Minneapolis Star Tribune [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]
- Automation can replace bureaucrats and save taxpayers money - Hot Air [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]
- TigerStop hopes to ride automation to new heights - The Columbian [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]
- Your Most Valuable Resource is Time Get More of it through Automation - CMS Critic (press release) (blog) [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- What Does Device Automation Mean for Users? - Medical Device and Diagnostics Industry (blog) [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- How To Beat Automation And Not Lose Your Job - Forbes [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- Logistics firm gets automation boost - The Straits Times [Last Updated On: February 14th, 2017] [Originally Added On: February 14th, 2017]
- PP Control & Automation launch new video to kick-start exciting plans for 2017 - Manufacturer.com [Last Updated On: February 14th, 2017] [Originally Added On: February 14th, 2017]
- Automation's Impace on Data Center Monitoring Alerts - The Data Center Journal [Last Updated On: February 14th, 2017] [Originally Added On: February 14th, 2017]
- Hollysys Automation Technologies Reports Unaudited Financial Results for the First Half Year and the Second Quarter ... - PR Newswire (press release) [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- 4 Automation Hacks to Save You Money and Manpower - Yahoo Finance [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- Istuary Innovation Group and Bluewrist Partner to Bring Robotics and Automation into China's Manufacturing Sector - Yahoo Finance [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- Redwood Software Named a Strong Performer in Independent Robotic Process Automation (RPA) Report - Yahoo Finance [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- Boeing ramps up automation, innovation as it readies 737MAX | The ... - The Seattle Times [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- Robots and AI are coming for our jobs, but can augmentation save us from automation? - Digital Trends [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- The Impact of Bad Data in Automation: Why Quality Management is Critical - R & D Magazine [Last Updated On: February 16th, 2017] [Originally Added On: February 16th, 2017]
- Automation: Are We Empowering Human Interaction Or Displacing It? - Business 2 Community [Last Updated On: February 16th, 2017] [Originally Added On: February 16th, 2017]
- Life in the Fast LaneAutomation with Software-Defined Intelligence - InfoWorld [Last Updated On: February 16th, 2017] [Originally Added On: February 16th, 2017]
- Luddite Lefty Journalists Apparently Think Workplace Automation is Conservatives' Fault [VIDEO] - Daily Caller [Last Updated On: February 16th, 2017] [Originally Added On: February 16th, 2017]
- Will automation define the future of network technology? - TechTarget [Last Updated On: February 16th, 2017] [Originally Added On: February 16th, 2017]
- Editorial: Improving automation - The Motorship [Last Updated On: February 17th, 2017] [Originally Added On: February 17th, 2017]
- TigerText Unveils Role-based Scheduling Automation, Amazon Alexa integration - HIT Consultant [Last Updated On: February 17th, 2017] [Originally Added On: February 17th, 2017]
- 89% people want automation at workplace: Adobe - Economic Times [Last Updated On: February 18th, 2017] [Originally Added On: February 18th, 2017]
- Delta veers to EV parts, automation - Bangkok Post [Last Updated On: February 18th, 2017] [Originally Added On: February 18th, 2017]
- Robotic process automation makes nearshore outsourcing more ... - CIO [Last Updated On: February 18th, 2017] [Originally Added On: February 18th, 2017]
- The working-class job that Trump could save from automation - Washington Post [Last Updated On: February 18th, 2017] [Originally Added On: February 18th, 2017]
- China must be ready for automation - Basic Income News [Last Updated On: February 18th, 2017] [Originally Added On: February 18th, 2017]
- Bill Gates Says Robots Should Be Taxed Like Workers - Fortune [Last Updated On: February 18th, 2017] [Originally Added On: February 18th, 2017]
- Trump and automation challenge India's IT industry - VentureBeat [Last Updated On: February 18th, 2017] [Originally Added On: February 18th, 2017]
- Both Trump and Automation Are Challenging India's IT Industry - Fortune [Last Updated On: February 20th, 2017] [Originally Added On: February 20th, 2017]
- 89% people want automation at workplace: Adobe - ETCIO.com [Last Updated On: February 20th, 2017] [Originally Added On: February 20th, 2017]