Tag: #AI-DrivenExploratoryTesting (Page 1 of 2)

Why Vitaq AI and why now?

Vitaq is equipped with AI machine learning algorithms that are coverage led. When you run Vitaq in AI mode, it will use the coverage model (defined by you the user) as the goal to try to achieve 100% coverage. It will do this by working out what is the most optimal set of tests to achieve this target.

The variable nature of your Vitaq Test Activity will provide many next allowable action selections and many different test data inputs. By informing the Vitaq AI machine learning algorithm what you care about, i.e. what user journeys you want to test and what test data you want to be generated, Vitaq will continuously run until it achieves 100% coverage of your coverage model.

The reasons to adopt Vitaq AI Test Automation:-

1) It helps you extend your testing from your traditional test Mocha (or other) Frameworks by creating a Vitaq AI Test Activity diagram by re-using all of your test framework JS code.

2) Your new Vitaq Test Activity allows the user to apply AI Machine Learning algorithms to auto-generate tests that focus on the things that you the QA Tester really cares about, which is your user journeys.

3) Vitaq AI gives users the ability to continuously generate tests which are highly variable, data-driven and which will explore the test space in ways which QA Testers may not necessarily think about.

Advantages of using Vitaq AI Test Automation:-

Vitaq AI delivers the following benefits:-

1) Productivity.

2) Efficiency and Effectiveness.

3) Reducing Risks.

Let’s discuss these three characteristics in more details :-

1) How Vitaq AI helps to improving productivity :-

It helps to improve productivity because you are able to capture your complete test space with a graphical visual model which is our Vitaq AI Test Activity.

This graphical test model, helps to drive the business logic of testing out into the open for all of the project contributors to see. It helps to improve communication between your managers, developers, dev testers and QA testers.

By releasing the power of AI machine learning to “explore” your newly created Test Activity Diagram (model of your test space) Vitaq AI will use compute power to auto-generate different test scenarios of test action script after test action script. All of these test action scripts can be be enhanced with highly variable auto-generated test data to give you data-driven tests. Because Vitaq AI by its very nature will give you highly variable tests, it does things which test developers might not think about, which helps it find defects which other approaches miss.

2) How Vitaq AI helps to improving efficiency and effectiveness:-

Vitaq AI Test Automation Tool helps in utilizing the test scripts that you may have already written for Mocha or other test frameworks, then enables you to make them data-driven and reusable across the test space.

With Vitaq AI the user is able to complete their testing by leading with QA Coverage. The user journey coverage capability is a unique way of not only monitoring, measuring and analyzing your user journey test coverage
but becomes the very goals that the AI machine learning algorithms of Vitaq will use to auto-generate your tests.

3) How Vitaq AI Helps in Reducing Risks :-

Vitaq AI uses the power of variability which auto-generate tests that quite often are not created in conventional frameworks like Mocha. So it will auto-generate tests that QA testers may well have missed, This helps find defects the other approaches miss and knowing that you have covered all of the user-journeys you care about, helps in reducing risks.

As well as completing all of your test requirements by achieving 100% QA Coverage, Vitaq AI can be run continuously to ‘explore’ in your test space to find corner cases that may escape into production. You can leave Vitaq AI running continuously utilising your spare compute resource 24 hours a day, 7 days a week. This will reduce your risks by helping to find more bugs earlier and make sure they get fixed before delivering your software build to clients or stake holders.

Vitaq AI can help take your Test Automation to the next level, so if you want to release the power of AI machine-learning combined with your QA testing skills, then the Vitaq AI-driven, coverage-led, auto-generated tests will make your testing life easier.

About AutomationPractice.com

We will be using the AutomationPractice.com e-commerce web application site to walk you through how to apply AI-driven continuous test automation with Selenium and WebDriverIO.

Automation Practice is an Ecommerce Website to help you practice test automation exercises on a real-time e-commerce website.

It consists of different workflows for adding products to cart, checking out
from the cart, making payments, etc.

Screenshot for adding products to cart​ :-

Screenshot for checking out from the cart​ :-

Screenshot for making payments​ :-

Workflows can be automated using Test Automation scripts and this website is
a great practice candidate for doing that​ .

To help you assess what our new Vitaq AI Test Automation Tool can do to help you get more testing done in less time, we have started our blog with a description of the classic way that many many QA and Dev testers deploy their testing using Jira for planning and then a conventional test framework such as Mocha. Once we have quickly stepped you through what you know already, you can easily relate it to how we tackle the test project with the new Vitaq AI continuous test automation tool, helping you to answer the key questions of Why Vitaq AI? and Why Now?

Gathering Test Requirements into Atlassian Jira

Before we jump into showing all the the new new AI-driven continuous test automation things in Vitaq we first need to talk about test planning. Failing to plan is planning to fail, so let’s begin with success in mind and take a look at how we approach test requirement planning. There are many ways to gather our web or mobile applications test requirements into a test plan. We typically take our story board and break it down into user stories and then into detailed user-journey definitions. One of the most common ways to capture this is to document them directly into Jira. Let’s look at how we did this for this example project :-

1) Start with our Product Requirements which needs to be tested.

For Example:- As mentioned in the earlier Blog we have chosen to use the AutomationPractice.com application site for our example project because it is representative of many e-commerce websites.

For this example project we have identified many test requirements which include searching for a product, adding it to cart and completing the payment process.

2) Communication of key features.

Our Test Cases need to communicate the key features of the application under test.

In our example project, one of the key features is to purchase items successfully from the registration of a user till the payment of an item. This is one test case out of many such cases.

3) Outline goals, business objectives, and strategic fit.

The team goals and business objectives section are meant to give you a chance to add some color and context to your requirement.

A good way to think about your goals is from your customer’s perspective. What exactly are they trying to achieve? How does the solution you’re proposing fit into it?

4) Creation of User Stories.

When all of the requirements of what to test are clearly agreed by all the team we now need to turn this into a story board that captures the User Story’s in the best possible way. See below how we have created this in Jira and then mapped it to our test requirements.

In the above screenshot, you can see some examples of our User Stories.

Let’s walk you through how we created these user story’s one by one:-

1) If We need user registration of 10 Users on AutomationPractice.com

Then we can simply create user story such as:- User Registration for 10 Users on AutomationPractice.com

2) If we want a user without login to be able to place an order on AutomationPractice.com

Then we can simply create user story such as:- Verify As a Guest User, A User should be able to search T-shirt in Search Box and proceed to Checkout Page

3) If we want a user to be able to subscribe to our newsletter on AutomationPractice.com to get information about the latest products.

Then we can simply create user story such as:- Verify User should be able to Subscribe to the WebSite Newsletter.

4) If we want that a Registered user to be able to order an Item through completing the payment of that item.

Then we can simply create user stories such as:- Verify as a Registered User, A user should be able to search Printed Dress in Search Box and able to Add it into his shopping cart and complete the payment process.

Likewise, we can create many more user stories like this on Jira by mapping the test requirements to user stories.

Before moving to AI-Driven Continous Test Automation, let’s first look at how we would use one of the conventional test frameworks such as Mocha. 

Mocha is a feature-rich Javascript test framework running on Node.js and in the browser, making asynchronous testing simple and productive. Mocha tests run serially, allowing for flexible and accurate reporting while mapping uncaught exceptions to the correct test cases.

There are many conventional test environments like Mocha used widely today including Jasmine, Jest, and Espresso.

All of these approaches require the user to write many individual tests that are then tied together to execute test scenarios. The user focuses their test writing on a very directed user-journey and one-shot data used.

Running these tests typically takes minutes and to achieve high test coverage the user will need to write test after test after test. Using their intuition and knowledge of their app under test many weeks of test scripting and debugging will be undertaken.

There is a more efficient and effective way of achieving high test space coverage by using the power of variability and the compute of AI-Driven to reduce the amount of scriptwriting needed and maximize the continuous test execution of data-driven test scenarios to achieve much more testing with much less effort. 

But before we introduce you to your new life as a Tester. Let’s briefly touch on what we do today with conventional test frameworks like Mocha. 

After Gathering Requirements we usually create a Test Environment. We have used Page-Object-Model for that. As we know page-object-model approach allows you to split your test logic from the UI representation.

As a result:-

1. You can develop your tests faster

2. You can re-use earlier created objects for one test in another test

3. If UI changes you don’t need to change your test logic, all you need to do is to amend the relevant Page Object(s) to reflect the changes – the test code remains the same

Following Page-Object-Model, we have also created a sort of framework for carrying out Test Activities on AutomationPractice.com

Here we have kept page objects for every page under the folder named as pages:-

Likewise, we have kept our test files under the Test Folder.

We of course have a config file that checks which test we need to run and on which browser.

This is the Conventional Approach we are following in our day to day Test Automation Task, writing test after test after test after test. Are you exhausted yet?

Running Vitaq AI Client in Docker with the Vitaq JavaScript Client and Selenium Server

The Vitaq AI Test Automation Tool is downloaded as a Docker Image. In order to run Vitaq in a Docker container, you will need to have Docker installed and running and be able to execute Docker commands at a command prompt. If you do not have Docker installed, then please follow the installation guides at the Docker website.

Before we jump into our Docker container and start the Vitaq JavaScript Client and Selenium Server to run our Vitaq AI selenium commands using WebDriverIO, we should take a few minutes to show you how easy it is to download and run Vitaq AI in a Docker Container. Let’s see the Vitaq AI installation journey.

1) Vitaq AI comes as a google drive link from where you can download the whole image at once. Whether you are using Ubuntu which is one of the Linux distribution or Windows or Mac OS Vitaq AI comes as a compressed tar Docker image file that can be directly loaded into Docker.

2) After Downloading the file, open Terminal Window which can easily be open by pressing CTRL + ALT + T key from your keyboard. or By clicking on Open in Terminal on the list displayed on right-clicking of mouse.

3) Now Run Command “docker load -i vitaq_evaluation_4_2_3.tar.gz” inside the folder. Where the vitaq_evaluation_4_2_3.tar.gz is the name of the docker image file you have downloaded using the link.

4) Now Run Command “docker image ls”

5) Now Run Command “docker volume create pgdata”

6) And Then Run Final Command :-

“docker run –name VitaqAI_4_2_3 -p 6080:80 –mount src=pgdata,dst=/var/lib/postgresql/9.6/main –mount type=bind,src=/home/,dst=/host –privileged –shm-size 512m vitaq_evaluation:4.2.3”

NOTE: You are mounting your host disk to the docker image disk at /host and your home directory /home/ on your Linux machine
drive on windows. If you want to just mount a folder on your host machine, (i.e.
where your working directory for Vitaq AI files will be stored, then you can change src:/home/ to /home/<LinuxUserName>/<FolderName>. In this example, you have to change to your user name (remember: if your Linux user name has space then you have to ‘escape’ the space character) and change to the folder
you will store your Vitaq AI files on your disk.)

7) Open your prefered web browser, make sure it is grown to the full screen and then Navigate to You are now in your Docker Container which has a full release of Ubuntu 1804 desktop.

8) Go to Programming and select Vitaq Test Automation

9) Now we are able to run Vitaq AI Test Automation Tool Successfully. But To make absolutely sure it is working correctly after installation, let’s check it by trying the Installation test. From the Vitaq AI Test Automation Tool window, use File -> Open which will open the File browser. Click on Home and then the folder examples

10) This is Vitaq AI JavaScript Test Activity Diagram which uses WebDriverIO and selenium server. So to run it successfully we need to run our Vitaq JavaScript client with WebDriverIO and start the Selenium Server.

For that you need to open a terminal from System Tools, LXTerminal.

Start the Vitaq JavaScript Client with WebDriverIO using the
command: “./vitaq_client.js -w webdriverio”

After starting the WebDriverIO on Vitaq JavaScript client, we now have to start the Selenium Server. For that open another terminal from System Tools, LXTerminal, and run the command “./selenium_server.sh”

Now Click on Run Button present on the top of Vitaq AI and see your Test Activity auto-generating tests by executing data-driven WebDriverIO JavaScript test scripts action, after action all driven by the user journey goals in the sequences and Vitaq AI machine learning algorithms..

Dividing and conquering your test space with the easy to capture Vitaq AI Data-Driven Test Activity Diagram

Vitaq AI provides users with an easy way to divide and conquer your applications functional test space by drawing test activity diagrams. This simple process involves the user taking the complete list of Test Requirements for our e-commerce AutomationPractice.com, which were previosly documented into Jira then dividing them in the most modular way to start performing Vitaq AI Test Automation to achieve the required 100% QA coverage results.

Let’s find out how we can take modular sections of requirements out of our Jira list to map to our VitaqAI Test Automation Tool:-

1) Below you will see our list of high level test requirements documented into Jira.

2) Now Open the Vitaq AI Test Automation Tool and add the common test actions needed to achieve the user journeys described in Jira for testing the sign-in of already registered users and new registration of a user through to checking their account details including wishlists, credit slips and the like to signing out. In addition to this add the new letter registration and contact us test action to increase the test space coverage. We have simply divided this section of our test space into a single test activity diagram by connecting each common test action to the next action it is ‘allowed’ to go to in the e-commerce AutomationPractice.com application. Resulting in single test activity diagram comprised of common test actions needed to meet the Jira test requirements for this registration and user account test space shown below:-

3) Now to capture the user-journey requirements defined in Jira: Click on the Sequences tab besides Test Action Scripts tab

What is Sequences tab in Vitaq-AI Test Automation Tool ?

Sequences:- Sequences in VitaqAI are referred to as user- journeys where we define the traversal path of the test run.

4) To Create Your User Journey Coverage Under Sequences Tab. Click on + Button

5) Enter the Sequence Name let’s say VTB_10 and keep the Add Sequence window open till you select your user journey by selecting respective test actions as required for your test run.

In the Above Screenshot, you can see numbering is taking place on each test action in the sequence while selecting each and every test action. This provides the user with an easy to visualise specification of our user journey goals for testing.

6) Click on Ok Button of Add Sequence Dialog Box. and we will see that VTB_10 has been added under the Sequences Tab.

These user-journey coverage goals are used by Vitaq AI’s machine learning algorithms to focus the automated-test scenarios generated to create the optimal set of tests to achieve 100% QA coverage.

To capture all of the test space defined in our Jira requirements we only needed to complete four separate Vitaq Test Activity Diagrams. The diagrams grouped the common test actions needed to execute user-journeys for particular types of test scenarios, such as user registration or product purchase and check-out. The four different test activities are shown below:-

Test Activity Diagram one

Test Activity Diagram Two

Test Activity Diagram Three

Test Activity Diagram Four

Why have four Test Activity Diagrams been created, why not one ?

By creating four Test Activity Diagrams we have divided and conquered the test space into four easy to visualise and hence debug user journey coverage groups. This is a more productive way of working with Vitaq AI Test Automation rather than creating one big Test Activity Diagram which would be harder to debug. Having four diagrams instead of one also increases the opportunity of deploying more dynamic variability in the automated tests Vitaq AI will create to meet the user-journey coverage goals, so there are more chances of finding bugs.

How to map your JavaScript Test framework code from Mocha, Jasmine, Jest or Espresso into Vitaq

Vitaq AI works seamlessly with Selenium, Appium, visual coding tools like Scriptworks, all CI tools, visual checking tools like Applitools and all cloud device platforms such as Saucelabs. At present this AI-driven test Automation Tool is Delivered in Docker for Mac, Windows and Linux. This product has been developed to increase UI and API test creation productivity, provide continuous auto-generated tests using the power of AI machine learning algorithms and find software functional bugs that other approaches miss. 

Inshort we can say that Vitaq AI Provides an AI-Driven, Coverage-led, continuous autonomous testing to than can be used with JavaScript, Python or Visual Code.

Mapping Mocha (or any other Test Framework) Code into Vitaq AI Test Automation Tool

Software Testers write their Automation code in their favourite IDE’s such as Eclipse, Intellij, Visual Studio Code etc. They quickly become productive in debugging their code in these IDE’s due to their feature-rich syntax checking, code completion and debugging capabilities. QA and dev testers have their favourite IDE which they gain experience with over time since they have started coding. So we have made sure that our Vitaq AI users can keep this productivity by being able to use their IDE of choice to create, check and debug their code as they create it for Vitaq AI driven test automation.

Before mapping our existing Test Framework code such as Mocha into the Vitaq-AI Test Automation Tool, We need to understand Vitaq Test Actions and Test Activity Diagrams to know what they are and how they work to help the QA and dev tester make the transition to continuous autonomous testing.

Test Actions :- Vitaq Test Actions typically represent web pages or app screens and the test scripts in these actions implement what the user can do, such as click a button or enter some data. The test data and sequences of Test Actions are auto-generated by Vitaq to efficiently fill the test space.

Test Activity Diagram :- The Test Activity Diagram in VitaqAI Test Automation Tool is a highly visual approach for describing test scenarios which ultimately makes it easier to develop and automate the generation of intelligent tests for dynamically generated content in websites and mobile apps. Many call this type of approach Model Driven testing. A Complete Test Activity Diagram consists of a number of Test Actions which are connected to their next allowable Test Actions to model what the user wants to test in a particular user journey or use-case scenario based on their test requirements. 

Let’s now take a look at how Mocha Tests can be picked up and dropped into the Vitaq script section of a particular Test Action :- 

1. Double Click on your desired Test Action for which you want to copy a Mocha JavaScript test. This might be a single function to complete a specific automated test or series of functions to test a whole web page. To Explain this concept we are going to use the user created “sign_In” Test Action of our Vitaq Test Activity diagram example below.

2. Go to the Sign_In function you have created in your Mocha Test.

3. We have used JS page object models for our Mocha tests. In our Mocha environment we have already created a signIn function which is present in the AutomationPracticeHome_Page js file. Therefore we can reuse that JS function from Mocha directly into Vitaq AI like this “AutomationPracticeHome_Page clickOnSignInLink()” inside the Vitaq sign_In Test Action script.

It is very easy to reuse all of your standard test framework code in the Vitaq AI Test Activity diagram.

Let’s now take a look at how your re-used Mocha test code can be enhanced to become data driven for highly variable exploratory tests by using Vitaq Test Activity Variables :-

In the above example we have used the sign_In Test Action which contains a simple click function which did not require any test data. When writing test code for Mocha functions which requires test data, we would typically put in fixed values. If we want highly variable data that continuously changes according to the needs of achieving coverage requirements of our test space then how can we provide that? Luckily Vitaq has come up with an ingeniously simple way of replacing our fixed date in Mocha (or other common JS framework tests) with something they call a Vitaq Test Activity Variable. 

Test Activity Variable:- Vitaq Test Activity Variables are the test script variables which hold test data and hence we can substitute them into our reused Mocha test code. In the Vitaq Test Action scripts we can call upon this test data dynamically as Vitaq AI runs. So when Vitaq AI running, is executing each Test Action Script in each Vitaq Test Action and then chooses what is the appropriate next allowable test action in the Test Activity diagram to execute next. All these next Test Action decisions and test data generation decisions are driven by the AI machine learning algorithms of Vitaq to “cover” the user journey requirements. Simply giving you continuous auto-generated AI-driven and coverage-led test scenarios.

Let’s look at the user journey example for User Registration. To test it  completely we will need test data created for the user’s first name, last name, address and phone number. We could stick to a very directed and static value based test data from Mocha or we can release the Power of variability by using the Vitaq Test Activity Variables provided by Vitaq AI Test Automation Tool to automatically create the data needed driven by the AI machine learning algorithms to the tool.

In the example for User Registration, we need the user’s first name , last name , address and phone number. All of this data can be kept inside the Test Activity Variables provided by VitaqAI Test Automation Tool.

Let’s go through the details of newsletter Test Action where the re-used Mocha code is now in the Vitaq test Action script requires newsLetterName Test Activity Variables for subscribing to newsletter of AutomationPractice.com. Let’s take a more detailed look at that to Understand it.

1) Double click on the newsletter Test Action where we are using the Vitaq Test Activity Variable named as newsLetterName Present under Activity Variable Tab on the Right Most Side After Action Properties Tab.

2) Inside the newsletter Test Action Script, we can see Test Activity Variable newsLetterName has been called using requestData() which is one of the Vitaq AI library methods which we can simply use to generate and return new values for our defined Vitaq Test Activity Variables when they are called in a Test Action Script.

Each time Vitaq AI runs this Test Action and executes the JS Test Action Script, Vitaq AI will decide what are the most appropriate data values to create for the defined Test Activity Variables and hence dynamically enhances your reused Mocha test action scripts for Data Driven Testing.

How to Implement WebDriverIO Page Object Model in VitaqAI Test Automation Tool

Page Object Models using WebDriverIO is fully supported by the Vitaq AI Test Automation Tool. Whether you are creating your Page Object Models from scratch in Vitaq or simply copying them from an already created Mocha (or other) Test Framework is quite simple.

Before diving into implementing Page Object Models, let’s discuss about their benefits in brief :-

Page Object Model, short hand POM, is a design pattern which nowadays has become very popular with QA and dev testers skilled in the art of test automation because of its characteristics which help in reducing code duplication over and over again and also helps in test maintainability.

Advantages of using Page Object Model (POM) :-

1) Actionable Code becomes much cleaner and readable as operational code i.e., Locators, Functions, and Methods is all present in one place which is the page object files.

2) Less Optimization of Code is needed because of reusable functions/methods present in page object files.

3) Functions or methods can be written in a more sensible way through which the meaning of that function i.e. what action it is going to perform can be understood. E.g. If we want to add an item on our shopping cart we can do so by creating a function/method named as clickOnAddToCart();

Let’s find out how we can implement the Page Object Model using WebDriverIO in the Vitaq AI Test Automation Tool and compare this to what you probably already know, which how you use them in Mocha:-

We will demonstrate a scenario where we will be searching an item say T-shirt on the sample e-commerce website i.e.,http://www.automationpractice.com/, and then carry out the checkout process for the guest user.

1) To Navigate to www.AutomationPractice.com. we keep our base url in the config file while using traditional webdriverio Mocha setup.

We can simply copy this Navigation or Base URL in Const Variable Config of Mocha, over to our JavaScript Functions File in Vitaq.

2) Now what we need is locators and functions before performing our desired test operations. For that, we create pages where we keep them separately. In the example below we are performing a search for an item in the e-commerce site and adding it to the shopping cart. So intuitively we name our page as AutomationPracticeSearch_Page.js

Likewise, we can pick relative locators and functions/methods and put them in JavaScript Functions present in VitaqAI Test Automation Tool as shown below:-

3) Now we have all the locators and creation of function/methods which are using all these locators completed we need to write the code to perform our required test actions. In Mocha (and other conventional test Frameworks) we create our test files by write our test code in the way as shown below :-

To re-use this Mocha code we can simply copy this code into our Vitaq Test Action scripts. As an example, here we perform the above actionable functions/methods from Mocha by copying itinto our VitaqAI Test Automation Tool through Test Actions present in Test Activity Diagram shown below:-

So you can see that it is very simple to re-use your Mocha (or other conventaional Test Framework) code by copying it across or if working on a new project implement your page object model (POM) using WebDriverIO in VitaqAI Test Automation Tool directly? You get the benefits of quickly making your test Automation framework AI-driven, data-driven and highly variable to reach 100% QA test coverage in the shortest possible time by letting the power of your computer auto-generate continuous exploratory tests and find defects that other a

Power of Variability: Both Test Action to Test Action and highly variable test data.

The power of variability in the Vitaq AI Test Automation Tool is the secret sauce that makes a single Test Activity automatically generate tests for many user journeys combined with different sets of data. Vitaq’s allows test scripts in each Test Action to execute in a series of action sequences, to imitate our user journeys by effectively executing each action script to the next allowable action script in turn.

As QA testers we get to know our Test Space in great detail. When we are creating a Vitaq Test Activity, it is quite intuitive to draw out our required test action to next allowable action and then in each action we write our test scripts. Another great thing about Vitaq is that we can also make our test scripts data-driven, so we can generate our data into the test scripts each time Vitaq executes a test action script. Vitaq AI has the capability of choosing the next allowable action to go to and when it’s in that action It goes through the test script and for any data-driven requirement it auto-generates the test data and feeds that data into the test script and then we go on to next allowable action.

It is very easy to click through actions in the Test Activity to define your specific requirements for certain user journey’s. To make sure these are achieved during a Test Automation run, we specify targets on each sequence (User Journey). Then we leave the heavy lifting up to Vitaq AI which uses it’s AI Machine Learning Algorithms to choose which next allowable Test Actions to select and what test data to auto-generate by learning what its achieving in terms of QA Coverage and comparing this against the goals that you have defined.

Vitaq works with its AI going through the entire Test Activity choosing Action to next allowable Action. The user can control how much variability is deployed when choosing test actions and test data by settings in the preferences form.

When setting the Variability to high, Vitaq will use its variability algorithm to choose different Action to next allowable Action sequences and different test data values, rather than directly choosing only the action to action sequences and test data defined in the User Journey goals. The increased variability provides a users with the ability to ‘explore’ around the test space rather than just directly executing a limited number of ‘known about’ user-journeys.

Vitaq’s power of variability in each Test Activity Diagram is a great way to make sure your software under test is tested thoroughly and helps to ensure that you will pass the rigorous quality checks required in modern app development.

Let’s discuss how we can handle Variability in the Vitaq AI Test Automation Tool :-

1) Open the Test Activity Diagram on which you want to apply Variability.

2) Click on Edit on top menu bar and click on preferences.

3) Check on Use coverage checkbox plus Check on Use AI checkbox, There you go you would be able to see the Vitaq AI Variability and Variability Decay.

4) If Variability has been set to low by keeping slider to the left and Variability Decay is Kept high by keeping slider to the Right.

Then Vitaq will use a minimum amount of Variability and each run it starts will quickly reduce (decay) the amount of variability. What that means to the Test Automation is that Vitaq will use a precise and directed choice of next action to achieve the sequence and by that, you can achieve your sequence faster but you will lose the opportunity to explore around your test space by using Vitaq’s variability to auto-generate tests that you may not have thought of.

5) If Variability has been set to High by keeping slider to the Right and Variability Decay is Kept low by keeping slider to the Left.

Then Vitaq will bring into play a high level of Variability at the beginning of a Vitaq AI Test Automation run and that for each new seed run, Vitaq will gradually reduce (decay) that amount of variability. This setting might not achieve your user journey sequence targets as quickly but it does mean you will get choices that are valid because you have drawn your Test Activity a connected Test Actions to next allowable actions.

6) if Variability has been set to Medium by keeping slider in the Middle and Variability Decay is set to Medium by keeping slider to the Middle.

Then Vitaq will provide medium amount of variability (which is not too high and too low) but would be sufficient to go through rigorous user journey’s checks with some exploratory variability testing.

The Relationship to the amount of Variability and the rate at which Vitaq will decrease that Variability on each run (by setting the Variability Decay) is a key aspect for controlling Vitaq AI and making sure it keeps a focus on achieving the defined test goals for achieving user journeys.

Vitaq makes its choice of next test action by either deploying its Machine Learning AI Algorithm or its underlying Variability algorithm. By setting the Variability to high and the Variability Decay to low means the choice will be largely taken by the Variability Algorithms and on each run this will slowly switch over to the AI Machine learning choices driven by achieving the QA coverage goals defined in the targets.

By Setting the Variability to low then you are actually asking Vitaq AI Test Automation Tool to use its machine learning Algorithms much more than the variability Algorithms and the resulting Test Automation run will execute test scenarios that are directly following the defined user sequences.

One of the useful aspects of Vitaq is it will do things that test developers don’t think about and if you allow more variability you will get more tests that may create more conditions in your software under test that a test developer wouldn’t have thought about. That is what makes Vitaq a powerful bug finder.

Measuring User Journey coverage and how Vitaq AI uses AI Machine Learning algorithms to achieve 100% Coverage.

The Vitaq AI Test Automation Tool provides users with the ability to monitor and measure user journey coverage by defining the sequences of test actions (and the test data used in these tests) that make-up our required journeys or use-cases. This can then be used as Test automation goals or Test objectives, which will guide the Machine Learning AI Algorithms to auto-generate tests which achieve those goals aiming to reach 100% QA test coverage.

User Journey:- The User Journeys are defined by the sequence of Test Actions in the Vitaq AI Test Automation Tool. The Test Activity diagram essentially models the path or Journeys which the user needs to go through to perform tests on the web of mobile app Software-under-test to achieve their desired test requirements.

Let’s find out more about these User Journeys, Vitaq AI Machine Learning Algorithms and how it maps to QA Coverage through some visual representations:-

1) In our last blog, we showed you how we create user journeys (or use case sequences), so as a reminder let’s take a look below at the screenshots.

Let’s say we have a test requirement called VTB_5 documented in Jira, which is our User Journey (or Use Case Sequence) and we want to see this happen at least once during our Test Automation run. So, we give our Vitaq AI sequence the name VTB_5 with a coverage target goal of 1 (i.e. needs to happen at least once). Then the user clicks on each test Action in turn on the Test Activity Diagram that makes up the user journey required. Here you can see the numbers in orange circles starting from 1 through to 7. Where action 1 in the sequence is Home, action 2 landingPage through to action 7 which is signOut. This sequence will be one of many user journey goals that the QA tester will want to cover during Test Automation.

2) After creating all of our required User Journeys (or Use Case Sequences) and completing the test scripts inside each of the test actions, we need to enable Coverage and AI through the edit preferences section of Vitaq. For that we click on Edit and select Preferences in the top banner menu of Vitaq.

3) Edit Preferences dialog box will open and enable the Use Coverage and Use AI checkbox. Ensure that Database information should be prefilled and then click on the Ok button.

4) When using JavaScript (instead of Python or Scriptworks visual code) in our Vitaq Test Activity diagrams, we will need to run the Vitaq JavaScript Client with WebDriverIO Configuration and a Selenium Server in command shell windows. So we need to open two terminals separately. Click on System Tools and click on LX Terminal. Note that you can also run Selenium (or Appium) outside the container either on your host machine or in a private or public cloud service.

5) In one of the terminals out of two opened terminals. enter “./vitaq_client.js -w webdriverio” to run Vitaq Client with WebDriverIO and hit Enter or Return key from Keyboard.

6) In Another Terminal. Enter “./selenium_server.sh” to run Selenium Server and hit Enter or Return key from Keyboard.

Now we are all set to go and hit Run button in Vitaq AI.

7) Click on the Run Button with Blue Play Symbol present on the top of the Vitaq window. By Clicking on it, Vitaq’s Machine Learning AI Algorithm will Start running continuous highly-variable auto-generated tests. Each new ‘seed’ run it makes will inform the AI algorithms to learn how to focus in on the required User Journeys gradually learning the traversal paths and executing tests until it achieves 100% test Coverage.

8) To see the percentage of test coverage covered achieved at any given time we can click on Coverage Button. It will display our percentage of test coverage which has happened during the run till it gets completed and shows 100% Test Coverage.

This is how we can make sure we have not missed any traversal path present in User Journey and achieves 100% Coverage through the unique and powerful Machine Learning AI Algorithm in Vitaq AI Test Automation Tool.

« Older posts