Since version 12.7 we have been continuously improving on what was the first installment of our much anticipated UI Performance Testing offering. In version 12.7 we introduced UI Performance Testing - Manual testing, in version 12.8 we significantly expanded this offering to include automation, transaction video reports and a report repository in Reporter.
Version 12.9 announced the third installment which included HAR files as part of transaction reports and improved UX and filtering capabilities for the transaction report repository. In version 12.10 we announced our fourth installment which included automatic Speed Index score calculation as part of a transaction along with much-improved reporting analytics with Grouping. In this version 12.11 we are happy to announce our fifth installment of which includes the much anticipated performance transaction for web for automation, as well as REST API for performance measurements comparison.
Transaction Support for Web / Selenium Tests:
In version 12.11, we have added the support for performance transaction for your automated Web / Selenium tests. You can implement performance transaction into your Selenium tests, see a report and analyse it. For each transaction we collect all the raw data (Browser name, OS, URL etc...), measure the duration time and calculate the Speed Index. This enables large scale performance transaction analytics for Web directly from your CI/CD pipeline.
REST API to Analyze Performance Results as Part of your CI pipeline:
Version 12.11 includes REST API for performance measurements comparison. You can specify the transaction name and baseline measurements you want to compare to and define a condition upon which the tests are to fail. An example for such condition can be greater than x% deviation in performance in parameter or parameters as duration time, CPU, memory or network usage as well as Speed Index score. You can now add the condition to your CI/CD pipeline and trigger alerts to know in real time of any performance degradation
Version 12.11 includes detailed video report also for automated Selenium tests. As in automated Appium tests, for each Selenium test executed, we generate a report that includes all the test steps, Selenium session capabilities and test video. It also includes test status, date and duration. By watching the video together with the test steps and the other data provided in this report, users can quickly identify issues and their root cause.
In version 12.11 we enhanced the granularity of version property of an application to better identify application version. If in the past application version was represented by one property (called 'version'), it is now represented by two types of versions fields:
Build Version - indicates the build number of the application (used for debug/testing)
Release Version - indicates public version of the application
This helps you better identify your application version and correlate bugs or issues to the right version of an application. It also enables uniformity of installation between iOS and Android applications.
For more information please see: Manage Project Applications
Appium OSS - Support Appium v1.15
Espresso - Video default bit-rate decreased to 4 Mb/s
Selenium Grid - Windows - Support for AutoIT script execution for popup handling
Reporter - Transactions Group By - replace dragging with drop-down
Video Report - Support setShowReport command - skip steps from Video report
This section is relevant only for Cloud Administrators.
To access Cloud Management documentation, you should log in.
In case you do not have credentials please contact email@example.com
Cloud Deployment - Stopping the support for macOS - from 12.12 we will not continue to support the deployment on macOS for the following components:
Region Proxy Manger
We will continue to support Device Host Machine and Selenium Agent on macOS and Windows operating systems
Please see the updated System Requirements (update the requirements for Selenium Agent)
Cloud Deployment on Linux - We plan to support from 20.1 version, the deployment of most of the cloud components on Linux (CentOS / Red Hat Enterprise )
The supported components on Linux (planned for 20.1) are:
Region Proxy Manger
Login to Cloud gives error 'license packages are missing' - Fixed
*Please note that due date and highlights of next release are as anticipated by Experitest on the date of release of current version, and are forward looking statements. Actual due dates and highlights may vary.