SeeTest 11.0 continues our focus on allowing you to test applications as widely and as early as possible so that you can ensure that customers enjoy great digital experiences. We are also introducing new functionality aimed at helping you be more effective and streamlining application validation processes across teams.
iOS 11 beta is fully supported in all our tools so that you can test your app to make it upgrade-proof, and ready for the GA expected in September 2017.
Developers enjoy rapid feedback on the quality of their code. A new wizard helps plan and schedule tests developed in espresso on SeeTestGrid.
Lastly, SeeTest 11.0 continues our growing support of native Appium and Selenium clients in Appium Studio.
Please note that we have added two new sections to the release notes: Important Notes and Known Issues. These sections contain important information that impacts the behavior of SeeTest tools, so we urge you to read them.
Main Release Highlights:
iOS 11 support
This version allows for side by side and parallel execution of tests on both iOS 10 and iOS 11 Beta devices. Run tests that were developed for iOS 10 devices on iOS 11 Beta devices using Appium Studio or export your test code to your IDE and run such tests in parallel.
Espresso Grid Execution
Android developers can now execute massive unit testing by running espresso tests on multiple devices in the cloud, in parallel. Developers receive rapid and comprehensive feedback on their code, helping them to commit better code.
Grid Execution is an easy to use interface for planning, managing and executing test sessions on numerous remote web browsers and physical devices on the Digital Assurance Lab (SeeTestCloud).
Test Execution Configuration grants users full control over execution management and life cycle. Execution plans can be created, canceled, deleted and run directly from the Digital Assurance Lab. Test Execution Plan also allows the setting of parameters such as device reservation time and test plan timeout.
Grid Execution currently supports espresso. Support for XCUITest will be available in the next version.
Grid Execution online guide
[Digital Assurance Lab (formerly SeeTestCloud)]
Code export for C# and Python
Test scripts created in Appium Studio can now be easily exported using C# and Python, including the import dependencies for Appium and unit testing.
This simplifies the first user flow for those who wish to develop their Appium \ Selenium scripts using Python \ C#.
Appium Studio online guide - code export
Application Management - Rest API
For version 11 - when installing apps from the cloud they will by default be installed as Non-instrumented
We have modified our public REST API for managing and installing applications Docs
To retrieve the old behaivor, you can pass over a parameter in the request body instrument=true
iOS - CPU \ Memory Monitors
SeeTest tools now don't capture device vitals and monitors by default - and users who wish to capture these data throught the lifecycle of the test will need to use startMonitor command or modify the app.properities file
Upgrading to iOS 10.3.3
iOS 10.3.3 presents an issue with iPads where the battery is drained rapidly while running tests on the device. We recommend not to upgrade such devices to iOS 10.3.3
iOS 11 Simulators
SeeTest 11 currently does not support iPhone and iPad simulators that are running iOS 11. Physical devices are supported regardless of this limitation.
Support for iOS 11 Beta
Experitest's suite of tools (Appium Studio, SeeTest Cloud, SeeTestAutomation) now supports iOS 11 Beta. Apps can be tested for compatibility and regression without delay.
AppiumStudio - ChromeDriver Delegation (Beta)
Run existing tests developed using Google's ChromeDriver for Android on Experitest Cloud or local devices without any modifications.
The feature is currently not enabled by default and requires the user to specify the capability in the capabilities set
Appium Studio - Adding custom messages to test report
Appium Studio now allows adding custom messages to the report that is generated at the end of a test. Adding custom messages is done by adding the command
Appium Studio - Support device action for iOS devices
Execute device actions such as home, change volume, switch apps on iOS devices.
|Appium Studio Community Edition - Disable iOS monitoring by default|
Starting from Version 11 iOS monitoring is disabled by default. It can be enabled by adding the line
|Omit the need to specify report capabilities in Appium Studio||Appium Studio will default to a set of report capabilities if such were not configured in the desired capabilities prior to executing a test.||Improvement|
iOS Remote Debugging - Generate symbols for XCode
|When first connecting an iOS device for the purpose of debugging, XCode generates a symbols folder in order to developers to debug the application. SeeTestRemoteDebugging offers the option to automatically generate these symbols, allowing testers to start debugging immediately.||Improvement|
Web Context - Retrieve all properties for web elements
|When in web context and retrieving web dump, the dump will include all properties and attributes that were configured for all HTML elements.||Improvement|
|iOS Remote Debugging - Allowing a remote debugging session in single port configuration|
Remote debugging sessions with iOS devices can now take place even if the Cloud Server is configured to a single port.
SeeTestGrid - waking device when a test starts running in the grid
|Preventing tests from failing in case the device was locked at the time of initiating the test and creating the test request in the grid.||Improvement|
|SeeTestManual / SeeTestAutomation for Web - Device disconnected message indicator||When working with devices in the cloud, if a device was disconnected for any reason then a device disconnected indicator message would appear for the tester.||Improvement|
|Appium Studio / SeeTestGrid - Allowing remote test execution using Access Key|
When running tests in the cloud grid using Appium Studio, an access key can be used instead of username and password combination.
|Appium Studio - implicitly_wait() not implemented for Python client||Adding missing implementation of the implicitly_wait method.||Bug|
|Appium Studio with Java Client 5.0.0BETA - Unable to create a new Android Driver||Making sure that the testing Android devices is possible with the latest Appium Java Client.||Bug|
|Appium Studio - send_keys in Python client doesn't work||Fixing the send_keys method for Python||Bug|
|Appium Studio with iOS Simulator - Setting Simulator using UDID fails||Making sure that an iOS device simulator can be recognized and connect to using Appium Studio.||Bug|
|iOS - Multiple WebViews - WebElements are misaligned in instrumented application||Fixing web element misalignment in instrumented hybrid apps.||Bug|