Page tree

Overview

SeeTest 11.0 continues our focus on allowing you to test applications as widely and as early as possible so that you can ensure that customers enjoy great digital experiences. We are also introducing new functionality aimed at helping you be more effective and streamlining application validation processes across teams.


iOS 11 beta is fully supported in all our tools so that you can test your app to make it upgrade-proof, and ready for the GA expected in September 2017.
Developers enjoy rapid feedback on the quality of their code. A new wizard helps plan and schedule tests developed in espresso on SeeTestGrid.

Lastly, SeeTest 11.0 continues our growing support of native Appium and Selenium clients in Appium Studio.

Please note that we have added two new sections to the release notes: Important Notes and Known Issues. These sections contain important information that impacts the behavior of SeeTest tools, so we urge you to read them.


Contents:


Main Release Highlights:



iOS 11 support

This version allows for side by side and parallel execution of tests on both iOS 10 and iOS 11 Beta devices. Run tests that were developed for iOS 10 devices on iOS 11 Beta devices using Appium Studio or export your test code to your IDE and run such tests in parallel.

 

[All products]




Espresso Grid Execution

Android developers can now execute massive unit testing by running espresso tests on multiple devices in the cloud, in parallel. Developers receive rapid and comprehensive feedback on their code, helping them to commit better code.

Grid Execution is an easy to use interface for planning, managing and executing test sessions on numerous remote web browsers and physical devices on the Digital Assurance Lab (SeeTestCloud). 

Test Execution Configuration grants users full control over execution management and life cycle. Execution plans can be created, canceled, deleted and run directly from the Digital Assurance Lab. Test Execution Plan also allows the setting of parameters such as device reservation time and test plan timeout.

Grid Execution currently supports espresso. Support for XCUITest will be available in the next version.


Grid Execution online guide


[Digital Assurance Lab (formerly SeeTestCloud)]




Code export for C# and Python


Test scripts created in Appium Studio can now be easily exported using C# and Python, including the import dependencies for Appium and unit testing.
This simplifies the first user flow for those who wish to develop their Appium \ Selenium scripts using Python \ C#.
Appium Studio already supports writing test scripts in ALL of the existing Appium clients. Code export to additional languages such as Javascript and Ruby is in process.


Appium Studio online guide - code export


[Appium Studio]





Important Notes

Application Management - Rest API

For version 11 - when installing apps from the cloud they will by default be installed as Non-instrumented

We have modified our public REST API for managing and installing applications Docs

To retrieve the old behaivor, you can pass over a parameter in the request body instrument=true

iOS - CPU \ Memory Monitors

SeeTest tools now don't capture device vitals and monitors by default - and users who wish to capture these data throught the lifecycle of the test will need to use startMonitor command or modify the app.properities file 

// to enable monitors by default
monitoring.disable=false



Known Issues 

Upgrading to iOS 10.3.3

iOS 10.3.3 presents an issue with iPads where the battery is drained rapidly while running tests on the device. We recommend not to upgrade such devices to iOS 10.3.3

iOS 11 Simulators

SeeTest 11 currently does not support iPhone and iPad simulators that are running iOS 11. Physical devices are supported regardless of this limitation.


Additional Changes

Summary

Description

Issue Type

Support for iOS 11 Beta

General improvement

Experitest's suite of tools (Appium Studio, SeeTest Cloud, SeeTestAutomation) now supports iOS 11 Beta. Apps can be tested for compatibility and regression without delay.

Improvement

AppiumStudio - ChromeDriver Delegation (Beta)


ChromeDriver


Run existing tests developed using Google's ChromeDriver for Android on Experitest Cloud or local devices without any modifications.

The feature is currently not enabled by default and requires the user to specify the capability in the capabilities set

DesiredCapabilities dc = new DesiredCapabilities();
dc.setBrowserName(MobileBrowserType.CHROME); // Setting up Chrome as the mobile browser type will pick up ChromeDriver service
driver = new AndroidDriver(url, dc);

Appium Studio - Adding custom messages to test report



Appium Studio now allows adding custom messages to the report that is generated at the end of a test. Adding custom messages is done by adding the command

 driver.executeScript("client:client.report(\"This is a custom message inserted into the test report.\", false)", "");

Custom Report

Improvement

Appium Studio - Support device action for iOS devices


Execute device actions such as home, change volume, switch apps on iOS devices.

Device Actions

Improvement
Appium Studio Community Edition - Disable iOS monitoring by default

Starting from Version 11 iOS monitoring is disabled by default. It can be enabled by adding the line

monitoring.disable=false

to Appium's app.properties file.

Improvement
Omit the need to specify report capabilities in Appium StudioAppium Studio will default to a set of report capabilities if such were not configured in the desired capabilities prior to executing a test.Improvement

iOS Remote Debugging - Generate symbols for XCode

Remote Debugging

When first connecting an iOS device for the purpose of debugging, XCode generates a symbols folder in order to developers to debug the application. SeeTestRemoteDebugging offers the option to automatically generate these symbols, allowing testers to start debugging immediately.Improvement

Web Context - Retrieve all properties for web elements


When in web context and retrieving web dump, the dump will include all properties and attributes that were configured for all HTML elements.Improvement
iOS Remote Debugging - Allowing a remote debugging session in single port configuration

Remote debugging sessions with iOS devices can now take place even if the Cloud Server is configured to a single port.

Remote Debugging

Improvement

SeeTestGrid - waking device when a test starts running in the grid


Preventing tests from failing in case the device was locked at the time of initiating the test and creating the test request in the grid.Improvement
SeeTestManual / SeeTestAutomation for Web - Device disconnected message indicatorWhen working with devices in the cloud, if a device was disconnected for any reason then a device disconnected indicator message would appear for the tester.Improvement
Appium Studio / SeeTestGrid - Allowing remote test execution using Access Key

When running tests in the cloud grid using Appium Studio, an access key can be used instead of username and password combination.

dc.setCapability("accessKey", "kldfljvdfkljgkl4235jk66546") //access key
Improvement
Appium Studio - implicitly_wait() not implemented for Python clientAdding missing implementation of the implicitly_wait method.Bug
Appium Studio with Java Client 5.0.0BETA - Unable to create a new Android DriverMaking sure that the testing Android devices is possible with the latest Appium Java Client.Bug
Appium Studio - send_keys in Python client doesn't workFixing the send_keys method for PythonBug
Appium Studio with iOS Simulator - Setting Simulator using UDID failsMaking sure that an iOS device simulator can be recognized and connect to using Appium Studio.Bug
iOS - Multiple WebViews - WebElements are misaligned in instrumented applicationFixing web element misalignment in instrumented hybrid apps.Bug
  • No labels