You can also try to whitelist our test environments’ Ip address but that would be a wide range of IP list and network engineers wouldn’t be happy about it.

Testinium Virtual Tunnel is a jar package that can be launched by a console application. You can also use CLI to run a Tunnel.

Downloading The Client
You need to go to https://testinium.io/user/account/tunnel and download the jar file.

Creating a Tunnel Connection

Testinium Tunnel’s page allows you to create a Tunnel Connection. Select “Create Tunnel” and you’ll be welcomed by the “Create Tunnel” page. There are 2 fields that you need to fill out.

Direct Domains field is for domains that you don’t want to reach via Testinium’s Tunnel like a 3rd party application that runs behind your application (ex: Google Analytics, Hotjar, etc..).
Think about a page where Google Analytics sends analytics data to Google servers. As those requests will be sent to Google’s production servers, there’s no need to send those requests through the tunnel. You need to separate each domain by using a comma. Then you need to give a name to that Tunnel. Finally, the last step is to enable the tunnel.

Now your tunnel is created. When you save this information, you will receive a Tunnel ID on the previous page.

Running the Tunnel

When you download the client, it will be a zip file containing all the components to run the jar file. The JAR file is in the lib folder.
There are two ways of running the Tunnel.

Command Line Interface

By using below command, you’ll be able to run a specific Tunnel. To get your username and Testinium access key, just go to Testinium Profile page by following this link:https://testinium.io/user/profile

java -jar tunnel-cli-1.2.jar -u username -p TestiniumAccessKey -t TunnelId

After running the command, you need to see below logs. This means that the Tunnel has started successfully.

Tunnel as Application

You can also run the Tunnel as a command line application by using the command below
Java -jar tunnel-cli-1.2.jar
Then you will be welcomed by the screen below

You can enter your credentials and select the specific tunnel by following the commands.

Ok, now everything is set up. The tunnel is created and Tunnel application is running. The last thing we should do is adding our Tunnel ID as a “Desired Capabilities” to our Selenium or Appium code.

Adding Tunnel to Desired Capabilities

In order to run your test in Testinium’s Selenium Grid, you need to add some desired capabilities. Those capabilities include the browser name, browser version and other supporting information about the test environment. To be able to proxy our request to Testinium VPN Tunnel, you need to add one more desired capability.

Below you can find the sample test code to create a RemoteWebDriver.

WebDriver driver = null;

DesiredCapabilities capabilities = new DesiredCapabilities();
capabilities.setCapability("key", KEY);
capabilities.setCapability(CapabilityType.PLATFORM, "LINUX");
capabilities.setCapability(CapabilityType.BROWSER_NAME, "firefox");
capabilities.setCapability(CapabilityType.VERSION, "64");
capabilities.setCapability(CapabilityType.TAKES_SCREENSHOT, true);
capabilities.setCapability("recordsVideo", true);
capabilities.setCapability("screenResolution", "WXGA_P");
capabilities.setCapability("testinium:tunnel.id", "8fda76d3s-089a-42e7-9c9c-fe9293232692");

try {
driver = new RemoteWebDriver(new URL("https://hub.testinium.io/wd/hub"), capabilities);
} catch (MalformedURLException e) {
e.printStackTrace();
}

Happy Testing with VPN Tunnel.

Here is the documentation: Testinium Public APIs

Also, you can use Jenkins plugin manager to install Testinium Plugin.

You should click “Install without restart” or “Download now and install after restart” button to install the plugin. We suggest restarting after installation. You will see such an information screen after installation successfully completed.

1. Collect your access key from Testinium. Go to your profile page and copy it.
   
2. Add new Jenkins credentials for Testinium
   
3. Go to Manage Jenkins > Configure System > Testinium Plugin and paste access key and select valid credentials.
   

Congrats you’ve set it up successfully!

It has two required fields, you must select a project and a plan.

Now your test plan going to be executed each Jenkins run. You can see a sample execution below.

You can see details of execution in Jenkins.

You can see the advanced report of execution in Testinium.

Additionally, Testinium provides classical test automation concept as well. You need to simply switch to AUTOMATED TEST section from the top menu.

Configuration

Java, C#, Python, Ruby or NodeJS all languages are supported by Testinium and your DesiredCapabilities code get ready instantly. So, you can run your local test scripts securely in Testinium device farm in a few seconds.

Reports

Results of Automated runs can be accessible via Reports tab based on each run. Testinium does record both video and screenshots.

IDE has two main parts; file project tree and editor. You can simply surf the tree by clicking folders.

Project Tree Actions

You have 3 simple actions on the project tree as creating a new file, renaming the file and deleting.

Creating a new file; Click the folder which includes the file you want, then right-click and choose “New File”, type the file name and extension (Ex. test.java) and lastly, press OK. That’s it!

• “New File”
• “Rename”
• “Delete” these 3 functionalities automatically update project repository (commit).

Tabs

Each file on the project tree has its own tab in the IDE. So you are limited to access 5 tabs at the same time. Simply click “X” to close the tab you want.

AutoComplete

.feature (Cucumber or Specflow), .spec or .cpt (Gauge) files have autocomplete options. All you need to do is press “cmd” + ”space”. This pops up a smart window which autodetects files in the project and recommends ‘steps’ to you. Also, you can navigate by keyboard and click /select the desired one.
Other file types are also supported by the autocomplete feature. However, ‘steps’ are not as clearly stated as above formats.

Saving

Next, to the tab that belongs to the modified file, a ‘*’ sign is placed. This means that the update has not been saved yet.
Changes can be undone with ‘Ctrl-Z’ combination. Each time when this combination is used, the cursor on the editor goes to the point where the change is made and the change is undone.
The changes in the editor are kept on a file basis and the changes made in each file are saved by pressing the ‘SAVE’ button while the file is open on the screen.
For each change, a separate commit is made to the relevant repository.
If no change is made in the opened file, the SAVE button will be passive and no action will be taken when it’s pressed.

Using the detailed reporting option in Testinium, you can examine the results of your suite runs.

• Project; Select one of the projects in your account and easily find any report by using the filter.
• Suites; Select the suite that you wish to look into.
• Run Date; View all your runs between the two specified dates.
• Show only failed tests; View only the reports of the failed tests.
• Export Table; Extract the report result.

• Details; You can get detailed analysis for each suite run.
• You can analyze the details of the report by using Command, Video, Executor Log and Selenium Log tabs.
• Previous Results; You can analyze the previous runs of the same scenario by using this feature and compare the results.

On the fast menu, you can easily update your test suite, delete it or run it manually.

You can click on the RUN button manually to start your test suite.

Your suite will start running according to the settings that you have identified (the scenarios that you’ve selected, the environments that you’ve set and etc.)

If there are bugs in the results of your automatic suites, the Rerun button will be activated automatically. This option allows you to rerun only the failed tests in your suite.

Select A Project; Prepared scenarios should be associated with the projects that you have created in Testinium. When you select your project, the SELECT SOURCE FILE field in the number 2 spot will be filled automatically.
Scenario Name; The name that you’ll give to your scenario.
A Scenario of Suite; The scenarios that belong to the project are listed and selected in this area.

The scenario of Order; You can create a working order for your scenarios.
Platform Selection; You can pick the environment in which you wish to run your tests. The list will be updated automatically in accordance with web or mobile projects.

Step 2: Advanced Settings

There are many advanced settings in this step.

Failed Test Retry Count; It contributes to the accuracy of your test results. You can run your malfunctioning scenario for any reason up to 3 times without splitting the stream in the test suite and you can be confident in the accuracy of the current bug.
Parallel Test Limit; Your account’s parallel test limit can be allocated to Test Suites, so you can improve your productivity.
Max Execution Time Per Scenario; You can set a max time limit for your current scenario runs and easily identify problems like infinite loop especially resulting from test code.
Bandwith Type; Testinium lets you choose different network types to simulate network behavior by simulating the bandwidth and network delays. There are many options:
Wifi
3G
5G
LTE
CABLE
etc…

They all have different bandwidth and network delay values. In case nothing is selected, by default Wifi is set to all engines.

Screenshots; You can get screenshots of your test scenario steps automatically.
Record Video; You can automatically record a video of your test scenario.
Capture Performance Data; You can gather reports on your pages’ performance metrics during test runs.
Tunnel,

In addition to all these features, you can assign a value from Testimonial interface to a dynamic variable that you will define in the test code. By doing so, you can execute more flexible test runs without changing your test code.

Step 3: Schedule & Notifications

You can run the test suites that you prepared manually or by setting a schedule.

If you wish to execute a run repeatedly, you only need to select the start and end dates. Moreover,
you can also get a smarter automatic run by entering the run period and day information.

After the run, you can get notifications by e-mail and you can customize notification types according to the results of the reports.