Key Results from The Total Economic Impact of Sauce Labs
Set the SAUCE_BUILD_NAME environment variable as the value of the build desired capability to set the Sauce build name at runtime. This enables you to access your test reports by build in Sauce Labs and view them on the Jenkins Build Details page. In the parameters selection screen, choose the operating system/browser combinations you wish to test for this iteration. This value will override the default $home directory.
They communicate with us quickly, respond quickly, and they tend to be incredibly transparent. If something goes down, I know immediately, and I will already have 40 people in my inbox complaining about it. I can immediately determine whether it’s a Sauce issue, an issue on our end such as an issue at the test level. https://www.globalcloudteam.com/ I work with a lot of different vendors, but the number-one thing about Sauce Labs is their ability to respond to questions. It is hands-down the best I’ve dealt with compared to any vendor. The quickness with which people respond, and the group effort they seem to make when we have questions, help out quite a lot.
API Management and Testing
A particular version might get outdated, so we just go and change it in our code, and it’ll appropriately take that particular version on Sauce Labs. The fact that Sauce Labs was co-founded by the creator of Selenium and was an early mover in cross-browser testing was a big part of their marketing and sales pitch. However, it wasn’t a critical factor in our decision.
I also don’t want to—and God bless them—but they’ve been managing Internet Explorer browsers. The problems I have just trying to get an IE container or browser up and running, so a test can be automated against it, is insane. The fact that Sauce Labs has it down and working fairly well saves us a lot of work and headaches. A lot of that comes from the ability to get teams on board fairly quickly. With the Sauce Labs documentation, everything is made so that it’s very easy for a team to just jump in and start running tests. They have a storage API that lets us retrieve APK and IPA, iOS and Android builds off the phone, so that we can continue testing with CI/CD.
Ready to see how a unified testing platform can help your organization?
You gonna have to maintain the operating system. You gonna have to update browsers and you gonna have to do all of that if you gonna maintain your own nodes. You can have many different nodes and so your task can be getting past to the hub and the hub will determine which node the test should run. You can do something like an app.config or you can use something like a configuration file for the hub. And what I mean by that is that a hub has multiple nodes. So for example, it may have a node that goes out here and node would be another, this will be another virtual machine.
- In general, our test execution speed, time to results, and time to deployment have dropped significantly (by approximately 10%), which is huge.
- If their configuration allows for it then it is definitely something that I recommend they take advantage of.
- Working on OTT devices usually includes testing on desktop browsers or phones/tablets and having all of those supported in one platform would be ideal.
- These instances may have been due to a service outage.
- We’ve also integrated Sauce Labs results with Slack.
- Sauce Labs streamlines the product testing process with one do-it-all service.
They have helped us with our questions and to get through any blockers. Technical support is very important because it helps us get through issues faster. When we are trying to integrate with a new tool, as is the case now because we’re trying to move to GCP, we have a dedicated solution engineer to work with us. The engineer is helping us as we ramp up with GCP, getting our automation to work. Although we are not using visual regression testing, that is something that would be really interesting, because a lot of our media clients want to test visual validations on their apps. If Sauce Labs is offering that out-of-the-box, it would be really interesting for us.
How was the initial setup?
There are tools, IDEs like IntelliJ, that were built for an original purpose and that, for a long time, were really good at that original purpose. But then they started adding so many features, bells and whistles, that all of a sudden what I used to be able to access by just clicking a button required me to go into a sub-menu. Has any of that happened yet with Sauce Labs? And a lot of the solutions they’ve purchased recently make sense to me. Latency, due to Sauce Labs being a cloud-based solution, has been a concern. If you’re not in either of those two places, you would have latency and issues running your test cases.
Taught by Nikolay Advolodin, CEO of ultimateqa.wpmudev.host. He had been teaching test automation for 5 years and is the author of top rated online courses to 50,000 students in over 100 countries around the globe. And the final advantage that I want to talk about Sauce Labs was that it decreases the amount of time to run your full-speeded tests.
Environment Variables
Here’s a list of all 20 tools that integrate with Sauce Labs. With Sauce Labs, we’ve been able to increase our throughput and speed of automation as well as quality. Sauce Labs has been a very stable solution, very high-performant and ready and available to complete our regression tests.
This way, we can get someone to start responding. We have faced challenges with the availability of mobile devices. There was once or twice where there were no What is Sauce Labs mobile devices available. These instances may have been due to a service outage. The parallelization of automated tests is a best practice that I recommend.
Meet our executive leadership team
We are a team of 60, and 20 of us are using this solution. We provide the service, and we utilize this tool to make sure that everything is running fine. We ensure that every product that we get from developers is properly working, and once we certify that it’s working fine, we move it to production for the developers to do their job. It’s easy for us to go in and switch data centers if we need to.
When options can be set at both levels, project settings override global settings. A great way to minimize complexity and reduce boilerplate code for writing Selenium tests with Sauce Labs is to use the Sauce Bindings. You can not have a test without an assertion. Each test should have something specific it is validating and have at least one explicit line of code to ensure that this functionality is working as intended.
How would you rate customer service and support?
Within each of those configurations, we were able to parallelize even further within our test framework, and ultimately, we were able to get the test time down to 33 minutes. For the most part, the product is optimized for automation and integration with the major CI/CD platforms and developer tools. That said, our constant complaint is that it is kind of slow. We are trying to figure out ways that we can work around the slowness, and what things we can do better. One of Sauce Labs’ competitors does not force you to select the data center you want to run against.
