Implementing QA methodologies is a tricky business, especially when it comes to agile or stressful development processes. This week, the TestProject team had the pleasure of interviewing Mr. Sagiv Elmaleh, a director of engineering at Varonis Systems, in order to share his thoughts regarding test automation ROI, KDT and how it has made his organization a successful story.
“… Automated testing isn’t so hard to implement; it is more a perceptional change you have to make.”
– Sagiv. E., Director of Engineering, Varonis.
Varonis Systems, Inc., a software company incorporated in Delaware in 2004, is one of the foremost innovators and providers of access, governance and retention solutions for human-generated data, the fastest-growing and most sensitive class of digital information. Based on patented technology and a highly accurate analytics engine, Varonis solutions give organizations total visibility and control over their data, ensuring that only the right users have access to the right data at all times from all devices, all use is monitored, and abuse is flagged.
Why test automation?
“In general – you reach this point when you don’t have a choice. At first, it might sound like a nice idea and nothing more, but, with the growth of the company and its products, long release intervals couldn’t be accepted. Furthermore, long release intervals for important features or poor quality product have direct impact on the user’s experience and eventually on your business. Our goal was to keep introducing new features and fixing releases in no longer than 2-3 weeks by utilizing a continuous integration process where test automation plays a significant role.”
What test automation tools are used in your organization?
“Since Varonis has a very complex product, we use several test automation tools such as Selenium, TestComplete and Coded UI in order to achieve optimal test coverage. In our labs, we mostly work with internally developed framework to support the build and the continuous integration process.”
Would you recommend using Keyword Driven Testing (KDT) in an agile continuous integration process?
“It’s a good question – test automation is directly related to product development. Nowadays they go hand in hand. We start with developing, and at the very same time we begin writing the tests. Varonis has evolved when it comes to automated testing. We started with KDT, but eventually it became too complicated to use, and we realized that a change had to be made. Personally, I would recommend working with code based frameworks.”
What about test automation ROI and manual testing?
“Manual testing is something that pulls you backwards. When using manual testing, we tended to get very selective (how much and how often you do certain tests); automation can run on demand or every hour of the night in full regression! Automated testing is a long-term investment, and is particularly relevant for companies that are looking to grow quickly. The test automation ROI is truly amazing. For every penny invested, I believe you will receive 10 times more!”