In my earlier post, I support idea of being Script-less can help the testing industry. The idea behind this is really simple. Manual testers, SME’s will work in Graphical environment, can use simple English language while building scripts as there are built in libraries to support their work.
While this may seem nice and easy to imagine, this may not be the case while being practical. I shared experiences with automation testers and came to conclusion that there are some important things to consider:
We still need Script monks to support our work: Script less environment works on ‘Keywords’, which are simply another scripts. Those scripts need to maintain and keep consistent with change in product
Choice of tool to automate: This is an important task. Tool must be choose based on factors like Capability, Reliability, and Capacity. Learnability, Operability, Performance, Compatibility, Non-Intrusiveness. Refer Test Automation Snake Oilby James Bach. Download demo first. Doing a small pilot project for choice of tool is a good idea. Test tools often have bugs that matters to us.
Automated regression tests find a minority of bugs: (Lesson 110): James reported regression tests find about 15%of total bugs reported in his extensive work as tester. Regression functional tests find less than that. Those find more bugs during test development than executing tests later. Regression test will be more effective to find defect when we reuse them in different environment.
I thank Mr.Phil Kirkham from Expected results mentioning important problems coming in process.
1. Lessons learned in Software Testing by Bach,Caner and Pettichord.
2. Test Automation snake oil, Bach(1999)
3. Software test automation by Fewster and Graham