What are the problems with Script-less Test Automation ?


I have come across few tools which call themselves as Scriptless Test Automation tools like Qualitia  , Certify 

Can experienced guys in this field tell me what are Problems and Good things about this concept and tools ?

7 thoughts on “What are the problems with Script-less Test Automation ?

  1. Umm… the whole idea of “scriptless” or “codeless” tests/automation is a bunch of B.S. In some way shape or form you will need to “program” the automated test to do what you need. All these tools do, or try to do, is add a layer of abstraction away from “live” code (programming statements/constructs). Some do a decent job, others don’t.
    Bottom line is that Test Automation (execution) is a form of programming. This is because you construct statements/components (whatever) into a logical process that the computer takes and executes. Even in graphical form the test is a ‘script’ (program). Even the most robust “scriptless/codeless” tool has the capability to add “custom code” (which means programming) when needed.
    So what you are getting is the “Automagic” smoke & mirrors dog & pony show Snake Oil story of their tool. Management eats that crap up, don’t let them because if you’re the poor schmuck stuck with the tool and misconceptions you are being setup for a world of hurt.
    It’s Automation, Not Automagic!

    Regards,

    Jim Hazen
    20+ year veteran of test automation

    Like

  2. Thanks Jim.

    Here are my some points –

    1.According to Wikipedia,

    ” scriptless test automation that does not use record and playback, but instead builds a model of the Application Under Test (AUT) and then enables the tester to create test cases by simply editing in test parameters and conditions. This requires no scripting skills, but has all the power and flexibility of a scripted approach.Test-case maintenance seems to be easy, as there is no code to maintain and as the AUT changes the software objects can simply be re-learned or added. It can be applied to any GUI-based software application.The problem is the model of the AUT is actually implemented using test scripts, which have to be constantly maintained whenever there’s change to the AUT.”
    Let me clear on this – I AM NOT MARKETING ANY TOOL.I asked review on concept.

    2.Experienced testers need to find out if they are fundamentalist or curious about this.There is resistance to any change.My question is that “change” is good or bad ?

    3.What if there one open source script-less tool into market which uses “selenium ” ?

    4.If developers use different wizards to visually design the GUI in the Visual Studio, Why can’t testers use this idea to build test automation ? Good artist copy, great artist steal.I stole it from Steve.

    Like

  3. TOSCA Testsuite (www.tricentis.com) with it’s business dynamic steering provides you with the long awaited paradigm shift in automated software testing: no more programming, instead, automated testing is becoming a business-based discipline. It supports a bunch of different technologies out of the box. Just try it for yourself >>http://gotosca.com/en/tosca/trial

    Like

  4. Riyaj,
    Again, even with the ‘codeless’/’scriptless’ tools you will be building a type of program (set of instructions/steps) for the tool and computer to run. That is the essence of programming. You define steps and logic along with data to perform an action.

    All these tools do is extrapolate a layer away from the actual live code. I’ve seen tools like Worksoft Certify (actually did a small project with it, I still had to go into the Winrunner code to do custom logic, and into the GUI Map to do custom objects) and Tricentis Tosca Testsuite (had a technical demo of it about 3 weeks ago).

    Tosca Testsuite allows you to ‘model’ the tests and associated data, and can ‘generate’ the tests and data according to different types of Combinatorial methods (Pairwise, Orthogonal, etc.) so that you can use the minimal amount of tests to get effective coverage. Along with that you have a tool to capture the objects on the GUI and build out ‘components’ of the functionality so you can piece together an automated test to run. As part of this you can add custom logic/processing as you need. Also, the tool has the capability to do custom coding work for both the components and objects. They have support for multiple technology types. During the demo the System Engineer stated that even with their tool there will be some type of programming needed.

    So again; in some way, shape or form you will be doing programming. Now I have to admit I was really impressed with Tosca Testsuite, mainly because they have created an IDE specifically for defining the tests and test data. And that they use different methods/models for the test & test data generation. This is something that will make testing more efficient, and help to remove some of the tedious grunt work of designing/building tests and data. Plus this can be fed into an automation tool. That is some cool stuff, and about time.

    Like

  5. I am currently facing a situation where any information to this subject is worth to have. I might not be the one to give you answers, but I can tell you to have a “look” at

    Not problems but circumstances and benefits are mentioned byside some integration approach tips.

    Like

  6. Hello,

    I ‘ m also quite impressed and moving towards model based approach of automation testing that will cost us one time on the tool but reap the benefits forever with robust automation and almost minimal to no training during transition should there be any attrition in the company. Currently, looking at both worksoft certify and TOSCA. Could you please suggest more details and if you have any idea on licensing costs as well, appreciate it.

    Like

  7. Consider ZAPTEST (www.zaptest.com). With true visual object recognition technology you can script once and play it anywhere. It can test any application with GUI. It supports cross-browser, cross-platform test automation. Excellent support for Agile. Has free version.

    Like

What do you think about article?

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s