Showing posts with label Criteria. Show all posts
Showing posts with label Criteria. Show all posts

Wednesday, October 8, 2008

Criteria for Automation

Criteria for automating
There are two sets of questions to determine whether automation is right for your test case:

Is this test scenario automatable?
Yes, and it will cost a little
Yes, but it will cost a lot
No, it is no possible to automate

How important is this test scenario?
I must absolutely test this scenario whenever possible
I need to test this scenario regularly
I only need to test this scenario once in a while


If you answered #1 to both questions – definitely automate that test
If you answered #1 or #2 to both questions – you should automate that test
If you answered #2 to both questions – you need to consider if it is really worth the investment to automate

What happens if you can’t automate?
Let’s say that you have a test that you absolutely need to run whenever possible, but it isn’t possible to automate. Your options are
>Reevaluate – do I really need to run this test this often?
>What’s the cost of doing this test manually?
>Look for new testing tools
>Consider test hooks