How can I decide what to test manually, and what to trust to automated tests?

Posted by bhazzard on Stack Overflow See other posts from Stack Overflow or by bhazzard
Published on 2010-04-14T16:44:30Z Indexed on 2010/04/14 16:53 UTC
Read the original article Hit count: 327

Filed under:

qa

|

automated-tests

|

bdd

|

TDD

|

manual-testing

We have a ton of developers and only a few QA folks. The developers have been getting more involved in qa throughout the development process by writing automated tests, but our QA practices are mostly manual.

What I'd love is if our development practices were BDD and TDD and we grew a robust test suite. The question is: While building such a testing suite, how can we decide what we can trust to the tests, and what we should continue testing manually?

© Stack Overflow or respective owner

Related posts about qa

QA with IBM's Dan Frye: "Everything Has Changed"

as seen on Internet.com - Search for 'Internet.com'
<b>Linux.com:</b> "IBM is celebrating more than a decade working with Linux, and Dan Frye was the co-author of the original IBM corporate strategies for Linux and open source." >>> More
QA with Matt Asay: How Linux is Beating Apple and Much More

as seen on Internet.com - Search for 'Internet.com'
<b>Linux Foundation:</b> "Matt took some time recently to share his perspective with me on why Canonical can take Linux places Red Hat can't, how Linux beats Apple, and how the Ubuntu community's passion and focus on design will change the way people see Linux for a long time." >>> More
DotNetNuke 5.3.1 Version now entering QA.

as seen on Dot net Slackers - Search for 'Dot net Slackers'
With any software product you will occasionally have a release that you wish you could take back. Microsoft had Windows Vista, and Tuesday we had DotNetNuke 5.3.0. We had a couple of significant bugs which slipped through the QA process and which resulted in a major impact to customers. Rather than… >>> More
Simple ‘In-Progress’ Message for Time Consuming Tasks in ASP.NET Pages

as seen on Code Project - Search for 'Code Project'
‘In-Progress’ Message & Disabling controls in ASP.NET Pages using JavaScript >>> More
A training world nugget for being taught by the best

as seen on SQL Blogcasts - Search for 'SQL Blogcasts'
June represents an exciting time for the SQL Server community with events all over the country in the next few months and there is plenty of knowledge to be gained from willing speakers enthusiastically sharing their knowledge. Furthermore, Paul Randall and Kimberley Trip will be conducting their… >>> More

Related posts about automated-tests

Should GUIs have their own automated tests?

as seen on Stack Overflow - Search for 'Stack Overflow'
Is there any reason for automating tests that focus on GUI (and not to things under it)? In my opinion GUI (and changes in it) should always be tested by a real person. >>> More
Disable selected automated tests at runtime

as seen on Stack Overflow - Search for 'Stack Overflow'
Is is posable to disable selected automated tests at runtime? I'm using VSTS and rhino mocks and have some intergation tests that require an external dependancy to be installed (MQ). Not all the developers on my team have this installed. Currently all the tests that require MQ inherit from a base… >>> More
Rescue overdue offshore projects and convince management to use automated tests

as seen on ASP.net Weblogs - Search for 'ASP.net Weblogs'
I have published two articles on codeproject recently. One is a story where an offshore project was two months overdue, my friend who runs it was paying the team from his own pocket and he was drowning in ever increasing number of change requests and how we brainstormed together to come out of that… >>> More
Basics of automated tests?

as seen on Stack Overflow - Search for 'Stack Overflow'
Hi, Till now I've been testing my web (usually written in PHP) as well as desktop applications (normally Java or C#) manually. Now I read somewhere on the net about automated tests. I tried searching to know about it in details but almost all searches end up at things like PHPUnit. Could someone please… >>> More
Automated tests for Java Swing GUIs

as seen on Stack Overflow - Search for 'Stack Overflow'
What options are there for building automated tests for GUIs written in Java Swing? I'd like to test some GUIs which have been written using the NetBeans Swing GUI Builder, so something that works without requiring special tampering of the code under test would be ideal. >>> More