One thing that I find about testing: QA can never test the application as deeply and easily if they do not have access to the code. Black box testing only gets you "so far", but for efficient testing White Box is the way to go.
Let's take an example: for most java projects have property files for the message resources so you can easily swap out the different languages you are using for your app. I think that it's impossible (or nearly so) if you do not have access to the files themselves to test for things like: duplicate keys; keys existing for all the languages you are supporting; or (this was new to me) if you have a space after the line continuation char (\) and the java property file reader doesn't pick up the next line.
I just don't know how any developers can rely on a QA department that is doing manual black box testing. Ultimately it's a developer's responsibility to ensure that things are working correctly, so why would you not have them do the testing?
Weird, trackbacks aren't displayed on this page (just on the TrackBack link above). Here's my response to this post:
ReplyDeletehttp://www.ryanlowe.ca/blog/archives/001392_the_agile_white_box_tester.php
Good post Jim!
I think you're title is a little off, but the basic idea is right. Black box testing will only get you so far. Without being able to see the code. Once you are aware of what the code is doing, and how it works, you can think of a lot more ways in which to break it. However, blackbox testing is also important, because sometimes blackbox opens up other issues that may not have appeared in white box testing. Maybe it was a specific order in which things happened. Maybe it was something that you hadn't thought of. Which brings up the best way to test. Get lots of people to test stuff. Not just one person. A single person will only think of so many ways to test stuff. This is why many bugs show up in software, after you release it, and millions of people are using it.
ReplyDeleteOh, the title should be, there's no substite for white box testing. And speaking of bugs, why doesn't this blog save my personal info, even when the radio button is set to yes?
ReplyDeleteThis all sounds like a bunch of "white-box supremacist's" stuff. I am appalled.
ReplyDeleteSchnell!
ReplyDelete