Monday, April 21, 2014

Beta Testing, Not the Same as Usability Testing

Dilbert.com
Using Beta Testers to Find the Flaws in a Product


Beta testing is not the same as usability testing. They are similar, but not the same. Usability testing is done in an environment when you are still trying to figure out the direction of your website or app. A usability test in that instance gives you some direction in which to head. When you are in beta testing, you should already have an idea of where your website or app is heading. All that should be left to do is finding bugs and making small tweaks to the design, if any. 

Usability (Testing Environment) vs Beta Testing (User's Own Environment)

Usability Testing Goals
Beta Testing Goals
Decide what platforms you are optimizing for
Users report issues that they have
Decide what works and does not work for your design
Very limited design changes
The test is done in a lab, so the person observing the test can observe where the user is having difficulty
Fix issues with broken code
Fix any design issues before writing any code
Test is done in the comfort of the user’s own environment
The tester is able to ask the subject about issues they had with the design

The tester is able to observe the body language of the subject



Beta Testing Cycle

As can be shown from the cycle above, the outcome for usability and beta testing are similar. The end goal of both test is to better the project. While usability testing focuses on the interaction with the product, beta testing focuses on coding problems. Beta testing is a highly recommended step in making websites and app making. Beta testing allows you to catch errors before your product is out in the open. The goal of beta testing is not to get rid of all the bugs in your code, that is not practical. What is practical though is flushing out as many bugs as you can.

If you are trying to do beta testing, here is a website that gives you some tips on how to conduct a beta test: Beta Testing Tips


Sources: 
  1. "Beta Testing." Web Development,web Designing and Internet Marketing Firm. N.p., n.d. Web. 21 Apr. 2014.
  2. Carter, Breck. "SQL Anywhere." : August 2011. N.p., 24 Aug. 2011. Web. 21 Apr. 2014.
  3. "Recording Usability Tests on the IPhone." :: Capstrat. N.p., n.d. Web. 21 Apr. 2014.
  4. Richmond, Nadyne. "Go Ahead, Mac My Day." Beta Testing vs Usability Testing. N.p., 5 Apr. 2010. Web. 21 Apr. 2014.
  5. Spolsky, Joel. "Joel on Software." Top Twelve Tips for Running a Beta Test -. N.p., 2 Mar. 2004. Web. 21 Apr. 2014.
  6. Thadani, Rahul. "How to Become a PS3 Game Tester." Buzzle. Buzzle.com, 15 Apr. 2011. Web. 21 Apr. 2014.

2 comments:

  1. A very good survey on the difference between Usability Testing and Beta Testing. Maybe a few of your own experience with this could be interesting to the readers. I like the cycle image and your table. It makes more sense to me when I look at your table and figure out the differences. You could explore more on the benefits of beta testing to the users.

    Your post is well documented. I hope to see more on the how beta testing can help your project become better, or any problems you are facing as a developer when you beta test it.

    Glad to read your post.

    ReplyDelete
    Replies
    1. Thank you for the comments Phuc. I would have liked to use some real examples of that, but I do not have any with me that I can show. I have participated in a couple of Beta games, but that is not my own intellectual property. I think the differences between Usability and Beta testing become very clear when you start listing out what each one wants to achieve. At first I was unclear about how they were different but as I did more research on the topic it became more clear. When all else fails I try to do tables because it helps me conceptualize the idea.

      Delete