What Do People Think of Your Site Design? Here's How To Find Out.
- Test Plans at a Glance
- Creating Test Plans
- Presenting Test Plans
- Test Plans in Context
This chapter is from the book
This chapter is from the book
This chapter is from the book
yū'-s
-bil'-a-tē test' plan'(n.)The usability test plan describes the goals, method, and approach for a usability test. The test plan includes several different components, from profiles of participants to an outline of a discussion with users. The test plan described here incorporates test objective, test logistics, user profiles, and the script.
Usability testing is an essential part of the web design diet. In a nutshell, it's a technique for soliciting feedback on the design of a web site. Usability testing is usually conducted on one participant at a time, and attempts to have participants use the site in as close to a real-world setting as possible. Different people have different approaches to usability testing but two things remain consistent—the documents describing what you will do during the test (the plan) and what came out of the test (the results report). This chapter describes the test plan—the document you prepare in advance of testing—and the next chapter describes the report.
There are several aspects of a usability test that need planning, and some people give each its own document. Other usability researchers create a single test plan, addressing all aspects of the test in a single document. This chapter will treat usability test plans as single documents, but will indicate where you might split the document if you need to have several deliverables.
Test Plans at a Glance
Test plans contain three main types of content: the purpose of the test, the logistics and methodology, and the script.
Unlike some of the other documents in this book, the test plan is usually long because it needs to be explicit about your method and what you're going to ask participants.
)
Figure 3.1 This table of contents for a simple test plan shows the high points: objectives, logistics, and essential scenarios. This plan may be appropriate for an informal test with a handful of users.
)
Figure 3.2 When usability tests become more complex, so, too, must their plans. This test plan has separate sections for facilities, methodology, and user profiles. It also distinguishes between user profiles—high-level descriptions of the target audience—and the screener, as well as from a series of questions for recruiting participants. Finally, this test plan also has two sets of scenarios, one for each group of users.
Challenges
Though planning a usability test is fraught with challenges—logistical decisions, keeping the scope of the test in check, varying the script for different user groups—the main challenge with the test plan itself is creating a multipurpose document. This document will be used for discussing the plan with stakeholders and team members, and for conducting the actual test.
Perhaps the easiest way around this challenge is to prepare two separate documents—the test plan and the test script. Preparing two documents, however, comes with its own set of risks. Two documents means related content in two different places and two version histories to track. Perhaps these are trivial issues for you. Over the years, however, I've found it easier just to combine the documents.