To describe lessons learned about the process of designing effective tasks for digital library user tests.
Illustrated examples are drawn from eight separate user tests run over the course of three years during development of Variations2, the Indiana University digital music library.
Four major considerations for effective task design are described and illustrated. Areas explored include iterative task development, design of authentic activities, recruitment of authentic users and how to deal with unrealistic testing scenarios.
Lessons learned in task design are matched with examples that illustrate how to balance real‐world constraints with ideal testing conditions to gather useful results.
User tests that consider a balance between real‐world constraints and ideal conditions are more apt to provide useful design ideas for complex systems such as digital libraries. Practitioners may use these guidelines to develop and run their own effective user tests.
