Top

Design Research Methods for Experience Design

Research That Works

Innovative approaches to research that informs design

A column by Michael Hawley
January 22, 2009

There is a trend among some in the UX community to take the U out of UX and refer to our discipline simply as experience design. One reason for this change in terminology is that it lets us talk about a specific target audience in terms that resonate with business stakeholders more than the generic term user—for example, customer experience, patient experience, or member experience. The other reason for using the term experience design rather than user experience design is that it recognizes the fact that most customer interactions are multifaceted and complex and include all aspects of a customer’s interaction with a company or other organizational entity, including its people, services, and products. Customer interactions encompass much more than the usability of a particular user interface. They include all of the social and emotional consequences of a customer’s interaction with an organization or brand, including trust, motivation, relationships, and value.

But if the name of the discipline is evolving and the focus of design is expanding, does that mean the design methods are different? Are traditional usability and user-centered design activities useful for gaining insight into the broader implications of the emotional impacts of a design? Or do we need different approaches? To explore these questions, it is helpful to look at the strengths and weaknesses of two existing alternative design approaches:

  • user-centered design
  • genius design

Champion Advertisement
Continue Reading…

One End of the Spectrum: User-Centered Design

The activities and methods of a traditional user-centered design process vary somewhat among practitioners, but the basic components are similar. User-centered design typically involves an element of research with the target audience and an iterative design process that lets UX professionals analyze designs and test them with representative users. The idea is to generate ideas for design by talking to potential users, then validate the resulting designs through real-world tests with those same users. Common techniques that are familiar to practitioners include task analysis, contextual inquiry, paper prototyping, card sorting, the creation of personas, and usability testing.

By focusing on user tasks and goals, user-centered design reduces users’ learning curve for a product and leverages their existing knowledge to maximize usability and value. We have traditionally judged the success of products that result from a user-centered design process by their learnability, efficiency in use, and the satisfaction that results from a user’s experience with a product.

While user-centered design’s success in developing usable systems justifies its popularity, there are several arguments against it. First, some doubt the value of the user-centered design process and question the investment of the time and resources a team needs to complete a range of research and testing activities. They point to successful designs that were developed by talented designers, applying only minimal user research at the outset of a project. This sentiment is especially prevalent among business owners, who feel they already understand the needs and goals of their target audience. Second, while listening to users within a research context helps make designs more usable and efficient to use, many question whether it leads to new thinking or innovative ideas. Users are not designers, and they are rarely good at thinking of creative design solutions to their problems. Relying too heavily on users’ suggesting solutions during the research or design phases of a project may steer well-intentioned designers in the wrong direction. This argument reminds me of the spoof video in Figure 1, which shows what the iPod packaging would have looked like if a team at Microsoft had designed it by listening to requirements and suggestions from customers.

Figure 1—Microsoft designs the iPod packaging
Microsoft design iPod packaging

For experience design, the second argument is particularly relevant. If users aren’t good at telling us what they want with regard to features for a design, they are likely not suited to talking directly about their emotional response to a design or the impact of their experience with an organization as a whole. Researchers and designers who focus too closely on what users ask for and who too rigidly follow a set process may not have the flexibility to see creative solutions that would meet the broader emotional requirements of a customer’s entire experience.

Finally, while increasing the efficiency and effectiveness of a user interface design through user-centered design are desirable goals, the needs of many user interfaces today are broader, incorporating social and human elements that go beyond usability.

The Other End of the Spectrum: Genius Design

An alternative to user-centered design is what some have called genius design. This approach to design forgoes user research and the iterative design and testing cycles of user-centered design in favor of relying on the skills of talented designers. The idea is that if a good designer focuses on solving users’ problems, the designer can use his or her skills to generate creative solutions without introducing the bias of users’ prior experience. This approach obviously requires fewer resources for user research and usability testing, and its intent is to develop unique solutions to specific user problems.

Proponents of this approach point to the success of innovative products and companies that leverage minimal user research in the design process. The success of the first Palm Pilot is an example. Jeff Hawkins, the creator of the Palm Pilot, spent most of his budget for the project on development and production of the product and had limited time for user research. He did develop a wood block prototype for himself, but there was limited time for user research and usability testing. The success of the product was credited to his adherence to his original vision for its design.

Figure 2—Original version of the Palm Pilot
Original Palm Pilot

As one might expect, user-centered design advocates see several problems with the genius design approach. First, while examples of successful genius design are available, not all designs that result from a process involving minimal user research are successful. Even a great designer usually tries several unsuccessful ideas before developing one that actually works. The Palm Pilot is an example of this. Have you heard of the GRiDPadSize or the Zoomer? Likely not. Neither of those products was commercially viable. Both were hand-held PDA projects Jeff Hawkins was involved in before the Palm Pilot.

Many organizations cannot afford to risk the failure that might result from pursuing such projects or designs and point to user-centered design as a way of increasing their chances of success. Second, and most relevant to experience design, even if talented designers are adept at solving user problems, how can they be sure they are solving the right problems? Making assumptions about user problems and needs often results in product designs that don’t satisfy the needs of their intended audience. Similarly, users’ emotional response to a design may not align with the designer’s expectations.

Alternative Methods to Design Research for Experience Design

New methods and approaches for experience design merge the best of traditional user-centered design and genius design. The goal is to obtain insight into the attributes of an experience that would help or delight people based on research evidence. However, the process does not rely on following exactly what users say during research interviews and instead leverages the talent and imagination of designers to look beyond what users are saying to envision creative solutions. The goal is empathetic design, or experiencing a solution as a user would.

To enable this approach, designers can consider some alternative approaches to traditional research interviews and conceptual modeling. These techniques represent extensions to both the traditional user-centered design approach and the genius approach. The list of techniques I’ll describe here is not exhaustive, and these techniques may not apply to all design situations—rather they offer options for those looking to expand their approaches to user research.

  • storytelling and personalization
  • triading
  • games

Personalization and Storytelling

Asking user research participants directly about their needs and goals is subject to biases and filters that may limit our insights into users’ social and emotional needs. Experienced interviewers who recognize this danger can potentially read between the lines and make their own judgments about participants’ feelings, but that approach can be error prone. However, by leveraging personalization and storytelling techniques, researchers can gain insights into users’ personal motivations and perspectives.

Personalization and storytelling involve asking participants to give human characteristics to user interfaces, designs, or concepts, then relate their own stories about their interactions with the personalized entity. Researchers can be creative with the possibilities here—for example, a researcher could ask participants to

  • give a name and a face to their ideal personal assistant and describe a particular interaction with that assistant
  • say what person their phone is most like
  • describe a competition between two different Web sites

At first these types of questions may seem silly or not applicable, but given the right context, they let participants explore different situations without imposing the filters they might apply to their own experiences.

By giving user interfaces names and personalities, participants can help researchers understand the characteristics that are important to them for a product in a particular domain. In addition, the relationship participants describe between themselves and a concept can give us insights into the social and personal aspects of their experience in the context of an interaction. These insights can help designers understand the emotional impacts of different design options.

Triading

In typical user research interviews, a researcher asks participants about their thoughts on a defined list of topics. The disadvantage of this approach is that the researcher may be inquiring about topics that are of little value or significance to the experience of the participants. Generally, participants will dutifully answer questions about any topics we ask them about, without thinking more broadly, going beyond the limits our questions impose, or interrupting us to tell us about dimensions that may be more relevant to them. Participants assume researchers are interested in studying the particular topics they’ve included in their interview scripts and don’t raise other issues that might be more pertinent to their overall experience with a product or potential design.

Triading is a method that allows a researcher to uncover dimensions of a design space that are pertinent to its target audience. In triading, researchers present three different concepts or ideas to participants and ask them to identify how two of them are different from the third. Participants describe, in their own terms, the dimensions or attributes that differentiate the concepts. Participants follow this process iteratively—identifying additional attributes they feel distinguish two of the concepts from the third until they can’t think of any other distinguishing factors. By repeating this process across multiple participants, researchers can see trends that define audience segments or personas.

The benefit of this process is that it uncovers dimensions of a particular domain that are important to the target audience rather than the researcher or designer. In addition, the dimensions participants identify are generally emotional aspects that it is important for experience designers to consider. For example, participants may describe differences in groups as “warm” versus cold” or business-like” versus fun.” Designers can then use the most relevant or common dimensions as inspiration for further design and exploration.

Games

Another way to break free of the rigidity of traditional research interviews is to involve participants in games that are oriented around the domain of interest. During a traditional interview, participants know they are supposed to answer questions, and the formality of the proceedings can limit the creativity and expressiveness of their responses. Positioning research as a game can ease the stress on participants, promote their involvement and engagement with the subject, and make them less reserved in their responses.

In addition, participants’ behavior in the course of a game can give designers insights into aspects of the target audience that are difficult for participants to talk about directly. For example, their behavior in time-stressed environments, emotional reactions to new concepts, natural patterns of language, and motivational drivers are all elements that are important to experience design, yet all of these are difficult to uncover using standard interview questions.

Games are particularly helpful when examining issues of communication. In a research setting, a game provides motivation for two or more participants to talk, chat, or interact in a natural way, allowing designers to understand what elements of communication align with users’ existing systems. Their interaction during a game also exposes the implications of and users’ emotional reactions to social environments that it may be important for designers to consider.

In Conclusion

Experience design requires a broad understanding of the motivations and aspirations of the target audience. Leveraging alternative techniques during the research and conceptual phases of a project can help designers empathize with these complex dimensions of user behavior and envision creative solutions. By pairing these approaches with traditional user-centered design techniques to iterate and refine design ideas, designers can address a wide spectrum of design considerations—from learnability, efficiency, and effectiveness to pleasure, trust, persuasion, and delight. 

Chief Design Officer at Mad*Pow Media Solutions LLC

Adjunct Professor at Bentley University

Boston, Massachusetts, USA

Michael HawleyAs Chief Design Officer at Mad*Pow, Mike brings deep expertise in user experience research, usability, and design to Mad*Pow clients, providing tremendous customer value. Prior to joining Mad*Pow, Mike served as Usability Project Manager for Staples, Inc., in Framingham, Massachusetts. He led their design projects for customer-facing materials, including e-commerce and Web sites, marketing communications, and print materials. Previously, Mike worked at the Bentley College Design and Usability Center as a Usability Research Consultant. He was responsible for planning, executing, and analyzing the user experience for corporate clients. At Avitage, he served as the lead designer and developer for an online Webcast application. Mike received an M.S. in Human Factors in Information Design from Bentley College McCallum Graduate School of Business in Waltham, Massachusetts, and has more than 13 years of usability experience.  Read More

Other Columns by Michael Hawley

Other Articles on User Research

New on UXmatters