Fundamentals

Foundational methods for practicing design research.

Findings

What

The findings communicate what you did, what you learn, and what it means for what comes next.

Why

For research to be actionable, the findings from each cycle have to be communicated to the team and other stakeholders clearly and confidently.

Templates

Time required

N/A

How to do it

  1. Download the template for research cycle findings (Word).
  2. Collaborate with others on the team who participated in the research cycle, either as facilitators or observers. (Findings are about documenting what happened. People who weren’t involved directly are consumers of this information, not contributors.)
  3. Ensure that your findings clearly connect the dots between the following:
    • What your questions were
    • What you did
    • What you saw
    • What you learned
    • What you think it means
    • What happens next
  4. Use the template to document your findings, but also consider alternate formats for actually presenting the findings. Sharing more concise slides that include imagery and even video clips are more impactful than scrolling through a Word document or expecting people to read it on their own.

Considerations for use in government

No PRA implications, for the findings themselves, but make sure the privacy of your participants is being protected as part of any artifacts that are included.

Incentives

What

Offering usability test or user research participants gifts to encourage participation and to thank them for their time.

Why

Incentives often result in a more diverse, representative set of participants. Without incentives, you often end up recruiting people with a strong intrinsic interest in your website. These people may not have the same needs and experiences as a less interested pool of users. With incentives, you can encourage less interested, more representative people to participate.

Time required

N/A

How to do it

  1. Figure out what’s legal and appropriate. Consult your agency’s Office of General Counsel on options for providing incentives or gifts to encourage participation in usability testing, consistent with your agency’s authorities. The options will depend upon your agency’s authorities and the specific facts.
  2. Consider contracting for a recruiting service to help you get an effective research pool.
  3. If incentives are determined to be permissible, clearly communicate when and how participants will receive incentives. In the emails, postings or other materials you use to recruit your participants, describe the incentive and how participants will receive it (via mail, pick up at an office, etc.). This is particularly important for “remote” research.

Considerations for use in government

No PRA implications. Even when users are present, the PRA explicitly exempts direct observation and non-standardized conversation, 5 CFR 1320.3(h)3.

If you are not working with government employees, you will need to observe standard precautions for archiving personally identifiable information.

Paperwork Reduction Act (PRA)

What

The Paperwork Reduction Act (PRA) is a law governing how federal agencies (and their consultants) collect information from the American public. It applies primarily when we collect structured information from 10 or more members of the public.

Why

PRA aims to prevent unnecessary or duplicative information requests from the public. The intent is for federal agencies to be good stewards of the public’s time.

Time required

Varies

How to do it

  1. Determine the type of research and estimate how many participants you’ll need. See “When PRA is most likely to apply” in Navigating PRA (Internal Bixal resource, for now).
  2. Think creatively about how to get the answers you need while complying with PRA. Each method in this site includes some guidance on the application of PRA, but in general, it does NOT apply in these cases:
    • Research methods that involve “direct observation or non-standardized oral communication”.
    • Research conducted with federal employees as participants.
  3. If you think a PRA clearance might be necessary, discuss with the project manager or product owner right away. They can help you connect with the PRA representative at the related federal agency.

Additional resources

Planning

What

A collection of methods and related activities aimed at answering specific questions.

Why

Research is iterative and ongoing throughout a project. By planning research in cycles based on current questions, you can show progress and make it easier to decide next steps.

Templates

Time required

N/A

How to do it

  1. Download the template for a research cycle plan (Word).
  2. Work with your team to align on the goals and questions you want to answer.
  3. Decide on what methods are most appropriate to answer those questions, keeping in mind constraints the project may have.
  4. Adjust the plan as needed and share it with the team before proceeding.

Considerations for use in government

No PRA implications for the plan itself, but see PRA implications for each of the methods you include in the plan.

Privacy

What

Designers potentially might work with many different categories of information, across a number of different contexts. You have an obligation to steward information in a way that respects privacy.

Why

Designers have an obligation to respect and protect privacy. People will not honestly participate in design processes, nor make use of products and services, they do not trust.

Time required

N/A

How to do it

  1. Familiarize yourself with the Fair Information Practice Principles, a set of precepts at the heart of the U.S. Privacy Act of 1974.
  2. Consult your organization’s privacy office, which may include your general counsel, if you plan to substantially make use of information that could potentially identify specific individuals.
  3. Inform and collect the voluntary consent of anyone who participates in moderated design research. Ensure that all unmoderated forms of research (for example, web analytics) are covered by an easy-to-access privacy policy.
  4. Pay special attention to all categories of information used throughout the design process. Note contexts in which it’s not okay to share certain categories of information.

Additional resources

Considerations for use in government

The government’s use of information about people is subject to a number of laws and policies, including: the Privacy Act of 1974, the Federal Information Security Management Act of 2002, and the eGovernment Act of 2002.

Conduct a Privacy Threshold Analysis in collaboration your agency’s privacy office whenever a design calls for the creation of a new data store (for example, a database).

Ensure all collections of personally identifiable information (PII) are accompanied by a Privacy Act Notice. See, for example, 18F’s Privacy Act Notice for Design Research.

Recruiting

What

Identifying and gathering people to interview or who will test your product.

Why

Recruiting people who represent your core user group is a critical and oft-overlooked part of research. Time spent with the right people using the wrong methods is better than time spent with people who aren’t your core users while using the right methods.

Templates

Time required

1–2 weeks for 5–10 participants

How to do it

Seek out people who

  • Are trying to use the thing you are working on right at that very moment.
  • Recently tried to use the thing you are working on.
  • Used the thing you are working on less recently.
  • Have used something like what you are working on, and are likely to use what you are working on.

Reach them through

  • Relevant community organizations.
  • Impromptu requests in or near the relevant environment.
  • Your personal and professional network.
  • The new or existing website.
  • Existing mailing lists.

Considerations for use in government

No PRA implications. No information is collected from members of the public.