Question 1

Why do you want to mix methods?

If you can’t confidently answer this question, then avoid a mixed methods study. You might collect too much or an incomplete amount of qualitative and quantitative for your stakeholders to find valuable or meaningful.

‍

Question 2

What are the qualitative, quantitative, and mixed research questions you’re trying to address in this potential mixed method study?

‍

Question 3

Can you collect the necessary data to answer your research questions without using a mixed methods study?

• If not, consider a mono-method research study instead.

‍

Question 4

Do you have the time, support, and resources to collect both qualitative and quantitative data in a meaningful and interconnected way for your qualitative, quantitative, and mixed research questions?

• If not, design a mono-method study.
• If you don’t have a lot of time: Use a two-strand design, where you can report learnings quickly and still be able to plan to collect the other qualitative/quantitative data later (and then report mixed findings); go unmoderated; use secondary or log data; use identical sampling to collect both sets of data from one sample
• If you don’t have a lot of resources (like budget, software, tools, etc.): Go unmoderated; use identical sampling to collect both sets of data from one sample; set the data priority towards available research method(s) that requires fewer resources in your environment
• If you don’t have a lot of support: Discuss the benefits of a mixed methods study with stakeholders (like the reasons in Step 1) or consider a mono-method to build a stronger relationship with stakeholders first

‍

Question 5

Finally, do you know all of the properties to design a meaningful mixed methods study to answer your research questions?

• If not, design a mono-method study or align with stakeholders to figure out which property is unknown or incorrect.

‍

Property 1: Alignment

Will your mixed methods study be planned or opportunistic?

• NOTE: Planned mixed methods studies tend to be more flexible, balanced, and impactful because you can think through the entire study but stakeholders might collecting both qualitative and quantitative data on one research topic to be redundant or unnecessary. Opportunistic studies can lead to mismatched or incomplete datasets but be seen as natural extensions after reporting meaningful findings.

‍

Property 2: Integration

How exactly will your qualitative and quantitative elements interact or influence each other?

‍

Property 3: Timing / Strands

When will the qualitative and quantitative data be collected?

‍

Property 4: Data Priority

Will one set of data take priority over the other?

• NOTE: Merging integration studies typically give equal priority to both the qualitative and quantitative data, while building and enriching integration studies give priority to one set of data.

‍

Property 5: Mixed Sampling

How many samples will you need to collect both sets of data?

• 1 - Write down your qualitative and quantitative research questions.
• 2 - Write down the available, relevant qualitative and quantitative research methods that’ll help you collect data for your research questions in Step 1.
• Note: Think about your comfort, experience, and tools for the research methods. If you’re not comfortable or experienced with using a research method in a mono-method study, you won’t magically become better during a complex, mixed methods study!

TIP: Don’t forget secondary data and log data (product analytics)

• 3 - Write down the individual strengths and weaknesses of each research method.
• 4 - Connect a qualitative research method to a quantitative research method where the strengths of one method overcome, cancel, or negate the weaknesses of the other.
• (Optional) If you can, connect a qualitative/quantitative research method that can be nested or used within another qualitative/quantitative research method.
• 5 - Select the qualitative-quantitative methods that are balanced, and reasonable to attempt within your constraints, and help you answer your research questions in Step 1.