Customer Research
What is an A/B test in customer research?
A meeting that aligns stakeholders on the research question, methods, sample, timeline, deliverables, decision it will inform, and what is explicitly out of scope — to prevent mid-study scope creep.
A controlled experiment where users are randomly assigned to two (or more) variants of a product, message, or flow, and a defined outcome is compared to determine which performed better and by how much.
A psychometric scale (commonly 5- or 7-point) where respondents indicate agreement, frequency, or satisfaction. Even-numbered scales force a direction; odd scales allow neutrality.
A trial run of the interview guide with a representative participant, used to surface confusing wording, missing probes, time overruns, and ethical issues before the real study.
Customer Research
What is a Likert scale?
A psychometric scale (commonly 5- or 7-point) where respondents indicate agreement, frequency, or satisfaction. Even-numbered scales force a direction; odd scales allow neutrality.
Preference testing compares options, such as designs or messages, to see which users favor and why.
A non-disclosure agreement that protects confidential product plans, designs, or customer data shared during a study, while still allowing the participant to speak honestly about their own experience.
A pragmatic approach that uses small samples (often 3–5 participants) per user type, runs short, iterative test cycles, and prioritizes the most severe usability issues — trading statistical completeness for speed and cost.
Customer Research
What is a behavioral vs attitudinal research question?
An extreme user is a customer at either end of a behavior spectrum (power user, complete non-adopter). Interviewing extremes surfaces unmet needs, workarounds, and constraints that average users blur.
Behavioral questions ask what people actually did (last action, frequency, tool used); attitudinal questions ask what people say they believe, prefer, or intend — and the two often diverge.
Buying decisions involve multiple roles (economic buyer, technical evaluator, end user, champion, gatekeeper) whose goals and criteria often conflict, so research must map each role separately.
Must-be quality is something customers expect by default and are dissatisfied without; attractive quality delights when present but is not expected. Each behaves differently in surveys and competitive comparisons.
Customer Research
What is a "p-value" in a survey or experiment?
A visual representation of the steps, touchpoints, emotions, and goals a customer experiences while trying to accomplish a goal with a product, service, or workaround.
The probability, assuming the null hypothesis is true, of observing data as extreme as what was collected. By convention, p < 0.05 is often used as a threshold for declaring a result "statistically significant."
A short survey sent to customers who have canceled or stopped using the product, asking the reason and what could have changed their decision. Useful when the response is voluntary and unbiased, and when paired with behavioral data.
A structured presentation of findings to stakeholders, typically including goals, method, sample, themes, supporting quotes, implications, and recommended next steps.
Customer Research
What is the value of follow-up probing?
Customer Satisfaction Score: typically the percentage of respondents who rate a specific interaction (e.g. support ticket, checkout) as satisfied or better, captured right after the event.
A visual representation of the steps, touchpoints, emotions, and goals a customer experiences while trying to accomplish a goal with a product, service, or workaround.
A single, prioritized research question for a study that, if answered, would most change the team's current decision — used to keep the discussion guide and analysis focused.
Probing uncovers the story behind short answers and often reveals hidden motivations or trade-offs.
Customer Research
What is the "critical incident" interview technique?
A specific touchpoint where the customer forms or updates their opinion of the brand, often disproportionately influencing satisfaction, conversion, or churn (e.g. first use, support call, renewal).
Asking the participant to recall a specific recent event in detail (what happened, when, where, who was involved, what they did, what the outcome was) to anchor answers in real experience.
Probing uncovers the story behind short answers and often reveals hidden motivations or trade-offs.
A statistical calculation that estimates the sample size needed to detect a given effect size with a chosen confidence level and power. It is used to plan quantitative studies, not qualitative ones.
Customer Research
What is the difference between a moderated and unmoderated usability test?
"Walk me through the last time you tried to solve this problem."
It is a JTBD framing where "push" forces customers away from the current solution, "pull" attracts them to a new one, "anxiety" creates hesitation, and "habit" keeps them on the old path.
A fast, low-cost method suitable for early or frequent use (e.g. 5-user usability test, single-question in-app survey, 3-customer interview sprint), used to inform decisions without the overhead of a full study.
Moderated tests have a facilitator present in real time, allowing probing; unmoderated tests are completed by the participant alone, using a task script and recording, which scales better but limits follow-up.
Customer Research
What is the difference between qualitative and quantitative research?
Uncontrolled expansion of the research question, sample, or methods after the study has started, usually because a stakeholder adds a "while you're at it" question, and the leading cause of late, diluted, or unfinished studies.
A short framing such as "When I [situation], I want to [motivation/progress], so I can [expected outcome]" that captures the progress the customer was trying to make.
It reduces guesswork by grounding decisions in real customer evidence instead of assumptions.
Qualitative research explores motivations and patterns in depth, while quantitative research measures scale, frequency, and statistical confidence.
Customer Research
What is an "anecdote" in customer research?
Back every claim with the underlying evidence — a quote, a clip, a chart of the data — so stakeholders can judge strength and re-derive the conclusion rather than just trusting the researcher's summary.
A single participant's vivid but unreplicated story. Useful for empathy and hypothesis generation, but not evidence for a finding on its own.
Keep questions short, specific, behaviorally anchored, single-barreled, balanced in wording, and pre-tested with the target audience; randomize option order for non-scaled items.
A single, prioritized research question for a study that, if answered, would most change the team's current decision — used to keep the discussion guide and analysis focused.
Customer Research
What is "insight" vs "observation" in research?
Functional jobs are the concrete tasks to accomplish; emotional jobs are how the customer wants to feel; social jobs are how they want to be perceived by others.
A visual representation of the steps, touchpoints, emotions, and goals a customer experiences while trying to accomplish a goal with a product, service, or workaround.
Keep questions short, specific, behaviorally anchored, single-barreled, balanced in wording, and pre-tested with the target audience; randomize option order for non-scaled items.
An observation is a piece of raw data (a quote, a metric, a behavior); an insight is the meaning or implication that observation carries, often stated as "so what?" plus evidence.
Customer Research
Why is "the customer" usually not a single person in B2B research?
Keep questions short, specific, behaviorally anchored, single-barreled, balanced in wording, and pre-tested with the target audience; randomize option order for non-scaled items.
NPS is a survey metric that asks how likely a customer is to recommend the product (0–10). It is calculated as %Promoters (9–10) minus %Detractors (0–6) and is used as a proxy for loyalty and growth.
Buying decisions involve multiple roles (economic buyer, technical evaluator, end user, champion, gatekeeper) whose goals and criteria often conflict, so research must map each role separately.
A survey metric asking how easy it was for the customer to get something done (e.g. resolve an issue). Lower effort is associated with higher retention and referral.
Customer Research
What is informed consent in user research?
A process where the participant understands the purpose of the study, what will happen with their data, any risks, and their right to stop, and then voluntarily agrees — usually documented in writing.
A non-disclosure agreement that protects confidential product plans, designs, or customer data shared during a study, while still allowing the participant to speak honestly about their own experience.
A meeting that aligns stakeholders on the research question, methods, sample, timeline, deliverables, decision it will inform, and what is explicitly out of scope — to prevent mid-study scope creep.
A visual breakdown of the main job, the related sub-jobs, the emotional and functional dimensions, and the context — used to scope a JTBD study and find the most underserved sub-jobs.
Customer Research
What is the "think aloud" protocol?
The output clearly links evidence to decisions, owners, and the next set of assumptions to test.
A usability method where participants narrate their thoughts while performing a task, so researchers can observe reasoning, hesitations, and confusion in real time.
Applying consistent labels (e.g. segment, topic, JTBD, feature area) to research artifacts so they can be filtered, counted, and re-used across teams and over time.
A reframing of a finding as an open, opportunity-focused question (e.g. "How might we let customers edit a saved address without re-entering it?") that opens solution space without committing to a design.
Customer Research
What is a "buying center" in B2B research?
They invite stories, examples, and nuance instead of limiting the customer to short predefined answers.
A statistical calculation that estimates the sample size needed to detect a given effect size with a chosen confidence level and power. It is used to plan quantitative studies, not qualitative ones.
The set of individuals in a customer organization who participate in a purchase decision, typically including initiator, user, influencer, gatekeeper, decider, and approver roles.
A survey method that asks respondents four questions (too cheap, cheap but not unrealistic, expensive but not unrealistic, too expensive) to map a range of acceptable prices for a product.
Customer Research
What is a "comprehensive" customer research repository?
A shared, searchable system that stores research goals, plans, transcripts, recordings, tags, insights, links to decisions, and the assumption map — so the organization does not repeatedly relearn the same things.
A method where users attempt realistic tasks while researchers observe friction, confusion, and success rates.
A repository is a shared system where notes, recordings, tags, and insights are stored for reuse.
A statistical calculation that estimates the sample size needed to detect a given effect size with a chosen confidence level and power. It is used to plan quantitative studies, not qualitative ones.
Customer Research
What is a "conjoint analysis"?
It means capturing observations faithfully, distinguishing direct quotes from interpretation, and keeping evidence traceable.
Demographic segments group by attributes (age, region, role) that are easy to observe but may not predict behavior; behavioral segments group by what people actually do (usage, workflow, triggers), which usually predicts value and need better.
A quantitative research method that asks respondents to choose between bundles of attributes at varying levels, statistically inferring the relative importance and trade-off value of each attribute.
A short survey sent to customers who have canceled or stopped using the product, asking the reason and what could have changed their decision. Useful when the response is voluntary and unbiased, and when paired with behavioral data.
Customer Research
What is a "push, pull, anxiety, habit" model in switching research?
Once three independent participants share a pattern with similar language or behavior, it is usually strong enough to surface as a theme rather than being treated as anecdote.
It is a JTBD framing where "push" forces customers away from the current solution, "pull" attracts them to a new one, "anxiety" creates hesitation, and "habit" keeps them on the old path.
A proto-persona is a draft persona built from team assumptions, used to guide early research and align vocabulary; a research-backed persona is validated against real interview and behavioral data before driving decisions.
A psychometric scale (commonly 5- or 7-point) where respondents indicate agreement, frequency, or satisfaction. Even-numbered scales force a direction; odd scales allow neutrality.
Customer Research
What is the difference between "must-be" quality and "attractive" quality (Kano)?
Studying only customers who remained (survived) and ignoring those who churned or never adopted, which can make a product look much better than it is for the average or failing experience.
An Institutional Review Board (or equivalent) reviews research involving human participants to ensure risks are minimized, consent is informed, and vulnerable populations are protected, especially in academic and medical contexts.
A book framing that the only useful questions to ask customers are about specifics of their past life (when, where, who, what), not opinions, compliments, or hypotheticals — because those reliably mislead.
Must-be quality is something customers expect by default and are dissatisfied without; attractive quality delights when present but is not expected. Each behaves differently in surveys and competitive comparisons.