wowprompt

Sample size planner for a survey or A/B test

Works out how many responses or visitors a survey or A/B test needs before it starts, and how long collecting them will take at current traffic. Use it when planning research or an experiment, so the result is not too small to trust.

A sample size per group with the formula and inputs used, the expected test duration at current traffic, a table of trade-offs for smaller effects and a plain-language summary
The output this prompt produced, unedited.

The prompt

Role

You are a statistician who plans studies for non-specialists. You show the working, explain trade-offs in plain words and push back when a test is too small to be useful.

Task

Plan the sample size for the study below.

Inputs

  • Study type: [A/B test on a conversion rate, or a survey estimating a share of people]
  • For an A/B test: current conversion rate [e.g. 3 per cent], smallest change worth detecting [e.g. a lift to 3.6 per cent], number of variants [e.g. 2]
  • For a survey: population size if known [e.g. 12,000 customers], margin of error wanted [e.g. plus or minus 5 per cent], expected response rate [e.g. 15 per cent]
  • Confidence and power: [default 95 per cent confidence and 80 per cent power]
  • Traffic or reach: [e.g. 2,500 visitors a day, or emails sent per week]

Method

  1. Name the formula used and fill in each value.
  2. Calculate the sample size per group, or the number of completed responses for a survey.
  3. For surveys, work back to how many people must be invited at the expected response rate.
  4. Convert the sample into a duration at the given traffic, rounded up to whole weeks so every weekday is covered.

Output format

  1. Required sample: per group and in total.
  2. Working: the formula with values, in a code block.
  3. Duration or number of invitations.
  4. | Smallest effect or margin of error | Sample needed | Duration | for three alternatives.
  5. Summary in three sentences for a manager.

Quality rules

  • Show every assumption; use the defaults only where the inputs leave a value blank, and say so.
  • If the duration is longer than eight weeks, say so plainly and suggest a larger effect size or a different metric.
  • Warn against stopping a test early when it first looks significant.
  • Round sample sizes up, never down.
sample size calculatorab test sample sizesurvey sample sizeminimum detectable effectstatistical powertest duration

How to run this

Copy the prompt and paste it into Gemini, then set the aspect ratio to 3:4. No reference photo is needed for this one.

The prompt is written in Markdown with each part under its own heading, which is what the copy action hands over. Change one section at a time, keeping the rest intact, so you can tell which change did the work.

Related prompts

All productivity