Benchmarks / SurveyBench / Why Fernway customers cancel / minimax/minimax-m3.1-flash:free
minimax/minimax-m3.1-flash:free: Why Fernway customers cancel
The decision: whether to build one-tap skipping of any week (about four months of product work) or cut the price of the plans by 20%, to win back and keep customers. The brief and the data →
- Verdict
- ✗ Not sound
- Research score
- 22 of 100
- Analysis rating
- 441
- Head to head, this task
- won 0 of 7
Why it is not sound
The survey
- Answer bands that overlap or leave gaps
- A double-barrelled question: Q6
- A double-barrelled question: Q7
The analysis
- Produced no usable analysis
Scorecard
The analysis
This model produced no usable analysis for this task.
The survey it planned
2 screening questions and 12 questions, as the model wrote them.
-
S1
Were you living in the United Kingdom when you cancelled your most recent Fernway subscription?
One answer- Yes
- No
- Prefer not to say
Continues if Yes
-
S2
When did you cancel your most recent Fernway subscription?
One answer- Within the past 6 months
- More than 6 months ago but within the past 12 months
- More than 12 months ago
- I have not cancelled a Fernway subscription
Continues if Within the past 6 months
-
Q1
For your most recent Fernway subscription, how long were you subscribed before you cancelled?
One answer- Less than 3 months
- 3 to 12 months
- More than 12 months
-
Q2
Which Fernway plan was on your most recent subscription?
One answer- Couples plan (recipe box for 2 people)
- Family plan (recipe box for 4 people)
- Another plan
- Not sure
-
Q3
Thinking about your decision to cancel, which were the main reasons? Select up to three.
Any that apply- The recipes or ingredients did not meet my expectations
- The monthly price was too high for me
- The portion sizes or number of meals did not suit me
- I wanted to skip a delivery but could not do so in time
- I wanted to pause deliveries or change the number of meals but could not
- A delivery was late, missing or damaged
- The app or customer service made the subscription difficult to manage
- My household, budget or circumstances changed
- I found a better meal-kit or food option
- I no longer wanted a meal-kit subscription
- No particular reason
- Prefer not to say
-
Q4
Which one was the single biggest reason you cancelled?
One answer- The recipes, ingredients, portion sizes or number of meals were not right for me
- The monthly price was too high
- I needed more flexibility to skip, pause or change a delivery
- The app, delivery or customer service was not good enough
- My household, budget or circumstances changed
- I found a better alternative
- I no longer wanted a meal-kit subscription
- No particular reason
- Prefer not to say
-
Q5
Overall, how satisfied were you with your Fernway subscription while you were subscribed?
ScaleScale 1-11: 0 — Not at all satisfied to 10 — Extremely satisfied
-
Q6
How satisfied were you with the recipes, ingredients and portion sizes while you were subscribed?
ScaleScale 1-11: 0 — Not at all satisfied to 10 — Extremely satisfied
Judges: double-barrelledRequires one satisfaction rating for recipes, ingredients and portion sizes, although satisfaction with these aspects may differ.
Asks for one rating that covers three separate aspects: recipes, ingredients and portion sizes. A respondent could be satisfied with one and dissatisfied with another.
-
Q7
Before you cancelled, did you want to skip a delivery, pause deliveries, or receive fewer meals?
One answer- No, I did not want to make any of these changes
- Yes, and I made the change I wanted
- Yes, but I could not make the change in time
- Yes, but I did not try to make the change
- I am not sure
Judges: double-barrelledCombines desired changes and their outcomes across skipping, pausing and receiving fewer meals. Someone who successfully made one change but could not make another cannot represent both outcomes with one answer.
It asks about three different actions (skip, pause, fewer meals) but options force a single outcome, which would be conflicting if a respondent experienced different outcomes for different actions.
-
Q8
Thinking about your decision to cancel, how important was it to have the flexibility to skip a delivery, pause deliveries, or receive fewer meals?
ScaleScale 1-11: 0 — Not at all important to 10 — Extremely important
-
Q9
Thinking about your decision to cancel, how important was the monthly price of your Fernway plan?
ScaleScale 1-11: 0 — Not at all important to 10 — Extremely important
-
Q10
If nothing about Fernway changes, how likely would you be to subscribe to Fernway again in the next six months?
ScaleScale 1-11: 0 — Definitely would not to 10 — Definitely would
-
Q11
Suppose Fernway made the changes listed below. Which option would make you most likely to subscribe again?
One answer- One-tap skipping of any week
- A 20% reduction in the monthly plan price
- Both a 20% reduction in the monthly plan price and one-tap skipping of any week
- A different flexibility change, such as temporarily pausing deliveries or receiving fewer meals
- Neither would make me likely to subscribe again
- I am not sure
-
Q12
If the option you selected were available, how likely would you be to subscribe to Fernway again in the next six months?
ScaleScale 1-11: 0 — Definitely would not to 10 — Definitely would
Routing Shown only if Q11 is: One-tap skipping of any week; A 20% reduction in the monthly plan price; Both a 20% reduction in the monthly plan price and one-tap skipping of any week; A different flexibility change, such as temporarily pausing deliveries or receiving fewer meals
Sample plan
Email the online questionnaire to every customer in Fernway's UK customer database who cancelled a subscription in the six months before fieldwork, referring to the most recent cancellation and allowing one response per customer. Send two reminders to nonresponders and use database subscription dates to set soft tenure quotas; use Q1 to validate tenure. There is an arithmetic conflict between the approximately 600-complete target and the board's precision requirement: 600 completes split evenly across three tenure groups gives 200 per group and a worst-case 95% margin of error of approximately ±6.9 percentage points. To honour the explicit ±5-point requirement, keep the survey open until there are at least 385 completed interviews in each of the three Q1 groups (1,155 total) and target 400 per group (1,200 total). If a tenure group contains fewer than 400 eligible customers, invite the entire group as a census and apply a finite-population correction. Use unweighted estimates within each tenure group for the board's precision calculations, and use post-stratification weights only for any overall estimate; report achieved sample sizes, effective sample sizes and confidence intervals. If 600 completes is a hard cap, the precision requirement must instead be relaxed to approximately ±6.9 points per equally sized tenure group. The questionnaire is designed to take approximately five minutes.