Benchmarks / SurveyBench / Why Fernway customers cancel / Kimi K3.1 Pro
Kimi K3.1 Pro: Why Fernway customers cancel
The decision: whether to build one-tap skipping of any week (about four months of product work) or cut the price of the plans by 20%, to win back and keep customers. The brief and the data →
- Verdict
- ✗ Not sound
- Research score
- 29 of 100
- Analysis rating
- 608
- Head to head, this task
- won 0 of 6
Why it is not sound
The survey
- A double-barrelled question: Q4
The analysis
- Produced no usable analysis
Scorecard
The analysis
This model produced no usable analysis for this task.
The survey it planned
2 screening questions and 12 questions, as the model wrote them.
-
S1
Which of the following best describes your most recent Fernway subscription cancellation?
One answer- I cancelled within the last six months and do not currently have an active Fernway subscription
- I cancelled within the last six months, but I have since restarted my subscription
- My most recent cancellation was more than six months ago
- I have never cancelled a Fernway subscription
Continues if I cancelled within the last six months and do not currently have an active Fernway subscription
-
S2
Do you currently live in the UK?
One answer- Yes
- No
Routing Shown only if S1 is: I cancelled within the last six months and do not currently have an active Fernway subscription
Continues if Yes
-
Q1
Thinking about your most recent cancellation, what was the single main reason you cancelled your Fernway subscription?
One answer- The boxes did not fit my schedule, or I was away or too busy to use them
- It was too difficult to skip or pause weeks when I did not need a box
- The boxes contained more food or meals than my household needed
- Fernway was too expensive for my budget
- Fernway did not seem good value for money
- There was not enough recipe choice or variety
- The recipes did not suit my tastes or dietary needs
- The quality or freshness of ingredients was not good enough
- Ingredients or other items were missing or damaged
- Deliveries were late, missed or unreliable
- The meals took too much time or effort to prepare
- There was too much packaging or food waste
- My household or personal circumstances changed
- I switched to another meal-kit provider
- I preferred shopping or cooking without meal kits
- Another reason
-
Q2
Apart from that main reason, which of the following also contributed to your decision to cancel? Select all that apply. Do not select your main reason again; select 'No other reasons' if nothing else contributed.
Any that apply- The boxes did not fit my schedule, or I was away or too busy to use them
- It was too difficult to skip or pause weeks when I did not need a box
- The boxes contained more food or meals than my household needed
- Fernway was too expensive for my budget
- Fernway did not seem good value for money
- There was not enough recipe choice or variety
- The recipes did not suit my tastes or dietary needs
- The quality or freshness of ingredients was not good enough
- Ingredients or other items were missing or damaged
- Deliveries were late, missed or unreliable
- The meals took too much time or effort to prepare
- There was too much packaging or food waste
- My household or personal circumstances changed
- I switched to another meal-kit provider
- I preferred shopping or cooking without meal kits
- Another reason
- No other reasons
-
Q3
Overall, how satisfied or dissatisfied were you with Fernway while you were subscribed?
ScaleScale 1-5: 1 - Very dissatisfied to 5 - Very satisfied
-
Q4
How satisfied or dissatisfied were you with Fernway's food and recipes overall, including ingredient quality, recipe choice and taste?
ScaleScale 1-5: 1 - Very dissatisfied to 5 - Very satisfied
Judges: double-barrelledOne rating combines ingredient quality, recipe choice and taste, which respondents could evaluate differently.
Asks respondents to rate their satisfaction with food, recipes, ingredient quality, recipe choice, and taste all in a single question.
-
Q5
How satisfied or dissatisfied were you with the reliability of Fernway's deliveries?
ScaleScale 1-5: 1 - Very dissatisfied to 5 - Very satisfied
-
Q6
How satisfied or dissatisfied were you with Fernway's value for money?
ScaleScale 1-5: 1 - Very dissatisfied to 5 - Very satisfied
-
Q7
While you were subscribed, how often did you want to skip a weekly box but received it anyway?
One answer- Never
- Rarely
- Sometimes
- Often
- Always or almost always
- I do not remember
-
Q8
Fernway is considering possible changes. Rank all four from 1 to 4, where 1 would most increase your interest in subscribing again and 4 would least increase it. Even if none would persuade you, please rank their relative appeal.
Ranking- A 20% lower price for your plan, with no other changes
- One-tap skipping of any week in the app, without the six-day-ahead delivery-change requirement, at the price you paid when you cancelled
- The ability to pause deliveries and payments for up to three months, at the price you paid when you cancelled
- The option to choose fewer meals each week, paying less in proportion to the number of meals
-
Q9
Imagine Fernway made none of these changes and stayed as it was when you cancelled. How likely would you be to subscribe again within the next 12 months?
ScaleScale 1-11: 0 - Not at all likely to 10 - Extremely likely
-
Q10
Imagine Fernway introduced one-tap skipping of any week in the app and removed the requirement to change a delivery at least six days ahead, but prices stayed the same. How likely would you be to subscribe again within the next 12 months?
ScaleScale 1-11: 0 - Not at all likely to 10 - Extremely likely
-
Q11
Imagine Fernway reduced the price of your plan by 20%, with no other changes. How likely would you be to subscribe again within the next 12 months?
ScaleScale 1-11: 0 - Not at all likely to 10 - Extremely likely
-
Q12
Other than the changes already described, what else, if anything, could Fernway change to make you more likely to subscribe again? You may leave this blank if nothing else would make a difference.
Open text
Sample plan
Use the customer database as the frame and email every unique customer whose cancellation falls in the rolling six-month window; do not invite only a price-related or otherwise selected subset. Append cancellation date, Couples/Family plan and continuous tenure at cancellation from the database, defining tenure groups as under 3 months, 3-12 months inclusive, and over 12 months. S1-S2 confirm eligibility, with one response per customer. Send reminders targeted towards underrepresented tenure groups and monitor plan and cancellation month. For an initial 600-complete cap, use soft quotas of 200 usable completes per tenure group. However, 600 completes cannot guarantee the board's requested precision: at 95% confidence and the conservative p=0.5, 200 respondents per group give approximately +/-6.9 percentage points, while +/-5 points requires 385 independent, effectively unweighted respondents per group, or at least 1,155 total. The recommended confirmatory plan is therefore 385 effective completes per tenure group, increasing raw targets if weighting creates a design effect; alternatively, the board must explicitly accept wider intervals or a directional survey at 600. Recalculate using actual stratum population sizes if a finite-population correction is material, and never claim +/-5 points from nominal sample size alone. Weight overall results back to the eligible cancellation population using tenure, plan and cancellation month, and base confidence intervals on effective sample sizes. Randomise the reason lists, keeping 'Another reason' and 'No other reasons' last, randomise Q8's options, and randomise Q10/Q11 order while keeping baseline Q9 first. Soft-launch to confirm a median completion time within six minutes and apply duplicate, speeding and inconsistent-response checks before finalising completes.