Gemini 4 Argon: Why Fernway customers cancel

Scorecard

The analysis

Findings

1. To answer the CEO: Price is not the primary driver of churn—inflexibility in skipping weeks is. Even after weighting the survey to correct for the under-representation of short-tenure customers (who are more price-sensitive), 'hard to skip weeks' remains the #1 reason for leaving.

   High confidenceBase 640

   Unweighted, 35.5% left due to difficulty skipping weeks vs. 21.6% for price (n=640). In the database, 45% of cancellers have <3 months tenure (where price churn is 31.2%) vs. 21.6% in our sample. Weighted to true population tenure, 'hard to skip weeks' is still #1 at 32.4% (~3,193 customers) vs. 26.3% (~2,591 customers) for price.

2. One-tap skipping is a much stronger win-back lever than a 20% price cut, both overall and when weighted to the true population, without sacrificing 20% of revenue.

   High confidenceBase 640

   Overall, 36.4% of respondents are likely to return for one-tap skipping vs. 25.8% for a 20% price cut (n=640). Among those who left over skipping difficulty (n=227), 58.6% would return for one-tap skipping vs. 22.9% for a price cut (a 35.7pp gap). Among price leavers (n=138), 49.3% would return for a price cut vs. 24.6% for one-tap skipping.

3. To answer the Head of Product: The Family plan does not have a satisfaction problem. The apparent lower satisfaction is a statistical illusion (Simpson's paradox) caused by tenure mix: long-tenure customers are less satisfied, and Family plan respondents in our sample are heavily skewed toward long tenure.

   High confidenceBase 640

   Overall Family satisfaction (49.2%, n=301) is slightly lower than Couples (53.4%, n=339), a statistically insignificant difference (p=0.29). However, within every tenure band, Family satisfaction is actually higher than Couples: <3 months (69.2% vs 66.1%), 3-12 months (61.6% vs 57.4%), and >12 months (42.1% vs 35.2%). Family looks worse overall only because 67.1% of Family respondents had >12 months tenure (where satisfaction is 39.7%), compared to 31.0% of Couples.

4. To answer the Operations Director: The survey suggests a severe delivery problem in Northern Ireland, where two-thirds of respondents cited delivery as their main reason for cancelling, but the sample is far too small to be conclusive on its own.

   Low confidenceBase 12

   66.7% (8 of 12) of Northern Ireland respondents cancelled due to delivery problems, compared to 8.1% in England (n=546), 13.0% in Scotland (n=46), and 0.0% in Wales (n=36). Although statistically significant vs. the rest of the UK, a base of 12 is too small to rely on without checking operational courier logs.

5. Open-text responses reveal an unmeasured product gap: 'difficulty skipping' is heavily intertwined with box-size inflexibility (minimum 3-4 meals per week) and multi-week holiday pausing. Many customers want a 2-meal option or fortnightly cadence.

   Medium confidenceBase 190

   Of 190 open-text responses, 35 mention skipping/pausing (including multi-week holiday pauses, app crashes, and early cut-off deadlines), while 29 spontaneously state they would have stayed if they could order fewer meals per week (e.g., 2 meals instead of a 3-meal minimum).

6. Recipe fatigue is the silent killer of long-term retention and Family plan subscribers, driving declining satisfaction over time.

   High confidenceBase 640

   Menu repetition is the #3 reason for cancelling overall (18.0%), but jumps from 6.5% among <3 month customers (n=138) to 25.4% among >12 month customers (n=307), and is much higher on the Family plan (23.6%, n=301) than Couples (13.0%, n=339). It is the single largest theme in open-text feedback (39 of 190 answers, 24 of which are from >12 month customers).

Open-text themes it coded

Recipe variety and menu repetition 40Price, affordability, and loyalty discounts 42Ease of skipping weeks, pausing, and cut-off deadlines 47Fewer meals per week and smaller box options 30Packaging waste and recyclability 18Delivery reliability, timing, and missing/damaged items 18Portion sizes too small or inflexible 12External life changes (unavoidable churn) 6

The survey it planned

2 screening questions and 12 questions, as the model wrote them.

1. S1

   What is the current status of your Fernway meal-kit subscription?

   One answer
   • I am currently subscribed and receiving boxes
   • I cancelled my subscription within the last 6 months
   • I cancelled my subscription more than 6 months ago
   • I have never subscribed to Fernway

   Continues if I cancelled my subscription within the last 6 months

2. S2

   How long were you subscribed to Fernway before you cancelled?

   One answer
   • Less than 3 months
   • 3 to 12 months
   • More than 12 months

   Continues if Less than 3 months; 3 to 12 months; More than 12 months

3. Q1

   Which Fernway plan were you subscribed to when you cancelled?

   One answer
   • Couples plan (recipes for two)
   • Family plan (recipes for four)
   • Not sure
4. Q2

   Thinking back to your time with Fernway, how satisfied or dissatisfied were you with your experience overall?

   Scale

   Scale 1-5: Very dissatisfied to Very satisfied

5. Q3

   How satisfied or dissatisfied were you with the freshness and quality of the ingredients you received?

   Scale

   Scale 1-5: Very dissatisfied to Very satisfied

   Judges: double-barrelled

   Freshness and ingredient quality can receive different satisfaction ratings, but only one answer is allowed.

   Asks about two things at once ('freshness' and 'quality'), which could yield different satisfaction levels.

6. Q4

   How satisfied or dissatisfied were you with the ease of managing your subscription (such as skipping weeks or changing deliveries) in the app?

   Scale

   Scale 1-5: Very dissatisfied to Very satisfied

   Judges: assumptive

   Assumes respondents managed their subscription in the app. The screeners do not establish app use, and there is no not-applicable option.

   Assumes the respondent tried to manage their subscription specifically 'in the app' and provides no 'Not applicable' option if they did not.

7. Q5

   Which of the following contributed to your decision to cancel your Fernway subscription? Please select all that apply.

   Any that apply
   • The boxes were too expensive for my budget
   • I had to give too much notice (6 days) to skip a week
   • It was too difficult or inconvenient to skip or pause deliveries in the app
   • I wanted to order fewer meals per week than the plan allowed
   • We were wasting food because we couldn't use all the meals in time
   • Issues with ingredient quality, freshness, or missing items
   • Lack of variety or appeal in the weekly recipes
   • Delivery issues (e.g. late, damaged, or missed boxes)
   • My introductory discount ended
   • My personal or household circumstances changed
   • I switched to another meal-kit provider
   • Other
8. Q6

   Which SINGLE reason was the most important in your decision to cancel?

   One answer
   • The boxes were too expensive for my budget
   • I had to give too much notice (6 days) to skip a week
   • It was too difficult or inconvenient to skip or pause deliveries in the app
   • I wanted to order fewer meals per week than the plan allowed
   • We were wasting food because we couldn't use all the meals in time
   • Issues with ingredient quality, freshness, or missing items
   • Lack of variety or appeal in the weekly recipes
   • Delivery issues (e.g. late, damaged, or missed boxes)
   • My introductory discount ended
   • My personal or household circumstances changed
   • I switched to another meal-kit provider
   • Other
9. Q7

   While you were subscribed, did you ever end up paying for and receiving a Fernway box that you did not want because you missed the 6-day cut-off to skip?

   One answer
   • Yes, more than once
   • Yes, once
   • No, never
   • I didn't know I could skip weeks
10. Q8

    Please rank the following potential improvements to Fernway in order of how appealing they are to you (where 1 is the most appealing and 5 is the least appealing).

    Ranking
    • A permanent 20% reduction in the price of your weekly box
    • One-tap skipping of any delivery week in the app, up to 48 hours before delivery
    • The ability to choose fewer meals per week when you need less food
    • The ability to pause your subscription for up to 3 months with one tap
    • A wider selection of weekly recipes to choose from
11. Q9

    To make sure our survey is working properly, please select 'Somewhat likely' as your answer to this question.

    One answer
    • Very unlikely
    • Somewhat unlikely
    • Neither likely nor unlikely
    • Somewhat likely
    • Very likely

    Continues if Somewhat likely

12. Q10

    Imagine Fernway kept its current prices, but introduced one-tap skipping in the app (allowing you to easily skip any week with shorter notice). How likely would you be to restart your subscription?

    Scale

    Scale 1-5: Very unlikely to Very likely

13. Q11

    Now imagine Fernway kept its current 6-day skip rules, but permanently cut the price of all plans by 20%. How likely would you be to restart your subscription?

    Scale

    Scale 1-5: Very unlikely to Very likely

14. Q12

    If you had to choose between the two options below, which one would make you MORE likely to rejoin Fernway?

    One answer
    • A permanent 20% price cut on all plans (with the current 6-day skip rule)
    • One-tap skipping of any week in the app (at the current plan prices)
    • Neither of these would make me consider rejoining