Benchmarks / SurveyBench / Why Pennywell customers don't use savings pots / GPT-6.2 Astra

Measured by Spring Prompt

GPT-6.2 Astra: Why Pennywell customers don't use savings pots

The decision: whether to run an awareness and onboarding push for savings pots (in-app prompts and a set-up nudge on payday), to raise the pots rate to 3.85% AER, or both. The brief and the data →

Verdict
✓ Sound research
Research score
100 of 100
Analysis rating
1,467
Head to head, this task
won 6 of 10

Scorecard

Numbers 12 of 12 right

QuestionIts answerTrue
What percentage of respondents said they knew, before the survey, that they could open savings pots (Yes at Q1)?✓39.4%39.4%
Among respondents who were asked Q3, what percentage chose 'The interest rate is too low'?✓29.7%29.7%
As a percentage of all respondents, how many knew about pots and chose 'The interest rate is too low' at Q3?✓11.7%11.7%
Weighted to the age mix of all customers who have never opened a pot, what percentage of them would know about pots and choose 'The interest rate is too low' at Q3?✓8.8%8.8%
Weighted to the age mix of all 361,000 customers who have never opened a pot, about how many of them did not know they could open savings pots (No or Not sure at Q1)?✓239,700239,702
Among respondents who reported an amount held in savings elsewhere (excluding None, Don't know and Prefer not to say), what percentage hold less than £5,000?✓55.2%55.2%
What percentage of all respondents said they would be likely (fairly or very) to start saving in a pot if the rate rose to 3.85% AER?✓29.9%29.9%
Among respondents asked Q3, is the difference in the share choosing 'The interest rate is too low' between those aged 35-54 and those aged 55-74 statistically significant at the 95% level? (1 for yes, 0 for no)✓NoNo
What is the 95% margin of error, in percentage points, on the share of respondents asked Q3 who chose 'The interest rate is too low'?✓5.4 points5.39 points
How many of the open-text answers say the respondent did not know about savings pots or what they are, or want Pennywell to tell them about pots?✓126126
How many of the open-text answers from respondents aged 18-34 say they did not know about savings pots or what they are, or want Pennywell to tell them about pots?✓4546
What percentage of the customers invited completed the survey?✓6%6%

Traps in the data 8 of 8 handled

  • ✓Q3 was asked only of the 276 respondents who knew about pots. 'The interest rate is too low' leads there (30%), but that is 12% of all respondents (about 9% weighted), while 61% of all respondents did not know pots existed (No or Not sure).
  • ✓Customers aged 55 or over are 15% of non-users but 31% of respondents; they know about pots more and cite the rate more, so unweighted figures overstate awareness and the rate reason (weighted, awareness falls from 39% to 34%).
  • ✓The mean amount held elsewhere (£14,513) is pulled up by a few large balances; the median is in the £1,000 to less than £5,000 band and 55% of those reporting an amount hold less than £5,000. Many hold nothing elsewhere.
  • ✓30% say they would be likely to start saving in a pot at 3.85% (17% at the current 3.1%); these are stated intentions about a hypothetical rate.
  • ✓Respondents aged 75 or over (base 20) show 65% holding £20,000 or more elsewhere, against 13% overall.
  • ✓Only 700 of 11,600 invited customers completed (about 6%); those who respond to an email about savings may be more engaged with saving than those who do not.
  • ✓The chief financial officer believes customers don't use pots because the rate is uncompetitive.
  • ✓Among those asked Q3, the rate reason is 10 points higher for 55-74s (38%, base 120) than for 35-54s (27%, base 102), but the difference is not significant at 95%.

The analysis

Recommendation

Pilot an optional awareness and onboarding push at 3.1% rather than announcing a permanent 3.85% rate or committing to both. Show what a pot is, the AER, how to get money back and a direct ‘Create a pot’ action. Trial a dismissible prompt at a genuine income payment. Give the rate a fair controlled test: the aware group is responsive in principle, but neither their switching threshold nor the value of the funds they would bring is established.

What would change it

Adopt the rate rise if, against otherwise identical communication at 3.1%, it attracts enough persistent net new funding to exceed the interest and operating costs, including repricing existing pot balances. Choose both only if the combination delivers better incremental economics than either alone. Drop or redesign the prompt if it mainly produces empty pots, shifts existing Pennywell balances, or worsens customer outcomes. Reconsider age targeting only with a larger validated sample and a positive incremental return at that segment's actual scale.

Findings

  1. Test making pots visible and easy to open first. A rate rise cannot, on its own, communicate that the account exists.

    Medium confidenceBase 700

    Only 276/700 knew about pots; 355 said No and 69 were unsure. Weighting the four age-specific awareness rates to the customer database suggests about 66.4%, or 240,000 of 361,000 never-openers, did not know or were unsure. This is an estimate of the audience for an explanation, not the number who will save.

  2. No, the top-ranked reason does not settle the pricing decision. It identifies a real objection among aware customers, not a majority barrier or a price at which they will switch.

    High confidenceBase 276

    Rate was first at 82/276 (29.7%, nominal 95% margin ±5.4 points), ahead of saving elsewhere (19.6%). Those 82 are 11.7% of all 700, or about 8.8% after weighting the joint outcome by age. The other 424 were not asked, so this is not an estimate of everyone who might care about rate once informed. Among aware respondents, 28/102 aged 35–54 versus 45/120 aged 55–74 chose rate; the 10-point difference is not significant on a two-sided 95% comparison (p approximately 0.11).

  3. Prior awareness is a better guide to which offer to test than an overall ranking. Test the higher rate as a challenger, particularly for customers who already know about pots.

    Medium confidenceBase 700

    Across 700, likely intent was 17.4% at 3.1%, 33.7% with a pay-in suggestion at 3.1% (+16.3 points), and 29.9% at 3.85% (+12.5). Among the 355 previously unaware, the same three figures were 17.2%, 42.5%, 24.2%; among the 69 unsure, 15.9%, 47.8%, 30.4%. Among the 276 aware the pattern reversed: 18.1%, 18.8%, 37.0%. These are contrasts in stated intent, not incremental funded accounts.

  4. There is no defensible sterling inflow forecast from this survey. Do not multiply £14,513 by the customer population or by the percentage likely to open.

    High confidenceBase 700

    £14,513 is a band-based mean for the 413 positive external savers only. Of 700, 250 reported none and 37 did not disclose or know. Of the 413, 228 (55.2%) had less than £5,000; the median band is £1,000–<£5,000. The upper tail pulls up the mean, and the open-ended top band was assigned £75,000. Neither the amount transferable nor the share actually transferred because of a higher rate was measured; cash ISA balances, for example, need not be available on equivalent terms.

  5. No, do not build the campaign around the 75+ group. Include older customers in accessible design and research, but high balances alone do not establish a large or responsive audience.

    Low confidenceBase 20

    13/20 aged 75+ reported £20,000+ elsewhere and 17/20 reported any savings. Just 5/20 said likely at 3.85%, versus 4/20 at baseline; one answer is five percentage points. Only seven were asked Q3. This age group is 2% of never-openers (about 7,220 people). In contrast, ages 18–34 are 46% of never-openers, only 47/218 knew of pots, and 38.5% expressed intent with a pay-in suggestion versus 17.9% at baseline.

  6. Offer a short explanation with a direct route to opening, not just a banner advertising interest. Let customers dismiss the suggestion: for some, nothing is left after essentials.

    Medium confidenceBase 230

    126/230 text respondents expressed a need for awareness or explanation, including 45 aged 18–34. P026 thought Pennywell only offered a current account and could not find pots; P048 knew of pots but abandoned setup at naming and funding; P541 wanted withdrawal timing before depositing. P052 wanted both explanation and a better rate, whereas P688 described having nothing left at month end. These identify design needs, not their population prevalence.

Caveats

  • The target is customers who have never opened a pot, not all current-account holders or former pot users. Invitations were random but responses were voluntary: 700/11,600 completed and 812 started. Ages 18–34 are 31.1% of completes versus 46% of the population; 55–74 are 28.6% versus 13%. Age weighting corrects that imbalance, not selection within age groups. The weighted headcount is approximate.
  • The Q3 margin and age comparison use ordinary unweighted binomial and independent-proportion approximations. They describe sampling uncertainty, not nonresponse, question wording or weighting error. A non-significant difference is not evidence of equality.
  • Q3 forced one main reason; barriers can coexist. Q2 had only 230 voluntary answers and followed a product explanation. Theme counts overlap and count expressed needs, not needs inferred from a respondent's Q1 label.
  • The same people rated the scenarios in fixed order after learning about pots. Even baseline intent is informed intent. There was no randomised exposure, observed deposit, combined offer or test of payday specifically: Q6 said whenever money is paid in. The marginal tables do not give paired changes or establish that the overall nudge-versus-rate gap is statistically reliable.

Next steps

  • decisionSet a funding-value hurdle with Finance before launch.
  • experimentRandomise eligible never-openers to usual experience, push only, rate only and both, subject to fair-offer review. Keep necessary rate disclosures comparable; balance the arms by age and track prior awareness in a subsample without priming the control.
  • researchObserve customers finding, opening, funding and withdrawing from a pot; include younger unaware customers, existing external savers and a deliberately enlarged accessible 75+ sample.
  • monitorMonitor the payday prompt for relevance and harm, with an easy opt-out and no automatic transfer.

Open-text themes it coded

Did not know about pots or what they are; wants an introduction or explanation 126Higher or more competitive interest needed to justify the effort 45Savings already parked with another provider; habit, trust or an incumbent rate to beat 17Hard to find the feature or its entry point in the app 29Opening process looks or feels confusing or too long 13Needs confidence about speed of withdrawal 10No spare money to save 23No interest in saving or in saving this way 15

The survey it planned

1 screening question and 6 questions, as the model wrote them.

  1. S1

    Do you currently have a Pennywell current account?

    One answer
    • Yes
    • No
    • Not sure

    Continues if Yes

  2. Q1

    Before this survey, did you know that Pennywell offers savings pots?

    One answer
    • Yes
    • No
    • Not sure
  3. Q2

    What, if anything, has kept you from opening a Pennywell savings pot? Select all that apply.

    Any that apply
    • I prefer to keep my savings outside Pennywell
    • I don't have money to set aside at the moment
    • I haven't got round to it
    • The interest rate isn't high enough for me
    • I don't know what interest rate I'd get
    • I don't know where to find pots in the app
    • Opening a pot seems like too much effort
    • I'm not sure how pots work
    • My current way of saving suits me
    • Another reason
    • Nothing in particular

    Routing Shown only if Q1 is: Yes

  4. Q3

    About how much of your own money do you currently hold in accounts outside Pennywell that you can withdraw from straight away without a penalty? Include money you've set aside in current accounts, but not money for day-to-day spending. Your best estimate is fine.

    One answer
    • £0
    • Under £500, but more than £0
    • £500 to under £2,000
    • £2,000 to under £5,000
    • £5,000 to under £10,000
    • £10,000 to under £25,000
    • £25,000 to under £50,000
    • £50,000 or more
    • Not sure
    • Prefer not to say
  5. Q4

    Imagine the following for the next three months. A Pennywell savings pot is an account inside the app that you can take money out of at any time. It pays {rate} AER (the yearly rate including compound interest). {discovery} How likely would you be to open a pot and put money in it during those three months?

    One answer
    • Definitely would
    • Probably would
    • Might or might not
    • Probably wouldn't
    • Definitely wouldn't
    • Not sure
  6. Q5

    In the situation just described, about how much of the money you currently have set aside outside Pennywell would you move into a pot in those three months? Enter your best estimate in pounds, or 0 if you wouldn't move any. You can leave this blank if you're unsure or prefer not to say.

    Number

    Routing Shown only if Q3 is: Under £500, but more than £0; £500 to under £2,000; £2,000 to under £5,000; £5,000 to under £10,000; £10,000 to under £25,000; £25,000 to under £50,000; £50,000 or more; Not sure; Prefer not to say

  7. Q6

    Which age group are you in?

    One answer
    • 18–34
    • 35–54
    • 55–74
    • 75 or over
    • Prefer not to say
Sample plan

Use the account database to select current adult customers with no pot-opening record, including no previously closed pot. Randomly invite within the four database age bands in waves, aiming for about 175 completes per band (700 total); oversample smaller or lower-response bands as needed. Use unique links and a neutral invitation about using Pennywell, with no mention of pots, rates or payday. Randomise Q2's substantive options, leaving the final two last and making 'Nothing in particular' exclusive. At Q4 randomly assign one of four equally allocated scenarios within each database age band. Render {rate} as '3.1%' or '3.85%'; independently render {discovery} as either 'You can find pots under a tab in the app.' or 'You can find pots under a tab in the app. You also see messages about pots in the app and a reminder on payday with a link to start setting one up.' Do not show placeholders or arm labels. Pilot on mobile, checking wording, routing and completion within five minutes. The precision request is not achievable with 700 for large age strata: at 175 per band the worst-case nominal 95% margin for a proportion is about ±7.4 percentage points, before nonresponse or weighting. Agree either wider intervals or an increased target of at least 385 completes per band (1,540 total) for approximately ±5 points on full-band proportions under simple random sampling; conditional and scenario estimates need larger samples still. Check actual stratum sizes for finite-population corrections.