Benchmarks / SurveyBench / Why Pennywell customers don't use savings pots / Claude Fable 5.2
Claude Fable 5.2: Why Pennywell customers don't use savings pots
The decision: whether to run an awareness and onboarding push for savings pots (in-app prompts and a set-up nudge on payday), to raise the pots rate to 3.85% AER, or both. The brief and the data →
- Verdict
- ✓ Sound research
- Research score
- 100 of 100
- Analysis rating
- 1,683
- Head to head, this task
- won 10 of 10
Scorecard
Numbers 12 of 12 right
| Question | Its answer | True | |
|---|---|---|---|
| What percentage of respondents said they knew, before the survey, that they could open savings pots (Yes at Q1)? | ✓ | 39.4% | 39.4% |
| Among respondents who were asked Q3, what percentage chose 'The interest rate is too low'? | ✓ | 29.7% | 29.7% |
| As a percentage of all respondents, how many knew about pots and chose 'The interest rate is too low' at Q3? | ✓ | 11.7% | 11.7% |
| Weighted to the age mix of all customers who have never opened a pot, what percentage of them would know about pots and choose 'The interest rate is too low' at Q3? | ✓ | 8.8% | 8.8% |
| Weighted to the age mix of all 361,000 customers who have never opened a pot, about how many of them did not know they could open savings pots (No or Not sure at Q1)? | ✓ | 239,700 | 239,702 |
| Among respondents who reported an amount held in savings elsewhere (excluding None, Don't know and Prefer not to say), what percentage hold less than £5,000? | ✓ | 55.2% | 55.2% |
| What percentage of all respondents said they would be likely (fairly or very) to start saving in a pot if the rate rose to 3.85% AER? | ✓ | 29.9% | 29.9% |
| Among respondents asked Q3, is the difference in the share choosing 'The interest rate is too low' between those aged 35-54 and those aged 55-74 statistically significant at the 95% level? (1 for yes, 0 for no) | ✓ | No | No |
| What is the 95% margin of error, in percentage points, on the share of respondents asked Q3 who chose 'The interest rate is too low'? | ✓ | 5.4 points | 5.39 points |
| How many of the open-text answers say the respondent did not know about savings pots or what they are, or want Pennywell to tell them about pots? | ✓ | 126 | 126 |
| How many of the open-text answers from respondents aged 18-34 say they did not know about savings pots or what they are, or want Pennywell to tell them about pots? | ✓ | 46 | 46 |
| What percentage of the customers invited completed the survey? | ✓ | 6% | 6% |
Traps in the data 8 of 8 handled
- ✓Q3 was asked only of the 276 respondents who knew about pots. 'The interest rate is too low' leads there (30%), but that is 12% of all respondents (about 9% weighted), while 61% of all respondents did not know pots existed (No or Not sure).
- ✓Customers aged 55 or over are 15% of non-users but 31% of respondents; they know about pots more and cite the rate more, so unweighted figures overstate awareness and the rate reason (weighted, awareness falls from 39% to 34%).
- ✓The mean amount held elsewhere (£14,513) is pulled up by a few large balances; the median is in the £1,000 to less than £5,000 band and 55% of those reporting an amount hold less than £5,000. Many hold nothing elsewhere.
- ✓30% say they would be likely to start saving in a pot at 3.85% (17% at the current 3.1%); these are stated intentions about a hypothetical rate.
- ✓Respondents aged 75 or over (base 20) show 65% holding £20,000 or more elsewhere, against 13% overall.
- ✓Only 700 of 11,600 invited customers completed (about 6%); those who respond to an email about savings may be more engaged with saving than those who do not.
- ✓The chief financial officer believes customers don't use pots because the rate is uncompetitive.
- ✓Among those asked Q3, the rate reason is 10 points higher for 55-74s (38%, base 120) than for 35-54s (27%, base 102), but the difference is not significant at 95%.
The analysis
Run the awareness and onboarding push now. Do not raise the rate to 3.85% across the board on this evidence; test it first.
- Why the push: about two-thirds of customers without a pot do not know pots exist. The nudge more than doubles stated intent in that group at no interest cost. A rate rise cannot reach people who do not know the product is there.
- What the push must include: make pots visible on the home or accounts screen, shorten the set-up flow, and state plainly that withdrawals are instant. Otherwise the new awareness will leak away at set-up.
- Why not the rate yet: it is the main barrier for only about one non-user in ten. The rate-sensitive ask for 4% or more. The survey cannot size the deposits it would bring in or the cost on existing balances. It is still the only lever that moved customers who already knew about pots, and they are older and hold more, so it deserves a proper trial.
- If the goal is deposit volume rather than number of pot users: the rate test becomes more urgent, but the survey still cannot stand in for it.
- The 75-or-over campaign: do not build it. If marketing wants high-balance customers, target on balance and transfer signals in account data, not on age.
- Towards raising the rate: a controlled test in which 3.85% brings in materially more new pot balances than the nudge alone, after the extra interest on existing and new balances. Account data showing that aware customers who make regular transfers to other savings providers hold most of the movable money would point the same way.
- Towards 'both' straight away: a funding need that makes deposit volume the objective and the interest cost acceptable.
- Against relying on the push: a live nudge producing pot openings far below the stated 43% among unaware customers, or new pots staying near-empty.
- Against any rate move at 3.85%: competitor instant-access rates sitting above 3.85%, so that it is still uncompetitive.
- Towards an age-targeted campaign: account records showing that customers aged 75 or over hold a large share of the transferable balances and respond to prompts.
Findings
-
CFO, question 1: no, the 'top reason' does not settle it. The reasons question was only put to the minority who already knew pots existed. About two-thirds of customers without a pot have never heard of them, so they could not have a view on the rate.
Q1: 276 of 700 (39.4%) knew about pots; 60.6% did not or were not sure (margin about ±3.6 points). The sample skews older and older customers are more aware (60.0% of 55-74s vs 21.6% of 18-34s). Weighted to the real age mix, about 66% are unaware, roughly 240,000 of 361,000 customers.
-
'Rate too low' is the main reason for about one non-user in ten, not three in ten. It is still the largest single reason among those who know about pots, so it is a real barrier for that group.
Q3: 82 of 276 chose it (29.7%, ±5.4 points). That is 11.7% of all 700 respondents and 8.8% once weighted to the customer age mix. Among the same 276, three friction reasons add up to as much as rate: unsure how to set up 10.9%, not got round to it 11.6%, worried about access 7.6% (30.1% in total). The age gap in citing rate (35-54 27.5% vs 55-74 37.5%) is not statistically significant.
-
The nudge and the rate rise move different people. The nudge works on customers who did not know about pots, who are the majority. The rate rise works on those who already knew. Overall the two score about the same on stated intent, so the choice turns on which group matters more to the business.
Likely (4-5) to start saving at the current rate, with the nudge, and at 3.85%:
- Unaware (No or Not sure, n=424): 17% → 43% with nudge → 25% at 3.85%.
- Aware (n=276): 18.1% → 18.8% with nudge → 37.0% at 3.85%.
- Total (n=700): 17.4% → 33.7% → 29.9%; age-weighted about 17% → 35% → 29%.
The total gap between nudge and rate (3.8 points) is within noise. These are stated intentions on hypotheticals, so read them as relative, not as forecasts.
-
CFO, question 2: the £14,500 figure cannot be multiplied across 361,000 customers, and this survey cannot say how much a rate rise would bring in. A more defensible figure is about £7,000 held elsewhere per customer without a pot. That is money that exists elsewhere, not money that would move.
- The £14,513 mean covers only the 413 respondents who reported an amount; it leaves out the 250 (35.7%) with no savings elsewhere.
- It rests on an assumed £75,000 for the top band: 32 people supply 40% of the total. The 88 holding £20,000 or more (12.6% of the sample) supply 73%.
- The median saver is in the £1,000-£5,000 band; 55.2% of those reporting an amount hold under £5,000.
- Counting 'None' as zero gives about £9,000 per respondent. Reweighting to the younger real age mix gives about £6,900, so roughly £2.5bn held elsewhere in total, against £5.2bn from the naive sum.
- No question asked how much anyone would move, and Q7 intent is not cross-tabulated by balance.
-
3.85% may fall short of what rate-sensitive customers say they want, and the larger balances sit with people who describe themselves as settled with another provider. The 18.1% → 37.0% rise in stated intent among aware customers should not be read as deposits.
Open text: 45 of 230 answers ask for a better rate. Those that name a level ask for 'at least 4%', 'something like 5%', 'a full percentage point more than Nationwide' or 'top of the best-buy tables'. 17 answers say savings are staying with a named bank or building society, 11 of them alongside a rate comment. Q3: 19.6% of aware respondents keep savings elsewhere as their main reason.
-
Head of marketing: no, not on this evidence. The 75-or-over figures rest on 20 people, and the group is about 2% of customers without a pot (around 7,200 people). Most customers with large balances elsewhere are under 75.
- 13 of 20 hold £20,000 or more (65%); the plausible range is roughly 43% to 82%. Only 7 answered Q3.
- Applying each age band's share to the population gives about 4,700 such customers aged 75+, against about 10,100 aged 55-74 and 12,400 aged 35-54. That makes 75+ around one in seven of roughly 34,000.
- Nothing shows this group would respond: 5 of 20 are likely under either the nudge or the rate rise, and 3 of the 7 asked said they keep savings elsewhere.
-
An awareness push will leak unless pots are easier to find and set up, and unless it says plainly that money can be withdrawn instantly. Some customers who knew about pots tried to open one and gave up. Others fear slow withdrawals from what is an instant-access product.
Open text: 40 of 230 answers say pots are hard to find or fiddly to set up; 20 of those are from aware customers, several describing an abandoned attempt (P039, P048, P141, P661). 10 answers worry about withdrawal speed. Q3 (n=276): 10.9% unsure how to set up, 7.6% worried about access.
-
A sizeable minority are out of reach of either lever because they have nothing to save or do not want to save.
Q4: 35.7% hold no savings elsewhere and a further 15.0% under £1,000 (n=700). Q3: 13.4% of aware respondents have no money left over (n=276). Open text: 23 answers say no spare money and 15 say not interested. Even in the best scenario shown, most respondents are not 'likely'.
Caveats
- Only 6.0% of those invited completed (700 of 11,600; 112 started and dropped out). People who answer a savings survey are probably more engaged than those who did not, so true awareness may be lower than measured. Age weighting does not correct for this.
- The tables are unweighted and the sample is older than the customer base (55-74s are 28.6% of the sample against 13% of customers; 18-34s are 31.1% against 46%). Older customers are more aware and more rate-focused, so unweighted totals overstate both. My weighted figures adjust for age only.
- The reasons question went only to the 276 who knew about pots. We do not know what would hold back the unaware majority once they are told.
- The three likelihood questions are stated intentions on hypotheticals, asked in a fixed order after everyone had been told about pots. Stated intent overstates behaviour, so use the comparisons between groups and scenarios, not the levels. The rate question also assumes the customer hears about the new rate, which unaware customers would not without a campaign.
- Savings elsewhere are self-reported in bands. The mean depends on assuming £75,000 for the top band, and 5.3% did not give an amount. Nothing in the survey measures how much anyone would move, or at what rate.
- The 75-or-over column has 20 respondents (7 at the reasons question). One person is 5 points, or 14 points at the reasons question. Treat every figure in that column as anecdote.
- Open-text counts come from the 230 answers supplied, coded by one analyst. The question followed straight after the awareness question, which invites 'tell me about them' answers. Treat the counts as mentions, not as population shares.
- The survey excluded existing pot users, so it says nothing about the cost of paying 3.85% on balances already held, or about retention benefits. Both belong in the rate decision.
Next steps
- decisionApprove the awareness and onboarding push (in-app prompts and payday set-up nudge). Hold the blanket rate rise until the rate test reports.
- experimentRoll the push out as a randomised test with a holdout: no contact, in-app prompt only, and prompt plus payday nudge.
- experimentTest the rate as a time-limited offer to a random cell, crossed with the nudge (3.1% vs 3.85%, and if compliance allows a cell at 4% or above), with prior pot awareness recorded.
- decisionMake pots visible on the home or accounts screen, cut the set-up steps, and add 'withdraw instantly, any time' to the set-up screens and prompts before the push goes wide.
- researchSize the opportunity from account data instead of the survey mean: regular outbound transfers to savings providers, credit balances idle in current accounts, existing pot balances, and the profile of customers aged 75 or over.
- monitorTrack pot awareness and pot holding quarterly among customers without a pot, age-weighted, using the same awareness question.
Open-text themes it coded
Did not know pots exist or what they are; want Pennywell to tell them or explain 126Interest rate too low; want a higher or more competitive rate 45Pots hard to find in the app or set-up too complicated 40No spare money to save 23Savings kept with another provider out of habit, trust or loyalty 17Not interested in saving or in saving this way; nothing would change it 15Worry about how quickly money can be withdrawn 10
The survey it planned
3 screening questions and 10 questions, as the model wrote them.
-
S1
Do you currently have a Pennywell current account?
One answer- Yes
- No
- Not sure
Continues if Yes
-
S2
How old are you?
One answer- Under 18
- 18 to 34
- 35 to 54
- 55 to 74
- 75 or over
Continues if 18 to 34; 35 to 54; 55 to 74; 75 or over
-
S3
Pennywell offers 'savings pots' – savings accounts that you open inside the Pennywell app. Thinking about what you knew before today, which one of these best describes you? There are no right or wrong answers.
One answer- I have opened a savings pot (now or in the past)
- I knew Pennywell offered savings pots, but I have never opened one
- I had a vague idea Pennywell offered something like this, but I wasn't sure
- I did not know Pennywell offered savings pots
Continues if I knew Pennywell offered savings pots, but I have never opened one; I had a vague idea Pennywell offered something like this, but I wasn't sure; I did not know Pennywell offered savings pots
-
Q1
Which of the following, if any, are reasons why you have not opened a Pennywell savings pot? Please select all that apply.
Any that apply- I don't have spare money to save at the moment
- I already save with another provider and I'm happy there
- I haven't got round to it
- I don't know enough about how savings pots work
- I couldn't find them, or wasn't sure how to set one up, in the app
- The interest rate is lower than I can get elsewhere
- I don't know what interest rate they pay
- I prefer to keep my savings separate from my everyday bank account
- I mainly use Pennywell for spending, not as my main bank
- Another reason
- No particular reason / don't know
Routing Shown only if S3 is: I knew Pennywell offered savings pots, but I have never opened one; I had a vague idea Pennywell offered something like this, but I wasn't sure
-
Q2
As far as you know, what yearly interest rate (AER) do Pennywell savings pots currently pay? If you are not sure, please select 'I don't know' rather than guessing.
One answer- Less than 1%
- 1% to 1.99%
- 2% to 2.99%
- 3% to 3.99%
- 4% or more
- I don't know
Routing Shown only if S3 is: I knew Pennywell offered savings pots, but I have never opened one; I had a vague idea Pennywell offered something like this, but I wasn't sure
-
Q3
Thinking about cash savings you hold with providers other than Pennywell – for example savings accounts, cash ISAs or fixed-term savings, but not investments or pensions – roughly how much do you hold in total? A rough estimate is fine.
One answer- None
- Less than £1,000
- £1,000 to £4,999
- £5,000 to £9,999
- £10,000 to £24,999
- £25,000 to £49,999
- £50,000 or more
- Prefer not to say
-
Q4
How much of that money could you withdraw at any time without paying a penalty or losing interest (for example, money in an easy-access or instant-access account)?
One answer- All of it
- More than half
- About half
- Less than half
- None of it
- I don't know
Routing Shown only if Q3 is: Less than £1,000; £1,000 to £4,999; £5,000 to £9,999; £10,000 to £24,999; £25,000 to £49,999; £50,000 or more
-
Q5
What yearly interest rate (AER) does the account holding most of those savings pay? If you are not sure, please select 'I don't know' rather than guessing.
One answer- Less than 1%
- 1% to 1.99%
- 2% to 2.99%
- 3% to 3.49%
- 3.5% to 3.99%
- 4% or more
- I don't know
Routing Shown only if Q3 is: Less than £1,000; £1,000 to £4,999; £5,000 to £9,999; £10,000 to £24,999; £25,000 to £49,999; £50,000 or more
-
Q6
To help us check the quality of responses, please select 'Orange' from the list below.
One answer- Blue
- Green
- Orange
- Purple
-
Q7A
Here is how Pennywell savings pots work. A savings pot is a savings account that you open inside the Pennywell app. You can pay money in or take it out at any time, with no penalties. Savings pots pay interest of 3.1% AER (the rate you would earn over a year). Knowing this, how likely or unlikely are you to open a savings pot in the next 3 months? Please answer on a scale from 1 (Very unlikely) to 5 (Very likely).
ScaleScale 1-5: Very unlikely to Very likely
-
Q7B
Here is how Pennywell savings pots work. A savings pot is a savings account that you open inside the Pennywell app. You can pay money in or take it out at any time, with no penalties. Savings pots pay interest of 3.85% AER (the rate you would earn over a year). Knowing this, how likely or unlikely are you to open a savings pot in the next 3 months? Please answer on a scale from 1 (Very unlikely) to 5 (Very likely).
ScaleScale 1-5: Very unlikely to Very likely
-
Q8
If you opened a Pennywell savings pot on the terms just described, roughly how much do you think you would put into it in the first 3 months? Please include any money you would move from accounts elsewhere.
One answer- Nothing – I would not open one
- Less than £500
- £500 to £999
- £1,000 to £4,999
- £5,000 to £9,999
- £10,000 to £24,999
- £25,000 or more
- I don't know
-
Q9
Which one of the following, if any, would do the most to make you open a Pennywell savings pot?
One answer- A clear explanation in the app of what savings pots are and how they work
- A prompt on payday offering to set one up and move money into it
- A quicker or simpler way to set one up
- A higher interest rate than the one shown earlier
- Something else
- Nothing – I'm not interested in opening a savings pot
Sample plan
WHO: Random sample from the account database of current Pennywell customers aged 18+ with no record of ever opening a savings pot (about 361,000 people, 86% of 420,000). The sample is stratified by age band (18-34, 35-54, 55-74, 75+) using date of birth on file. S1-S3 confirm eligibility; anyone who says they have opened a pot is screened out and counted, as a check on the database flag.
COMPLETES AND QUOTAS: About 700 completes, with equal quotas of 175 per age band. Bands are deliberately over- or under-sampled relative to their size, and totals are weighted back to the true age profile of never-openers. Further weighting to database variables (tenure, balance band, app-login frequency) will be applied if responders differ from non-responders.
PRECISION – THE BOARD'S REQUIREMENT CANNOT BE MET WITH 700 COMPLETES:
- Plus or minus 5 points at 95% confidence in each band needs about 385 completes per band, about 1,540 in total.
- With 175 per band the margin is about plus or minus 7.4 points per band (worst case, 50% result).
- For the weighted total it is roughly plus or minus 4 to 5 points after the design effect from unequal sampling.
- Smaller bases are wider still. Q1/Q2 go only to customers who knew of pots, and each rate cell has about 350 in total and about 87 per band. Age differences on these will be directional only, and the rate experiment is read mainly at total level.
OPTIONS FOR THE BOARD: (a) Raise the target to about 1,540 completes (385 per band). This is recommended, because email invitations are cheap. (b) Accept about plus or minus 7.4 points per band. (c) Merge 55-74 and 75+ into 55+ and run three bands of about 233 (about plus or minus 6.4 points).
75+ BAND: An app-only bank may have few never-openers aged 75+. Check the database count before fieldwork. If the band is small, invite all of them and apply a finite population correction; if 175 cannot be reached, report 75+ as indicative or merged.
INVITATIONS: The response rate is unknown; the plan assumes 5-8%, so about 2,500-3,500 invitations per band, released in tranches with one reminder. Each band closes when its quota fills. The invitation and subject line describe 'a short survey about your Pennywell account' and do not mention savings pots or interest rates, so they neither inflate awareness nor attract only savers.
SURVEY SET-UP:
- Each respondent is randomly assigned 50/50, within age band, to see either Q7A (3.1%) or Q7B (3.85%), never both.
- No respondent sees more than 9 questions after the screener, and the survey should take under 5 minutes.
- Option order is randomised for Q1 (except the last two options) and Q9 (first four options).
- Respondents who fail Q6 are removed and replaced, as are speeders (under one-third of median time).
- A soft launch of about 50 completes checks timing and routing.