Benchmarks / SurveyBench / Why Tallyroom trials don't convert / Muse Wonder

Measured by Spring Prompt

Muse Wonder: Why Tallyroom trials don't convert

The decision: where to put next quarter's product and sales effort to lift trial-to-paid conversion: a new accounting integration, assisted setup, a cheaper plan, or a shorter trial. The brief and the data →

Verdict
✓ Sound research
Research score
100 of 100
Analysis rating
1,460
Head to head, this task
won 13 of 16

Scorecard

Numbers 11 of 11 right

QuestionIts answerTrue
What percentage of respondents said they would need a Sage integration before paying?✓23.7%23.7%
Weighted to the company-size mix of all lapsed trials, what percentage would need a Sage integration?✓18.1%18.2%
Among businesses with 1-9 employees, what percentage gave 'didn't have time to set it up' as the main reason?✓27.4%27.4%
How many of the open-text answers mention not having time to set Tallyroom up, or setup taking too long?✓2424
What is the 95% margin of error, in percentage points, on the unweighted share of respondents needing a Sage integration?✓3.9 points3.89 points
Is the difference in the share giving 'too expensive' as their main reason between businesses with 1-9 employees and those with 50-249 statistically significant at the 95% level? (1 for yes, 0 for no)✓NoNo
Weighted to the company-size mix of all 1,640 lapsed trials, about how many teams' main reason was not having time to set it up?✓355355
How many of the open-text answers from businesses with 1-9 employees mention not having time to set Tallyroom up, or setup taking too long?✓1414
Weighted to the company-size mix of all lapsed trials, what percentage would give 'no integration with our accounting software' as their main reason?✓16.3%16.3%
What percentage of the trial admins invited completed the survey?✓28%28%
Among respondents whose main reason was no integration with their accounting software, what percentage said they would be likely (fairly or very) to pay if Tallyroom connected to it?✓61.3%61.3%

Traps in the data 7 of 7 handled

  • ✓Teams on 'Other' accounting software (base 17) mostly cite missing integration.
  • ✓Teams of 50-249 people are 22% of respondents but 10% of lapsed trials. They cite missing integration and use Sage far more, so unweighted figures overstate integration and Sage demand and understate setup time: unweighted, missing integration is the top reason; weighted, setup time is.
  • ✓Q2 is multi-select: percentages are of respondents and add up to more than 100%.
  • ✓Likelihood to pay is a hypothetical stated intention.
  • ✓The head of sales believes the trial is too long and teams forget about it.
  • ✓460 of 1,640 invited admins completed (about 28%), with a £10 voucher; those who respond may differ from those who do not.
  • ✓Only teams that did not pay were surveyed, so the survey cannot show what distinguishes them from teams that did; paying teams may also have struggled with setup.

The analysis

Recommendation

Next quarter: (1) Do not shorten the trial to 14 days. (2) Make assisted setup the lead conversion play, targeted first at 1-9 employee trials (done-for-you onboarding, setup in one sitting, team invites and approval rules configured with the admin, timed reminders well before day 30). (3) Approve Sage as a validated segment build/beta, sized on the weighted 18.1% need and 16.3% integration-blocked share rather than the 23.7% headline, and recruit Sage lapsed trials for a paid-intent beta before full build commitment. (4) Do not launch a blanket cheaper plan; instead test per-company/active-claimant pricing, since objections are mainly about paying for non-claimants. Keep approval-chain flexibility and receipt-scanning reliability as the following product priorities.

What would change it

A real-offer test that changes the economics: e.g. Sage beta users offered actual paid onboarding at GBP6/user/month converting materially below the 61.3% stated likelihood (or refusing prepayment/deposit), assisted-setup pilot failing to lift trial-to-paid versus control, behavioural product data showing most trials are actually activated within 14 days (which would reopen the trial-length question), or win/loss and pricing tests showing a simple price cut converts more profitably than per-company pricing.

Findings

  1. Do not cut the 30-day trial to 14 days: almost nobody says the trial was too long or that they forgot it, while setup incompletion is common. Shortening would likely remove time from the group already failing to finish setup.

    High confidenceBase 460

    Q2: 'trial was too long' 0.2% (about 1 of 460), 'forgot trial was running' 3.7%, 'trial was too short' 1.5%, versus 'didn't have time to set it up' 18.7% unweighted and 21.6% size-weighted. Open text repeatedly describes setup started but unfinished when the trial ended.

  2. Assisted setup is the largest addressable barrier after size-weighting, especially for 1-9 employee businesses, and should be the first operational priority for next quarter.

    High confidenceBase 460

    Q2 size-weighted 'didn't have time to set it up' is 21.6%, about 355 of 1,640 lapsed trials. Among 1-9 employee respondents it is 27.4% (46 of 168 approx.), versus 15.9% at 10-49 and 10.0% at 50-249. 24 of 109 open-text answers mention setup time, 14 of them from the 1-9 segment label.

  3. There is real demand for Sage, but the headline 23.7% overstates demand in the lapsed-trial population because larger firms are over-represented in the sample.

    High confidenceBase 460

    Q3 Sage integration: 23.7% unweighted, 95% margin of error +/-3.9pp, n=460. Reweighted to the population size mix (55% 1-9, 35% 10-49, 10% 50-249) it falls to 18.1%: 7.7% of 1-9, 28.0% of 10-49 and 40.9% of 50-249. Q2 'no integration' similarly falls from 20.2% unweighted to 16.3% weighted.

  4. Sage demand is concentrated, not general: it is driven by Sage users and larger lapsed trials, so a Sage build should be sold and validated as a segment play rather than assumed to lift all conversion.

    High confidenceBase 460

    Q3: 85.5% of Sage users (100 of 117) say they need Sage integration, versus 3.3% of Xero and 0.9% of QuickBooks users. Q2: 58.1% of Sage users give 'no integration' as main reason, versus 0.0% of Xero/QuickBooks users who already have integrations. FreeAgent need is much smaller overall at 7.2% unweighted, though 72.7% among its 33 users.

  5. For the finance director: connection alone does not convert most lapsed trials. Even among the integration-blocked, stated likelihood is encouraging but hypothetical and must not be treated as a payment forecast.

    Medium confidenceBase 93

    Q5 among those whose main reason was 'no integration' (n=93), 61.3% say fairly/very likely to pay GBP6/user/month if connected. Across all respondents only 37.6% are net likely, and likelihood is 23.3% among 'too expensive' and 27.9% among 'didn't have time'. Q5 was asked of Xero/QuickBooks users who already have a connection, so the question is partly counterfactual and stated intent will overstate actual payment.

  6. Price is a material but secondary barrier; the evidence points more to per-user pricing structure for occasional claimants than to a blanket cheaper plan.

    Medium confidenceBase 460

    Q2 'too expensive' is 15.9% overall. Q3 20.4% say they would need per-company (not per-user) pricing. Open text repeatedly objects to paying for every seat when only a few staff claim (e.g. T059, T208, T322, T343, T402). The 1-9 versus 50-249 difference in 'too expensive' (19.0% vs 15.5%) is not statistically significant at 95% (difference 3.5pp, approx. SE 4.6pp), so do not build a size-specific price story on it.

  7. Approval-workflow fit and receipt-scanning reliability are credible secondary product blockers that an integration or price change will not fix.

    Medium confidenceBase 460

    Q2: approval workflow didn't fit 12.6%, problems with mobile app 6.3%. Q3: custom approval chains 22.0%, better receipt scanning 15.0%. Open text gives concrete approval patterns Tallyroom cannot model (single MD approver, verbal/paper sign-off, two-stage and threshold approvals) and scanning failures (cropped totals, misread amounts, upload failures).

  8. A substantial minority are simply not in market and should be excluded from conversion upside calculations.

    High confidenceBase 460

    Q2: 'decided we didn't need it' 10.0% plus 'chose another tool' 8.7%. Q3: 36.5% need 'none of these', rising to 51.6% among Xero users. Open text includes very low claim volumes and company-card use making any expenses tool unnecessary.

Caveats

  • Response rate was only 28.0% (460 of 1,640) with a GBP10 voucher incentive; non-respondents may differ systematically and size-weighting only corrects the known size skew, not self-selection by accounting software, engagement or strength of grievance.
  • The sample badly over-represents larger businesses versus the lapsed-trial population (50-249: 23.9% of respondents vs 10% of population; 1-9: 36.5% vs 55%). All unweighted headlines, especially Sage and integration, are therefore inflated for the population; use weighted figures for sizing and unweighted figures only for within-segment reads.
  • No respondents report 250+ employees or 'we don't use accounting software', so nothing can be said about those groups, and Q5 bases are effectively all accounting-software users.
  • Q5 is stated hypothetical intent at GBP6/user/month, asked even of Xero/QuickBooks users who already have integration; it cannot be converted into expected paid conversion or revenue without a real offer test.
  • Open text is only 109 of 460 respondents and is self-selected, so theme counts indicate what exists, not population prevalence; use Q2/Q3 for prevalence.
  • Some open-text segment labels conflict with the business described in the answer itself (e.g. T010 labelled 50-249 but describes nine people; T164 labelled 50-249 but describes a four-person office), so verbatim-level segment attribution should be treated cautiously and checked against the product database before targeting.
  • Q3 is multi-select, so needs overlap (e.g. T322 and T334 cite both Sage and per-user price); percentages cannot be added to size a single combined opportunity.
  • Small bases limit precision for FreeAgent (n=33) and Other accounting software (n=17); do not prioritise integrations for those packages on this survey alone.

Next steps

  • experimentRun an assisted-setup pilot for new and restarted 1-9 employee trials: human setup call, completed configuration checklist, and day 7/14/21 prompts, randomised against current onboarding.
  • experimentRecruit Sage-using lapsed trials (starting from the 117 Sage respondents) into a Sage integration beta with a real paid offer, deposit or signed order form at GBP6/user/month before full build.
  • monitorKeep the 30-day trial and instrument activation milestones (account created, team invited, approval rules set, first receipt approved, accounting connected) by day since trial start.
  • experimentTest per-company or active-claimant pricing against current per-user pricing in a price page / reactivation offer, rather than cutting the headline price.
  • researchInterview and observe admins on approval patterns and scanning failures, then prototype configurable approval chains (threshold, category-based, external/paper-first approvers) and fix top receipt-capture failure modes.
  • researchRecontact or database-match the lapsed population to validate size and accounting-software targeting, and clean the verbatim segment inconsistencies before sales follow-up.

Open-text themes it coded

No accounting-software integration (including Sage, FreeAgent and other packages) 22No time for setup / setup took too long / setup left unfinished 24Price, per-user pricing and cost justification 23Approval workflow did not fit how the business signs off expenses 15Mobile app / receipt scanning or upload problems 10No need for an expenses tool 12Chose a competitor or another tool 8

The survey it planned

4 screening questions and 10 questions, as the model wrote them.

  1. S1

    Which of the following best describes your role in your team's recent Tallyroom trial?

    One answer
    • I set up or managed the trial and was involved in deciding whether to pay for Tallyroom
    • I set up or managed the trial but was not involved in deciding whether to pay for Tallyroom
    • I used the trial but did not set it up or manage it
    • I did not use or manage the trial

    Continues if I set up or managed the trial and was involved in deciding whether to pay for Tallyroom

  2. S2

    Is your business based in the UK?

    One answer
    • Yes
    • No

    Continues if Yes

  3. S3

    After your team's Tallyroom free trial ended, did your team start a paid Tallyroom plan?

    One answer
    • Yes, we started a paid plan
    • No, we did not start a paid plan
    • I don't know

    Continues if No, we did not start a paid plan

  4. S4

    How many employees does your business have?

    One answer
    • 1-9 employees
    • 10-49 employees
    • 50-249 employees
    • 250 or more employees

    Continues if 1-9 employees; 10-49 employees; 50-249 employees

  5. Q1

    Which of the following were reasons your team did not start a paid Tallyroom plan after the trial? Please select all that apply.

    Any that apply
    • The price was too high
    • It did not connect to the accounting software we use
    • A feature we need was missing
    • It took too much time or effort to set up
    • Our staff or managers did not use it
    • We did not have enough time to evaluate it during the trial
    • We forgot about it or it stopped being a priority
    • We chose a different expenses product
    • Our existing way of handling expenses is good enough
    • Our business needs or circumstances changed
    • We are still considering paying for Tallyroom
    • Another reason
  6. Q2

    And which one of these was the single biggest reason your team did not start a paid Tallyroom plan?

    One answer
    • The price was too high
    • It did not connect to the accounting software we use
    • A feature we need was missing
    • It took too much time or effort to set up
    • Our staff or managers did not use it
    • We did not have enough time to evaluate it during the trial
    • We forgot about it or it stopped being a priority
    • We chose a different expenses product
    • Our existing way of handling expenses is good enough
    • Our business needs or circumstances changed
    • We are still considering paying for Tallyroom
    • Another reason
  7. Q3

    Which accounting software, if any, does your business currently use?

    One answer
    • Xero
    • QuickBooks Online
    • Sage
    • FreeAgent
    • Zoho Books
    • Another accounting product
    • We do not use accounting software
    • I don't know
  8. Q4

    Which, if any, of the following were missing from Tallyroom and would have made your team more likely to start a paid plan? Please select all that apply.

    Any that apply
    • Integration with Sage
    • Integration with FreeAgent
    • Integration with Zoho Books
    • Integration with another accounting product
    • Automatic import of company card transactions
    • Mileage claims
    • Multi-currency expenses
    • More flexible approval rules
    • Reimbursing employees through Tallyroom
    • Integration with payroll or HR software
    • None of these - nothing important was missing
  9. Q5

    Please rank the following changes from 1 to 4, where 1 is the change that would have made your team most likely to start a paid Tallyroom plan and 4 is the least likely.

    Ranking
    • An integration with the accounting software my business uses
    • One-to-one help to set up Tallyroom and train our team
    • A lower monthly price per user
    • More time to trial Tallyroom before deciding
    Judges: assumptive

    The ranked options offer a longer trial but not the shorter trial under consideration, steering the trial-length comparison towards extension. The assisted-help option bundles setup help and team training into one rank. The accounting-integration option assumes the business uses accounting software, although Q3 permits businesses that do not.

    The 'integration with the accounting software my business uses' option assumes the business uses accounting software that is not already integrated. Q3 allows 'We do not use accounting software', and Xero and QuickBooks users may already be connected. There is no display logic, yet everyone is forced to rank this option.

  10. Q6

    Tallyroom currently costs £6 per user per month. What is the highest price per user per month, in pounds, that your team would have been willing to pay after the trial? Please enter a number. Enter 0 if you would not have paid at any price.

    Number
  11. Q7

    To check that we record your answers correctly, please select 'Disagree' below.

    One answer
    • Agree
    • Disagree
    • I don't know
  12. Q8

    Thinking about your 30-day trial, when did you last actively use Tallyroom before the trial ended?

    One answer
    • During days 1-7 of the trial
    • During days 8-14 of the trial
    • During days 15-21 of the trial
    • During days 22-30 of the trial
    • I did not actively use it after signing up
    • I don't remember
  13. Q9

    How did the length of the 30-day trial feel for evaluating whether Tallyroom was right for your team?

    Scale

    Scale 1-5: Far too short to Far too long

  14. Q10

    If your trial had lasted 14 days instead of 30 days, which of the following would most likely have happened?

    One answer
    • We would have started a paid plan within the 14 days
    • We still would not have started a paid plan, for the same reasons
    • We would not have had enough time to evaluate Tallyroom properly
    • We probably would not have got around to evaluating Tallyroom within 14 days
    • I don't know
Sample plan

Invite the named admin of each UK team whose Tallyroom trial ended without payment, one invitation per team, by email from the product database, with a £10 voucher on completion and up to two reminders. PRECISION CORRECTION: the stated c.450 completes cannot deliver ±6 percentage points at 95% confidence within each size band. At the worst case p=0.5, n = 1.96^2 x 0.25 / 0.06^2 = 267 completes per band, so set equal quotas of 267 for 1-9, 267 for 10-49 and 267 for 50-249 employees = 801 completes in total (450 split evenly would be c.150 per band, i.e. c.±8.0 points per band). Fill quotas using company size from the database, verified at S4, closing each band at 267. Expected frame from the last 90 days is only c.1,558 lapsed trials (1,900 starts per quarter x 82% not paying), and the 50-249 band is likely to be scarce, so invite all eligible admins from the last 90 days first; if any band is below quota, extend backwards in successive 90-day blocks to the most recent lapsed trials until the quota is met or the frame is exhausted, recording trial-end date for recency checks. If a band still cannot reach 267, report its achieved margin of error rather than claiming ±6 points. Monitor completes by size band during fieldwork, compare respondents with the invited frame on size and trial-end date, and exclude failed attention checks at Q7 from the analysis bases.