Benchmarks / SurveyBench / Why Quaymark's customer score fell / Gemini 4 Hydrogen
Gemini 4 Hydrogen: Why Quaymark's customer score fell
The decision: whether to reverse the per-shipment fee and bring back the subscription, invest in shipment tracking and proactive delay alerts, or add account managers for mid-sized customers. The brief and the data →
- Verdict
- ✓ Sound research
- Research score
- 100 of 100
- Analysis rating
- 1,088
- Head to head, this task
- won 8 of 11
Scorecard
Numbers 12 of 12 right
| Question | Its answer | True | |
|---|---|---|---|
| What is the Q3 2026 wave's NPS across all respondents (percentage scoring 9-10 minus percentage scoring 0-6), unweighted? | ✓ | 12.9 | 12.9 |
| Weighted to the shipments-a-month mix of all 4,720 active accounts, what is the Q3 2026 wave's NPS? | ✓ | 17.7 | 17.8 |
| Re-weighted to the shipments-a-month mix of the Q1 2026 wave's respondents, what is the Q3 2026 wave's NPS? | ✓ | 20.3 | 20.3 |
| Among respondents who scored 0-6 and answered the open question, what percentage of answers mention tracking (not being able to see where shipments are) or late or missed collections or deliveries? | ✓ | 68.9% | 68.9% |
| How many of the open-text answers mention the per-shipment fee or its cost? | ✓ | 21 | 21 |
| What is the 95% margin of error, in percentage points, on the Q3 2026 wave's unweighted share of respondents scoring 9-10? | ✓ | 4.1 points | 4.12 points |
| Among accounts booking 100 or more shipments a month, is the change in the share scoring 9-10 between the Q1 2026 and Q3 2026 waves statistically significant at the 95% level? (1 for yes, 0 for no) | ✓ | No | No |
| What percentage of the accounts invited to the Q3 2026 wave completed it? | ✓ | 11% | 11% |
| Among Q3 2026 respondents booking fewer than 20 shipments a month, what percentage said the per-shipment fee is worse for their business than the subscription? | ✓ | 49.2% | 49.2% |
| Among accounts booking fewer than 20 shipments a month, by how many points did NPS fall between the Q1 2026 and Q3 2026 waves? | ✓ | 3.9 points | 3.9 points |
| How many Q3 2026 respondents who send shipments to the Republic of Ireland scored 0-6? | ✓ | 13 | 13 |
| Weighted to the shipments-a-month mix of all 4,720 active accounts, about how many accounts would score 0-6? | ✓ | 1,001 | 1,001 |
Traps in the data 8 of 8 handled
- ✓The Q1 wave (+24) was phone interviews by account managers; the Q3 wave (+13) was online. Interviewer-administered scores, especially when the interviewer is the customer's own account manager, run higher, so part of the fall may be the change of method rather than a change in loyalty.
- ✓Accounts booking fewer than 20 shipments a month are 61% of Q3 respondents against 30% in Q1 and 40% of active accounts, and they score lowest (Q3 NPS +5). Re-weighted to Q1's mix the Q3 NPS is +20.3, and to the active-account mix +17.8, so much of the 11-point fall is a change in who answered.
- ✓The commercial director believes the fee caused the fall. Among detractors who explained their score, 69% mention tracking or delays and 18% the fee; only 39% of all respondents say the fee is worse than the subscription (49% of small accounts, 15% of the largest).
- ✓Respondents who ship to Ireland (base 14) are nearly all detractors (NPS -93).
- ✓45% of small accounts say they would be likely to choose a monthly subscription if offered: a stated intention about a hypothetical, with no price given.
- ✓521 of 4,720 invited accounts completed (about 11%); unhappy customers and small accounts may be more likely to respond online.
- ✓Among accounts booking 100 or more a month (bases 98 and 48), the promoter share moved from 49% to 52%, NPS +38 to +38: not significant.
- ✓The 69% figure is a share of the 45 detractors who answered the open question, not of all respondents or all customers.
The analysis
Invest in live shipment tracking and proactive delay alerts (paired with haulier punctuality remediation), keep the per-shipment fee rather than reverting to the old subscription, and do not add named account managers for mid-sized customers. Tell the CEO the 11-point drop is largely a mix and mode artifact (not a proven loyalty collapse); tell the commercial director that mid and large accounts mostly accept the per-shipment fee and tracking/delays drive far more detractors than fees; and tell the operations director that Ireland shows a severe warning signal (-93 NPS) on a tiny base (n=14) that requires immediate audit of haulier SLA logs rather than guessing from survey percentages alone.
Three pieces of evidence would change this recommendation: (1) Transaction and cohort churn data from March-September 2026 showing a sharp drop in retention or booking frequency among <20/month or high-frequency small-parcel shippers whose lifetime value loss exceeds the per-shipment fee gain—which would justify testing an optional capped/tiered subscription for smaller accounts; (2) Operational carrier SLA logs showing Ireland shipments fail far more often than UK domestic lanes due to customs or specific Irish partner hauliers—which would require immediate Ireland-specific carrier replacement ahead of general tracking work; (3) Churn/win-loss interviews with lapsed 20-99 accounts showing they left specifically for lack of dedicated account management rather than tracking or delivery reliability.
Findings
-
Answering the chief executive: the board should NOT be told that customer loyalty fell by 11 points between Q1 and Q3, because most of the apparent +24 to +13 drop is an artifact of sample mix and survey mode.
Q3 unweighted NPS is +12.9 (rounded +13; 35.9% promoters minus 23.0% detractors, n=521) vs Q1 +24 (n=412). However, Q3 over-sampled small <20/month accounts (61.2% vs 40% of the 4,720 active accounts and 30.1% of Q1) and under-sampled 100+ accounts (9.2% vs 18% population and 23.8% Q1). Re-weighted to Q1's segment mix, Q3 NPS is +20.3; weighted to the active population mix, it is +17.7. Within bands, changes are modest or flat (<20: +8.9 to +5.0; 20-99: +25.8 to +21.4; 100+: +37.8 to +37.5, promoter change not significant, p>0.7), and Q1 was conducted by phone by account managers (prone to interviewer politeness bias) whereas Q3 was an unmediated online survey.
-
Prioritise live shipment tracking and proactive delay alerts: visibility and late/missed collections are the primary drivers of customer dissatisfaction across every volume segment.
On Q7 (up to two choices, n=521), 65.6% selected live tracking (41.3%) or delay alerts (34.2%)—including 69.2% of detractors, 69.6% of passives, 65.8% of <20, 63.0% of 20-99, and 72.9% of 100+ accounts. Satisfaction with seeing where shipments are (Q4) is the weakest metric (28.6% dissatisfied vs 41.2% satisfied), and punctuality (Q3) is 22.4% dissatisfied vs 50.3% satisfied. Both strongly separate detractors from promoters (Q4 dissatisfied: 48.4% of detractors vs 8.0% of promoters; Q3 dissatisfied: 44.1% vs 8.0%). In Q2 open text, 68.9% (31/45) of detractors cite tracking gaps or late/missed collections/deliveries.
-
Answering the commercial director: do NOT reverse the per-shipment fee globally—half of customers say it is better or about the same, mid/large accounts largely accept it, and pricing is not the main cause of low scores.
Overall on Q5 (n=521), 49.9% say the per-shipment fee is better (20.0%) or about the same (29.9%) vs 39.0% worse (7.5% joined after March 2026). Acceptance is high in higher-value segments: 65.6% of 20-99 accounts (n=154) and 72.9% of 100+ accounts (n=48) say better or about the same, vs only 38.8% of <20 accounts (49.2% worse, n=319). On Q6, 39.5% overall say they are likely to choose an unpriced hypothetical subscription vs 36.7% unlikely. On Q7, lower booking fees rank 4th at 22.6% (25.0% of detractors), and only 21 of 186 Q2 answers (11.3%, and 8/45 detractors) mention fees.
-
Do NOT add named account managers for mid-sized (20-99) customers; demand is low and customers are contacting support mainly to chase missing tracking updates.
Only 15.6% of 20-99 accounts (n=154) selected a named account manager on Q7 (14.2% overall; 11.0% for <20; 31.2% for 100+, where live tracking still led at 54.2%). By contrast, 63.0% of 20-99 accounts want live tracking or delay alerts, and 22.1% want quicker support replies. In Q2, respondents repeatedly link support calls and emails directly to lack of tracking or missed pickups.
-
Answering the operations director: Ireland customers show an alarming negative signal, but the survey base (n=14) is too small on its own to prove a systemic Ireland-only operational failure.
Among the 14 respondents who send shipments to the Republic of Ireland (2.7% of 521; another 11 were not sure), 13 scored 0-6 (92.9%) and 1 scored 7-8 (7.1%), giving an NPS of -93 vs +16 for non-Ireland accounts (n=496). Six of the seven Ireland respondents answering Q2 cited multi-day delays, missed collections, or poor tracking (one cited the fee). Because n=14 has wide sampling error, operational carrier logs are required to verify whether Ireland lanes perform worse than UK domestic lanes.
-
Quaymark's fast quote-and-booking workflow is a clear competitive strength that must be protected while fixing post-booking reliability and visibility.
In Q2 open-text responses (n=186), 79 respondents (42.5%) spontaneously praised the speed and simplicity of getting a quote and booking a collection (often citing a two-minute flow), including passives and detractors who otherwise scored Quaymark down solely for post-collection tracking black holes, missed pickup slots, or slow support/claims.
Caveats
- Methodological break between Q1 and Q3: Q1 was run by phone by customers' own account managers (412 interviews from 640 called), which introduces social desirability bias and non-random selection, whereas Q3 was an unmediated online survey.
- Low Q3 response rate (11.0%, 521/4,720) and strong segment skew: <20/month accounts make up 61.2% of Q3 completes vs 40% of active accounts (and 30.1% of Q1), while 100+ accounts are 9.2% vs 18% of active accounts; all published tables are unweighted.
- Active-account screener survivorship: both S1 and the sample frame exclude customers who churned or stopped booking after the March 2026 fee change, so pricing-driven attrition cannot be measured from this survey alone.
- Unpriced hypothetical bias in Q6: asking willingness to choose a monthly subscription without specifying price tiers overstates real take-up.
- Small subgroup bases: Republic of Ireland (n=14, plus 11 'Not sure') and 100+ shipments/month (n=48, MOE ±14.1 pp on promoters) have wide margins of error.
- Open-text self-selection: 186 of 521 respondents answered Q2 (and 45 of 120 detractors), so open-text proportions reflect vocal writers rather than all respondents.
- NPS measures stated recommendation intent rather than actual repeat booking, revenue retention, or churn.
Next steps
- decisionGreenlight engineering and carrier-integration roadmap for live milestone tracking (collection scan, depot scans, ETA) and proactive alerts when collections or deliveries slip.
- researchAudit operational haulier SLA logs (on-time collection, on-time delivery, and scan completeness) segmented by Republic of Ireland vs UK domestic lanes and by carrier.
- researchAnalyse March-September 2026 booking and churn cohorts by shipment volume band (<20, 20-99, 100+) and parcel vs pallet mix to measure actual post-fee attrition (missed by the active-account screener).
- experimentIf cohort analysis shows elevated churn among price-sensitive <20/month or frequent small-parcel accounts, run a priced A/B or Van Westendorp pricing test for an optional low-tier monthly bundle rather than reversing per-shipment fees globally.
- monitorStandardise future quarterly NPS waves on a single unmediated online methodology, weight results to active-account volume bands (40%/42%/18%), and include recently lapsed accounts.
Open-text themes it coded
Fast and simple quote-and-booking flow 79Missing, vague, or un-updated shipment tracking 42Late or missed collections and delayed deliveries 29Generally satisfactory, neutral, or too new to judge 22Per-shipment fee and higher cost than monthly subscription 21Slow or hard-to-reach customer support 6Damaged goods and slow, burdensome claims process 5
The survey it planned
2 screening questions and 10 questions, as the model wrote them.
-
S1
Are you the main contact responsible for booking pallet or parcel shipments for your business on Quaymark?
One answer- Yes, I am the main booking contact
- I share booking equally with colleagues
- No, someone else in the business handles most bookings
Continues if Yes, I am the main booking contact
-
S2
Has your business booked at least one shipment through Quaymark in the last three months?
One answer- Yes, at least one shipment in the last three months
- No, we have not booked a shipment in the last three months
Continues if Yes, at least one shipment in the last three months
-
Q1
On a scale of 0 to 10, how likely are you to recommend Quaymark to another business or colleague?
ScaleScale 1-11: 0 - Not at all likely to 10 - Extremely likely
-
Q2
What is the main reason for the score you gave?
Open text -
Q3
Which of the following, if any, have worked well for your business on Quaymark over the last three months? Please select all that apply.
Any that apply- Speed and ease of getting quotes and booking
- Reliability of pallet and parcel collections
- Online shipment tracking
- Updates when a shipment is delayed
- Customer support when an issue comes up
- Pricing and booking fees
- Account management or dedicated contact
- None of these
-
Q4
And which of the following, if any, have caused problems or frustration for your business over the last three months? Please select all that apply.
Any that apply- Speed and ease of getting quotes and booking
- Reliability of pallet and parcel collections
- Online shipment tracking
- Updates when a shipment is delayed
- Customer support when an issue comes up
- Pricing and booking fees
- Account management or dedicated contact
- We have not experienced any problems
-
Q5
Thinking about Quaymark's per-shipment booking fee (£3.50 per shipment, or lower for accounts booking 100 or more a month), how fair do you consider this fee for the service you receive?
ScaleScale 1-5: 1 - Very unfair to 5 - Very fair
-
Q6
In March 2026, Quaymark moved from a monthly subscription (starting from £25 a month) to a per-shipment booking fee (£3.50 per shipment, reduced for accounts booking 100 or more a month). Which pricing model would suit your business better?
One answer- Per-shipment booking fee (pay only when you book)
- Monthly subscription (fixed monthly fee with no per-shipment booking fee)
- No preference — either works equally well
- Not sure
-
Q7
If Quaymark could focus on four changes over the next six months, please rank them from 1 (most valuable to your business) to 4 (least valuable to your business).
Ranking- More detailed, real-time online shipment tracking
- Proactive alerts when a shipment is delayed
- A dedicated account manager for your business
- Returning to a monthly subscription instead of a per-shipment booking fee
-
Q8
To help us check data quality, please select "Quarterly" from the options below.
One answer- Weekly
- Monthly
- Quarterly
- Annually
-
Q9
On average, how many shipments (pallets and parcels combined) does your business book through Quaymark each month?
One answer- Fewer than 20 shipments a month
- 20 to 99 shipments a month
- 100 or more shipments a month
-
Q10
When did your business start booking shipments through Quaymark?
One answer- Before March 2026
- March 2026 or later
- Not sure
Sample plan
Send an email invitation (with two targeted reminders over a 14-day fieldwork window) to the main booking contact of all 4,720 active UK business accounts in Quaymark's CRM database, targeting approximately 520 completed interviews (~11% response rate). Pre-tag invitation links by historical CRM monthly volume (<20, 20 to 99, and 100+ shipments a month) and set soft disproportionate stratified quotas of ~174 completes per segment (verified via Q9), using targeted reminders to boost response in smaller high-volume segments (100+). Post-stratification weights will be applied using actual CRM segment proportions when reporting overall NPS. Important statistical caveat for the board: achieving a +/-5 percentage point margin of error at 95% confidence for the 9-10 promoter share within each individual account-size band requires roughly 323 to 384 completes per band before finite population correction (assuming a 30%-50% promoter share), or ~970 to 1,152 completes in total if all three bands are large. With the 520-complete budget (~173 per band), the achieved 95% margin of error per segment will be roughly +/-6.8 to +/-7.5 percentage points unless a band's total active population is small enough that finite population correction reduces the required sample (for example, ~152 completes if a segment has ~250 total accounts). If strict +/-5 percentage point precision is required in every segment, Quaymark should either expand fieldwork/incentives to reach ~1,000+ completes or accept ~+/-7 percentage points per segment.