Benchmarks / SurveyBench / How Ashgrove patients find online-first booking / MiniMax M3.1 Flash
MiniMax M3.1 Flash: How Ashgrove patients find online-first booking
The decision: whether to keep online-first booking as it is, restore a morning phone booking line for every patient, or add a dedicated phone line and in-person help at reception only for patients who need them (over-75s, patients with a disability, and patients with limited English). The brief and the data →
- Verdict
- ✗ Not sound
- Research score
- 30 of 100
- Analysis rating
- 484
- Head to head, this task
- won 0 of 4
Why it is not sound
The analysis
- Produced no usable analysis
Scorecard
The analysis
This model produced no usable analysis for this task.
The survey it planned
2 screening questions and 12 questions, as the model wrote them.
-
S1
Are you currently registered with Ashgrove Medical Group?
One answer- Yes
- No
Continues if Yes
-
S2
Which age range includes your age?
One answer- 18 to 44
- 45 to 64
- 65 to 74
- 75 or over
- Under 18
Continues if 18 to 44; 45 to 64; 65 to 74; 75 or over
-
Q1
Since April 2026, have you requested an appointment at Ashgrove Medical Group in any way?
One answer- Yes
- No
- Not sure
-
Q2
Overall, how satisfied or dissatisfied are you with the way appointments are requested at Ashgrove since April 2026?
One answer- Very satisfied
- Satisfied
- Neither satisfied nor dissatisfied
- Dissatisfied
- Very dissatisfied
- I have not requested an appointment since April 2026
-
Q3
Since April 2026, have you ever needed an appointment but not requested one because of the way appointments are booked at Ashgrove?
One answer- Yes
- No
- Not sure
-
Q4
Which of the following contributed to your decision not to request an appointment? Select up to three.
Any that apply- I do not use the internet or could not get online
- I found the online form difficult to understand or complete
- I needed help from someone to use the online form
- I preferred to speak to someone
- I did not know how to request an appointment
- I was not confident the form would help me get the right appointment
- I was concerned about waiting for a text or phone reply
- I could not use or get through on the telephone
- I could not get help at reception
- I needed an interpreter or communication support
- I could not explain my symptoms or needs in writing
- I was concerned an appointment time or location would not suit me
- Another reason (please describe)
Routing Shown only if Q3 is: Yes
-
Q5
If you needed to use Ashgrove's online request form, which statement best describes your situation?
One answer- I could complete it confidently without help
- I could complete it with a little help
- I would need a lot of help
- I could not use the online form
- I have not used the online form
- Not sure
Judges: ambiguousThe question asks about hypothetical ability, but 'I have not used the online form' answers past experience instead. Someone who has never used it could select that option or any ability category, making responses ambiguous between non-use and capability.
The options mix hypothetical capacity ('I could complete it confidently') with past behaviour ('I have not used the online form'). It is unclear if someone who has not used the form but could use it confidently should choose the capacity statement or the non-usage statement.
-
Q6
When you need an appointment, how would you prefer to request it?
One answer- Use the online request form
- Telephone the practice
- Request it in person at reception
- Ask a family member, friend or carer to submit the request for me
- It depends on the situation
- No preference
- Another way (please describe)
-
Q7
Which of the following booking arrangements would you prefer for Ashgrove?
One answer- Keep online-first booking as it is
- Restore a morning phone booking line available to every patient
- Add a dedicated phone line and in-person help at reception only for patients aged 75 or over, patients with a disability, and patients who need an interpreter
- Keep online-first booking and add both a morning phone line for every patient and extra help for patients who need them
- No preference
- Another arrangement (please describe)
-
Q8
What would make it easier for you to request an appointment? Select up to three.
Any that apply- A shorter online form
- More guidance in the online form about symptoms and urgency
- Clearer instructions about how to book
- Help completing the online form by phone
- In-person help at reception
- A dedicated phone line
- More flexible opening hours
- A quicker text or phone reply
- More appointment times or greater availability
- Larger text or a more accessible format
- British Sign Language or interpreter support
- More time to complete the online form
- Clearer information about how requests are assessed
- Nothing; the current system works for me
- Another improvement (please describe)
-
Q9
Thinking only about your most recent appointment request since April 2026, what was the main outcome?
One answer- I was offered an appointment that suited me
- I was offered an appointment, but it did not suit me
- I was offered a telephone consultation or clinical advice instead
- I was told that I did not need an appointment
- I was told that no appointment was available
- I did not receive a reply
- I had to contact the practice again
- Another outcome (please describe)
Routing Shown only if Q1 is: Yes
-
Q10
How long did it take Ashgrove to first respond to your most recent appointment request since April 2026?
One answer- Within 24 hours
- 2 calendar days
- 3 to 5 calendar days
- 6 or more calendar days
- I have not received a reply
- Not sure
Routing Shown only if Q1 is: Yes
Judges: ambiguousThe answer options mix hours and calendar days, and there is no option for 1 calendar day. A reply the next day but more than 24 hours later, or 25 to 47 hours later, has no clear category, so respondents could place the same response time in different options.
The gap between 'Within 24 hours' and '2 calendar days' is unclear; a respondent who received a reply in 36 hours might not know which option to select.
-
Q11
Do you consider yourself to have a disability or long-term physical or mental health condition that affects your day-to-day activities?
One answer- Yes
- No
- Prefer not to say
-
Q12
Do you need an interpreter to communicate with Ashgrove Medical Group in English?
One answer- Yes
- No
- Not sure
Sample plan
Frame and invitation: Send a neutral SMS to all approximately 17,100 registered adults with a mobile number, for example: 'Ashgrove Medical Group is asking registered adult patients about appointment booking. Please tell us about your experience in this short survey: [link]. It takes about five minutes. Please answer based on your own experience.' Do not imply that online-first booking is working. Send up to two reminders to nonrespondents, prioritising age bands below quota, and allow one response per mobile number or survey token. Record invitations, starts and completes by age band. Precision and quotas: the approximately 900-complete target is incompatible with the requested plus or minus 5 percentage-point precision for all four age bands. At the worst-case proportion of 50%, 95% precision of plus or minus 5 points requires approximately 385 completes in each band, or 1,540 completes in total. With only 900 completes and equal allocation, each band would have about 225 responses and a maximum margin of error of approximately 6.5 points. Therefore, set minimum quotas of 385 usable completes in each of 18-44, 45-64, 65-74 and 75-or-over, and continue to at least 1,540 completes rather than stopping at 900. If 900 is an absolute cap, the practice must accept wider uncertainty or revise the precision requirement. Monitor additional soft targets of at least 200 respondents identifying a disability and at least 100 respondents needing an interpreter; if these remain too small, report their exact sample sizes and confidence intervals and avoid overinterpreting them. Report each age-band result without weighting, and weight overall results to the age distribution of mobile-numbered registered adults. These are voluntary-response estimates, so nominal margins of error do not measure nonresponse bias. Adults without a mobile number are outside the SMS frame; results should not be generalised to all registered adults without additional recruitment. Pilot the unchanged questionnaire with 30-50 respondents and confirm a median completion time below five minutes and a 90th-percentile time no greater than six minutes.