Benchmarks / SurveyBench / How Ashgrove patients find online-first booking / Kimi K3.1 Pro

Measured by Spring Prompt

Kimi K3.1 Pro: How Ashgrove patients find online-first booking

The decision: whether to keep online-first booking as it is, restore a morning phone booking line for every patient, or add a dedicated phone line and in-person help at reception only for patients who need them (over-75s, patients with a disability, and patients with limited English). The brief and the data →

Verdict
✗ Not sound
Research score
30 of 100
Analysis rating
608
Head to head, this task
won 0 of 5

Why it is not sound

The analysis

  • Produced no usable analysis

Scorecard

The analysis

This model produced no usable analysis for this task.

The survey it planned

1 screening question and 12 questions, as the model wrote them.

  1. S1

    This survey is for patients aged 18 or over who are registered at Ashgrove Medical Group. Are you aged 18 or over and currently registered there as a patient?

    One answer
    • Yes
    • No
    • Don't know

    Continues if Yes

  2. Q1

    Since April 2026, which of these have happened when you or someone else tried to get an appointment at Ashgrove Medical Group for you? Select all that apply. If you have not tried, select only the last option.

    Any that apply
    • I completed the online request form myself
    • Someone else completed the online request form for me
    • I started the online request form but did not finish it
    • I phoned the practice, or someone phoned for me
    • I asked at reception in person, or someone asked for me
    • I have not tried to get an appointment since April 2026
  3. Q2

    Thinking about the most recent time you or someone else tried to get an appointment for you, how satisfied or dissatisfied were you with the booking process? Please rate the process, not the care you received.

    One answer
    • Very dissatisfied
    • Dissatisfied
    • Neither satisfied nor dissatisfied
    • Satisfied
    • Very satisfied
    • Don't know or can't remember

    Routing Shown only if Q1 is: I completed the online request form myself; Someone else completed the online request form for me; I started the online request form but did not finish it; I phoned the practice, or someone phoned for me; I asked at reception in person, or someone asked for me

  4. Q3

    Since April 2026, has the booking process ever put you off contacting Ashgrove Medical Group when you needed an appointment?

    One answer
    • Yes, I decided not to contact the practice at all
    • Yes, I delayed contacting the practice
    • Yes, both of these
    • No
    • I have not needed an appointment since April 2026
    • Don't know or can't remember
  5. Q4

    Why did the booking process put you off or delay you? Select all that apply.

    Any that apply
    • I did not know how the booking process worked
    • I could not get online or did not have a suitable device
    • I found the online form difficult to use
    • The online form took too long
    • I did not want to describe my health problem in writing
    • I preferred to speak to someone
    • It was too difficult to get help by phone
    • It was too difficult to get help in person
    • My disability or health made the process difficult
    • I needed help with English or an interpreter
    • I was worried about privacy or security
    • I thought it would take too long to get a response or an appointment
    • A previous request was not handled well
    • Another reason

    Routing Shown only if Q3 is: Yes, I decided not to contact the practice at all; Yes, I delayed contacting the practice; Yes, both of these

  6. Q5

    If you needed an appointment in future, which one way would you most prefer to use to ask for it?

    One answer
    • Fill in the online request form myself
    • Ask someone else to fill in the online request form for me
    • Phone the practice
    • Go to reception and ask in person
    • Use another method
    • No preference
  7. Q6

    Which one of these booking arrangements would you prefer Ashgrove Medical Group to use?

    One answer
    • Online-first booking as it is now, with reception phones for patients who cannot go online
    • Online-first booking, with reception phones for patients who cannot go online, plus a morning phone booking line that any patient can use
    • Online-first booking, with reception phones for patients who cannot go online, plus a dedicated phone line and in-person help at reception for patients aged 75 or over, patients with a disability or patients with limited English
    • None of these
    • Don't know
  8. Q7

    What, if anything, would make it easier for you to ask Ashgrove Medical Group for an appointment? Select up to three. If nothing needs to change, select only that option.

    Any that apply
    • A phone booking line that any patient can use
    • A dedicated phone line for patients who need extra help
    • Help at reception to use the online form or request an appointment
    • A shorter, simpler online form
    • Clearer instructions about how to request an appointment and what happens next
    • A clear expected response time and updates by text or phone
    • Help for patients without internet access or a suitable device
    • Forms and information in my preferred language, and access to an interpreter
    • Online forms that work better with assistive technology
    • The option for someone I trust to complete the form for me
    • More appointments or more choice of appointment times
    • Nothing; the current process works well for me
    • Something else
  9. Q8

    You can use this space to explain any of your answers or suggest anything else that would make booking easier. Please do not include details of your medical condition. This question is optional.

    Open text
  10. Q9

    Which age group are you in?

    One answer
    • 18 to 44
    • 45 to 64
    • 65 to 74
    • 75 or over
    • Prefer not to say
  11. Q10

    Do you have any physical or mental health conditions or illnesses lasting, or expected to last, 12 months or more that reduce your ability to carry out day-to-day activities?

    One answer
    • Yes, a lot
    • Yes, a little
    • No
    • Prefer not to say
  12. Q11

    When you contact Ashgrove Medical Group, do you need an interpreter or other help with English?

    One answer
    • Yes, always
    • Yes, sometimes
    • No
    • Prefer not to say
  13. Q12

    How confident are you filling in forms online, including on a mobile phone?

    One answer
    • Very confident
    • Fairly confident
    • Not very confident
    • Not at all confident
    • I cannot get online
    • Prefer not to say
Sample plan

Send a de-duplicated, single-use SMS invitation to every registered adult patient with a mobile number on record, followed by one reminder and accessible reminders to under-represented age groups if needed. Target approximately 900 eligible completes with usable age data, using operational quotas of 225 in each Q9 age band. Monitor disability and interpreter-need subgroups, report their achieved base sizes, and do not invent population quotas where reliable frame counts are unavailable. Make the questionnaire accessible by screen reader and mobile phone, provide the practice's main community-language versions where feasible, and allow a trusted person to assist. Weight overall estimates back to the practice's registered-adult age distribution because of the equal age quotas; report unweighted bases and actual confidence intervals. The partners' precision requirement cannot be met conservatively in all four bands with 900 completes: 225 per band gives a worst-case margin of about ±6.5 percentage points at 95% confidence under simple random sampling, before weighting. Approximately 385 completes per band, or about 1,540 overall, would normally be needed for ±5 points, subject to any defensible finite-population correction using actual band counts. The partners must therefore increase the completes or relax the precision or age-band requirement; do not describe 900 as meeting it. If a quota cannot be filled, report the shortfall rather than silently replacing it with another age group. Finally, this SMS-online frame excludes patients without a mobile number on record and may under-represent digitally excluded, disabled and limited-English patients. Weighting cannot repair that coverage, so results must not be presented as the certain views of all registered patients, and non-digital research should supplement them before decisions are made about patients the survey cannot reach.