Benchmarks / SurveyBench / What Hollinbrook residents think of three-weekly bin collections / GPT-6.2 Sol

Measured by Spring Prompt

GPT-6.2 Sol: What Hollinbrook residents think of three-weekly bin collections

The decision: whether to move general waste collection to every three weeks across the whole district, to do so with extra support for households that need it (a larger bin, or extra collections of nappies and hygiene waste), to pilot it in some areas first, or to drop the proposal. The brief and the data →

Verdict
✓ Sound research
Research score
93 of 100
Analysis rating
1,354
Head to head, this task
won 7 of 12

Scorecard

Numbers 11 of 11 right

QuestionIts answerTrue
What percentage of open-consultation respondents tend to oppose or strongly oppose collecting general waste every three weeks (Q2)?✓77.5%77.5%
What percentage of residents' panel respondents tend to oppose or strongly oppose collecting general waste every three weeks (Q2)?✓45.3%45.3%
What percentage of residents' panel respondents strongly support or tend to support collecting general waste every three weeks (Q2)?✓40.8%40.8%
What is the 95% margin of error, in percentage points, on the share of residents' panel respondents who support the change (strongly or tend to)?✓4.69 points4.69 points
On the residents' panel, is the difference in the share supporting the change (strongly or tend to) between owner-occupiers and renters statistically significant at the 95% level? (1 for yes, 0 for no)✓NoNo
Among residents' panel respondents whose household includes a child under 3 or someone who uses continence or other hygiene products, what percentage chose 'every three weeks, with extra support for households that need it' as their preferred option (Q4)?✓55.6%55.6%
How many of the open-text answers are copies or near-copies of the template comment circulated by a local group?✓192209
How many of the open-text answers from residents' panel respondents mention hygiene: smell, flies, maggots or vermin, or nappies or hygiene waste sitting in the bin?✓99
As a percentage of all residents' panel respondents, how many oppose the change at Q2 and said they would support it if their household could have a larger bin at no extra charge (Q3)?✓10.2%10.2%
What percentage of residents' panel respondents said they would be very or fairly likely to recycle more if general waste were collected every three weeks (Q5)?✓40.5%40.5%
What percentage of the addresses invited by letter to the residents' panel produced a completed questionnaire?✓21.1%21.1%

Traps in the data 8 of 8 handled

  • ✓The open consultation is self-selected: anyone with the link could respond, Brookfield is 38% of it against 12% of households, and households with a young child or hygiene needs are over-represented. It shows 78% opposed, against 45% on the panel, which matches the district's age and tenure profile.
  • ✓209 open-consultation comments (16% of the consultation's responses) are copies or near-copies of a template circulated by Keep Brookfield Tidy.
  • ✓The council leader wants to show that residents support the change. Support is 41% on the panel (with 45% opposed) and 15% in the open consultation.
  • ✓Q3 was asked only of those who oppose: 22% of panel opponents would support the change with a larger bin, which is only 10% of all panel respondents; most opponents would still oppose.
  • ✓Wendle Vale (panel base 16) shows 62% support, far above any other ward.
  • ✓On the panel, owner-occupiers support the change more than renters (43% against 37%, bases 282 and 140), but the gap is not statistically significant at 95%.
  • ✓40% of the panel say they would be likely to recycle more: a stated intention about a hypothetical change.
  • ✓Only 422 of 2,000 addresses invited to the panel completed (about 21%); the panel is matched on age and tenure only, and those who replied may care more about bins than those who did not.

The analysis

Recommendation

Keep fortnightly black-bin collections district-wide for now. If the council can fund and safely run a time-limited trial, test three-weekly collections in a mix of town and rural routes with support available from day one. Offer larger bins for demonstrated capacity needs and test separate nappy and hygiene-waste collections for households that need more frequent removal. Keep comparable routes on fortnightly collections and leave food waste weekly and recycling fortnightly. Do not commit to rollout before reviewing the results. If proportionate support or a credible trial cannot be delivered, retain the current service rather than roll out untested.

What would change it

Move towards a supported rollout only if the trial shows a worthwhile reduction in residual waste, a measurable recycling or waste-prevention benefit, and a credible net saving after support and clean-up costs, without unacceptable increases in overflow, hygiene complaints, fly-tipping or unequal impacts. If those harms persist despite support, uptake is blocked by access barriers, or the benefits do not justify the costs, retain fortnightly collections. Consider unsupported rollout only if evidence shows that targeted support is unnecessary to meet the same safeguards.

Findings

  1. Council leader: No, the council cannot say residents back a district-wide move. The panel is divided, with opposition slightly ahead of support.

    Medium confidenceBase 422

    In the panel (n=422), 40.8% supported and 45.3% opposed at Q2. Strong opposition was more common than strong support (28.2% versus 17.3%). The nominal 95% margin of error on support is ±4.69 percentage points under simple random sampling assumptions; it does not account for recruitment bias.

  2. Cabinet member: Nearly four in five open-consultation respondents opposed the change. Take that opposition seriously, but do not treat it as a district-wide vote or as sufficient reason on its own to drop the proposal.

    High confidenceBase 1318

    Of 1,318 open-consultation respondents, 77.5% opposed and 58.0% strongly opposed. Brookfield supplied 38.0% of responses versus 12% of district households. Opposition was still about 74% among the 817 respondents outside Brookfield. The 192 template or near-template comments show organised participation, not that those responses were invalid or that campaigning explains the full gap with the panel.

  3. Head of waste services: No, a free larger bin did not bring most opponents round. Offer it as a capacity measure to test, not as a way to secure majority backing.

    High confidenceBase 191

    Among the 191 panel opponents asked Q3, 22.5% (43 people) said they would support the change with a free larger bin and 61.3% would still oppose. The 43 are 10.2% of the whole panel. Among 1,021 open-consultation opponents, 17.4% said they would support and 66.5% would still oppose.

  4. Households with young children or hygiene-product waste should shape the support offer. Extra capacity and more frequent removal address different problems.

    Medium confidenceBase 54

    In the panel, 74.1% of the 54 households in this group opposed the basic change, versus 41.0% of the other 368. Yet 55.6% of the 54 chose three-weekly collections with extra support as their first preference, versus 19.0% of other households. Q4 bundled support options, so it does not show which provision they would choose. Comments distinguish bins already full at two weeks from concerns about storing nappies or hygiene waste for longer.

  5. A supported trial is a way to resolve uncertainty, not a policy the survey gave a clear mandate to implement.

    High confidenceBase 422

    Panel first preferences at Q4 were tightly grouped: trial 25.4%, keep fortnightly 24.6%, three-weekly with support 23.7%, and district-wide three-weekly without specified support 22.0% (n=422). In the open consultation, keeping fortnightly was the largest single choice at 42.7%, followed by three-weekly with support at 25.9% (n=1,318). A preference for a trial is not endorsement of eventual rollout.

  6. Do not use the tenure difference to decide whom to exempt or where to run a trial.

    Medium confidenceBase 422

    Panel support was 42.6% among owners (n=282) and 37.1% among renters (n=140). The roughly 5.5-point gap was not significant in a conventional two-sided two-proportion test (p≈0.29); this does not establish that the groups have identical needs.

  7. Treat increased recycling as a benefit to measure, not a gain to book in advance.

    High confidenceBase 422

    40.5% of panel respondents (n=422) and 24.2% of open-consultation respondents (n=1,318) said they were very or fairly likely to recycle more. A further 11.8% of the panel said they already recycled everything they could. These are stated intentions and perceptions, not measured changes in waste.

Caveats

  • The open consultation was self-selected and online. It is useful for identifying objections, practical concerns and strength of feeling among participants, not for estimating district-wide opinion. Owner-occupiers were 81.5% of open respondents versus 67% in the district; households with young children or hygiene-product waste were 28.9% versus an estimated 15%. Do not pool the two samples.
  • The panel is the better guide to the district, but it is not a simple random sample of adults: addresses were randomly invited, adults opted in online, and places were filled to age and tenure targets. Only 422 of 2,000 invited addresses produced a complete (21.1%). Matching profiles does not remove nonresponse or digital-access bias. The reported margin and tenure test are nominal calculations, not design-adjusted guarantees.
  • The panel slightly underrepresented households with young children or hygiene-product waste (12.8% versus an estimated 15%). The subgroup of 54 gives a useful signal about support needs, not precise estimates of uptake. Ward bases are also small, especially Wendle Vale (n=16); do not choose trial areas by apparent ward support rankings.
  • Q3 was hypothetical and asked only of Q2 opponents. It does not measure whole-panel support for a larger-bin policy, actual uptake or the effect of separate hygiene collections. Q4 measured first preference among bundled options, not acceptance of each option. Q5 did not observe behaviour.
  • The comment counts are for the supplied entries: 401 are listed (299 open consultation and 102 panel), although the heading says 417. Reconcile this with the survey export before publishing counts as exhaustive. Near-copies retain the shared sequence of claims and the call for fortnightly collections despite differences in spelling, punctuation, intensity or sign-off. They are coded together, not removed from Q2. Comment frequencies do not estimate how common concerns are, and predicted increases in pests or fly-tipping are not observed outcomes.

Next steps

  • decisionPublish both surveys separately, reconcile the comment export, and agree the decision criteria and stop rules before authorising a trial.
  • researchDesign the support offer with carers, families with young children, people using continence products, larger households and residents with limited storage. Use phone, paper and in-person routes as well as online contact.
  • experimentRun a supported trial across contrasting town and rural routes, with a pre-trial baseline and comparable fortnightly routes. Include warm weather and enough collection cycles to assess sustained effects.
  • monitorMonitor outcomes by household need and housing circumstances, follow up with residents who do not request support, and report results before any rollout vote.

Open-text themes it coded

Campaign-template objection: overflow, summer smells and pests, nappies, fly-tipping and a call to retain fortnightly collections 192Own household lacks black-bin capacity or space for overflow 65Hygiene in independently worded comments: smells, flies, maggots, vermin or storing nappies and hygiene waste 35Fly-tipping or bags abandoned in public space in independently worded comments 15Fewer collections for the same council tax feels like poor value 40Expected encouragement to recycle, reduce waste or send less to landfill 57Little or no expected impact on own household 18

The survey it planned

2 screening questions and 10 questions, as the model wrote them.

  1. S1

    Are you aged 18 or over?

    One answer
    • Yes
    • No

    Continues if Yes

  2. S2

    Is your main home in the Hollinbrook District Council area? If you’re not sure, you can check which council serves your address before answering.

    One answer
    • Yes
    • No
    • Not sure

    Continues if Yes

  3. Q1

    Hollinbrook District Council needs to save £3.1 million next year. One proposal is to collect general waste (the black bin) every three weeks instead of every two weeks. The council estimates this would save about £600,000 a year in collection and disposal costs before any costs for extra support. Food waste would still be collected every week and recycling every two weeks. The full council will consider responses to this consultation before deciding in the autumn. How much would you support or oppose collecting black bins every three weeks across the district, without extra support for households?

    One answer
    • Strongly support
    • Tend to support
    • Neither support nor oppose
    • Tend to oppose
    • Strongly oppose
    • Not sure
  4. Q2

    If your black bin were collected every three weeks instead of every two, without extra support, how much easier or harder, if at all, would it be for your household to manage its general waste?

    One answer
    • Much easier
    • A little easier
    • No difference
    • A little harder
    • Much harder
    • Not sure
  5. Q3

    What effects, if any, would you expect for your household if your black bin were collected every three weeks without extra support? Select all that apply. If you select ‘None of these’ or ‘Not sure’, select only that answer.

    Any that apply
    • Running out of room in the black bin before collection day
    • Needing more space to store waste between collections
    • More problems with smells or pests
    • More difficulty managing used nappies, continence products or other hygiene waste
    • Having to make more trips to dispose of general waste
    • Less time or effort putting the black bin out
    • Another effect
    • None of these
    • Not sure
  6. Q4

    Which of the following apply to your household? Select all that apply. If you select ‘None of these’ or ‘Prefer not to say’, select only that answer.

    Any that apply
    • A child under 5 lives here
    • A child in the household uses disposable nappies or pull-ups
    • Someone in the household uses disposable continence products, such as pads or briefs
    • Someone in the household uses other disposable hygiene products, such as period products or wound dressings
    • None of these
    • Prefer not to say
  7. Q5

    If your black bin were collected every three weeks without extra support, would your household put out more, less or about the same amount for the fortnightly recycling collection compared with now? Please don’t count food waste collected separately.

    One answer
    • Much more
    • A little more
    • About the same amount
    • A little less
    • Much less
    • Not sure
  8. Q6

    Which of these options would you most prefer the council to choose? For all options, food waste would still be collected weekly and recycling every two weeks.

    One answer
    • Collect black bins every three weeks across the district, without extra support
    • Collect black bins every three weeks across the district, with extra support for households that need it, such as a larger black bin or extra collections for nappies and hygiene waste
    • Try collecting black bins every three weeks in some areas first, keep collections every two weeks elsewhere, and review the trial before deciding whether to extend it
    • Keep collecting black bins every two weeks across the district
    • No preference
    • Not sure
  9. Q7

    Now imagine the council offered extra support to households that need it, such as a larger black bin or extra collections for nappies and hygiene waste. How much would you support or oppose collecting black bins every three weeks across the district with this extra support?

    One answer
    • Strongly support
    • Tend to support
    • Neither support nor oppose
    • Tend to oppose
    • Strongly oppose
    • Not sure
  10. Q8

    What is your home postcode? This helps us compare responses from different parts of the district. Please enter only your postcode, not your full address. You can leave this blank.

    Open text
  11. Q9

    What is your age group?

    One answer
    • 18 to 24
    • 25 to 34
    • 35 to 44
    • 45 to 54
    • 55 to 64
    • 65 to 74
    • 75 or over
    • Prefer not to say
  12. Q10

    Which best describes how your household occupies your home?

    One answer
    • Owns it outright
    • Owns it with a mortgage or loan
    • Part owns and part rents it through shared ownership
    • Rents it from the council or a housing association
    • Rents it from a private landlord or letting agent
    • Lives there rent-free or under another arrangement
    • Not sure
    • Prefer not to say
Sample plan

Run the same questionnaire for both routes and record the recruitment source. For the residents’ panel, stratify the address sample by ward and randomly select addresses within each ward. Invite one adult per address by letter using a unique link or access code; ask the adult with the next birthday to respond. Use reminders and randomly drawn reserve batches to aim for about 420 eligible completes, roughly 70 per ward. Monitor age and tenure against the district profile, use broad targets rather than small ward-by-age-by-tenure quotas, and account for unequal selection and remaining profile imbalances in weighting. Publish a separate open link on the council website and promote it through social media and the residents’ magazine. Apply the same eligibility screen, with no quotas or fixed target for open responses. Test the questionnaire on mobile before launch to verify that it takes no more than six minutes and that the exclusive answers in Q3 and Q4 work as stated. The panel target cannot meet the requested ward precision: at 70 completes per ward, the approximate worst-case 95% margin of sampling error for a percentage is ±12 points under simple random sampling, before weighting. Achieving ±6 points at 95% confidence would require about 267 effective completes per ward, or 1,602 across six wards, and potentially more actual completes after allowing for weighting. Either increase the panel target or agree before fieldwork that ward results will be indicative.