Benchmarks / SurveyBench / What Hollinbrook residents think of three-weekly bin collections / Gemini 4 Hydrogen
Gemini 4 Hydrogen: What Hollinbrook residents think of three-weekly bin collections
The decision: whether to move general waste collection to every three weeks across the whole district, to do so with extra support for households that need it (a larger bin, or extra collections of nappies and hygiene waste), to pilot it in some areas first, or to drop the proposal. The brief and the data →
- Verdict
- ✗ Not sound
- Research score
- 84 of 100
- Analysis rating
- 1,088
- Head to head, this task
- won 6 of 9
Why it is not sound
The survey
- Presumed the stakeholder's view instead of testing it
- A leading question: Q1
- A leading question: Q5
The analysis
- Reported a material finding the data does not support
Findings the judges found unsupported
Answering the cabinet member for environment: the 'nearly four in five oppose' headline (77.5%) is an artefact of self-selection and an organised Brookfield campaign, not representative district opinion, so the proposal should not be dropped on that basis.
Calling the 77.5% opposition figure an artefact of self-selection and the campaign overstates what is established. The evidence demonstrates an unrepresentative sample and organised participation, but does not establish how much of the opposition either caused. The consultation also records genuine strength of feeling among engaged or affected households.Households with children under 3 or continence/hygiene waste needs strongly oppose an unmitigated switch (74.1%), but a clear majority back three-weekly collections if extra support is provided (55.6%).
The open-text responses identify hygiene and capacity concerns, but do not establish that hygiene rather than bin volume is the core issue causing these households' Q4 preferences. Both concerns occur together, and no respondent-level analysis demonstrating that explanation is supplied.A trial first and targeted extra support are the most viable pathways, commanding nearly half of panel preferences outright and bridging the gap between Q2 opponents and Q4 choices.
The aggregate Q2 and Q4 results do not demonstrate that trial and support options bridge the gap specifically among Q2 opponents. That requires a Q2-by-Q4 cross-tabulation. Combining preferences for two distinct options also does not establish support for a single combined package.
Scorecard
Numbers 11 of 11 right
| Question | Its answer | True | |
|---|---|---|---|
| What percentage of open-consultation respondents tend to oppose or strongly oppose collecting general waste every three weeks (Q2)? | ✓ | 77.5% | 77.5% |
| What percentage of residents' panel respondents tend to oppose or strongly oppose collecting general waste every three weeks (Q2)? | ✓ | 45.3% | 45.3% |
| What percentage of residents' panel respondents strongly support or tend to support collecting general waste every three weeks (Q2)? | ✓ | 40.8% | 40.8% |
| What is the 95% margin of error, in percentage points, on the share of residents' panel respondents who support the change (strongly or tend to)? | ✓ | 4.7 points | 4.69 points |
| On the residents' panel, is the difference in the share supporting the change (strongly or tend to) between owner-occupiers and renters statistically significant at the 95% level? (1 for yes, 0 for no) | ✓ | No | No |
| Among residents' panel respondents whose household includes a child under 3 or someone who uses continence or other hygiene products, what percentage chose 'every three weeks, with extra support for households that need it' as their preferred option (Q4)? | ✓ | 55.6% | 55.6% |
| How many of the open-text answers are copies or near-copies of the template comment circulated by a local group? | ✓ | 209 | 209 |
| How many of the open-text answers from residents' panel respondents mention hygiene: smell, flies, maggots or vermin, or nappies or hygiene waste sitting in the bin? | ✓ | 9 | 9 |
| As a percentage of all residents' panel respondents, how many oppose the change at Q2 and said they would support it if their household could have a larger bin at no extra charge (Q3)? | ✓ | 10.2% | 10.2% |
| What percentage of residents' panel respondents said they would be very or fairly likely to recycle more if general waste were collected every three weeks (Q5)? | ✓ | 40.5% | 40.5% |
| What percentage of the addresses invited by letter to the residents' panel produced a completed questionnaire? | ✓ | 21.1% | 21.1% |
Traps in the data 8 of 8 handled
- ✓The open consultation is self-selected: anyone with the link could respond, Brookfield is 38% of it against 12% of households, and households with a young child or hygiene needs are over-represented. It shows 78% opposed, against 45% on the panel, which matches the district's age and tenure profile.
- ✓209 open-consultation comments (16% of the consultation's responses) are copies or near-copies of a template circulated by Keep Brookfield Tidy.
- ✓The council leader wants to show that residents support the change. Support is 41% on the panel (with 45% opposed) and 15% in the open consultation.
- ✓Q3 was asked only of those who oppose: 22% of panel opponents would support the change with a larger bin, which is only 10% of all panel respondents; most opponents would still oppose.
- ✓Wendle Vale (panel base 16) shows 62% support, far above any other ward.
- ✓On the panel, owner-occupiers support the change more than renters (43% against 37%, bases 282 and 140), but the gap is not statistically significant at 95%.
- ✓40% of the panel say they would be likely to recycle more: a stated intention about a hypothetical change.
- ✓Only 422 of 2,000 addresses invited to the panel completed (about 21%); the panel is matched on age and tenure only, and those who replied may care more about bins than those who did not.
The analysis
Run a controlled pilot of three-weekly general waste collections in selected areas first, with the extra support package (separate/extra collections for nappies and hygiene/continence waste, plus larger bins for large households) built into the pilot from day one—neither forcing an unmitigated district-wide rollout nor dropping the proposal.
Evidence from the pilot showing persistent increases in fly-tipping, side-waste, or recycling contamination, or operational modelling showing that the cost of administering extra nappy/hygiene collections and larger bins outweighs the savings of three-weekly residual rounds, would justify dropping the proposal and retaining fortnightly collections.
Findings
-
Answering the council leader: residents do not give clear backing to a straight switch to three-weekly collections. Opinion on the representative residents' panel is split, with slightly more opposing than supporting.
On the residents' panel (n=422, matched to district age and tenure), 40.8% support the change vs 45.3% oppose (10.4% neither, 3.6% don't know; 95% margin of error on support is ±4.7 pp). An unmitigated district-wide move is the least popular option on Q4 (22.0%).
-
Answering the cabinet member for environment: the 'nearly four in five oppose' headline (77.5%) is an artefact of self-selection and an organised Brookfield campaign, not representative district opinion, so the proposal should not be dropped on that basis.
Open consultation (n=1,318) over-represents Brookfield (38.0% vs 12% of district households), owner-occupiers (81.5% vs 67%), and households with under-3s or hygiene needs (28.9% vs ~15% council estimate), and 209 of 315 consultation comments (66.3%) are verbatim/near-verbatim copies of Keep Brookfield Tidy's template. On the representative panel, only 24.6% prefer keeping fortnightly collections while 71.1% prefer one of the three-weekly options (with extra support, a trial, or district-wide).
-
Answering the head of waste services: offering larger bins alone would NOT bring most opponents round; over three in five would still oppose.
Among Q2 opponents offered a free larger bin at Q3, 61.3% of panel opponents (n=191) and 66.5% of consultation opponents (n=1,021) say they would still oppose. Only 22.5% of panel opponents (10.2% of all panel respondents) would switch to support.
-
Households with children under 3 or continence/hygiene waste needs strongly oppose an unmitigated switch (74.1%), but a clear majority back three-weekly collections if extra support is provided (55.6%).
On the panel, high-need households (n=54) oppose Q2 by 74.1% vs 14.8% support (compared with 41.0% oppose / 44.6% support among other households, n=368). On Q4, 55.6% of high-need households choose 'every three weeks, with extra support' (vs 25.9% keep fortnightly), because open-text responses show their core issue is 21-day odour, flies, maggots, and vermin—not just bin volume.
-
A trial first and targeted extra support are the most viable pathways, commanding nearly half of panel preferences outright and bridging the gap between Q2 opponents and Q4 choices.
On Q4 across the panel (n=422), 25.4% prefer a trial first and 23.7% prefer district-wide with extra support (49.1% combined), alongside 22.0% for unmitigated district-wide—leaving only 24.6% wanting to keep fortnightly collections. Even in the skewed consultation (n=1,318), 43.8% prefer either extra support (25.9%) or a trial (17.9%).
-
Four in ten residents say three-weekly collections would prompt them to recycle more, while organic objections cluster around large-household capacity, hygiene/pests, fly-tipping, and council tax value for money.
40.5% of the panel (n=422) say they are very (15.6%) or fairly (24.9%) likely to recycle more (11.8% already recycle everything they can). Among non-template comments (n=208 across both sources), 65 cite bin capacity/overflow (often 4–8 person households), 57 support recycling/landfill benefits, 39 cite paying the same/higher council tax for less service, 35 cite smell/pests/nappies/medical waste, and 15 cite fly-tipping or dumped side-bags.
-
Demographic differences on the panel are modest overall, though renters show directionally higher opposition than owner-occupiers.
On the panel, renters (n=140) oppose at 52.1% and support at 37.1%, versus owner-occupiers (n=282) at 41.8% oppose and 42.6% support—a 5.5 pp support gap that is not statistically significant at 95% (z=1.06, p=0.29). Ward bases are small (n=16–133), so apparent differences (e.g. Stanmoor 55.2% oppose vs Wendle Vale 12.5% oppose on n=16) should be treated cautiously.
Caveats
- The open consultation (n=1,318) is self-selected and distorted by an organised Keep Brookfield Tidy campaign (209 template comments; Brookfield is 38.0% of respondents vs 12% of households), and cannot be combined with the residents' panel or used to estimate district-wide support.
- The residents' panel (n=422) achieved a 21.1% response rate via an online-only questionnaire; digitally excluded residents and non-respondents may differ from participants, and subgroup bases (e.g. Wendle Vale n=16, households with under-3s/hygiene needs n=54) carry wide margins of error.
- Q3 asked opponents only about a free larger bin, not about separate or extra nappy and hygiene collections, so it understates potential acceptance if hygiene-specific support is included.
- Q4's trial option does not specify whether extra support would be included during the trial, and Q5 measures stated intent to recycle more (40.5% on the panel), which often exceeds actual behaviour change.
- Household size and property/bin storage type were not captured in the profile questions, even though 4–8 person households and homes lacking side access drove many capacity and odour objections.
- Council tax fairness was a major spontaneous objection (39 organic comments) that was not measured in closed questions and could create backlash if unaddressed in communications.
Next steps
- decisionApprove a 6-month pilot in 2–3 representative areas (covering terraced urban streets, family estates, and rural lanes) that includes free larger bins for large households and separate/more frequent nappy and hygiene waste collections.
- researchConduct brief qualitative interviews or a co-design check with high-need households (nappy/continence/medical waste users), large households (5+ residents), and renters in terraced properties before launching the pilot.
- communicationPublish a transparent financial and environmental briefing explaining the savings target, how savings are reinvested, and the recycling support available alongside the pilot.
Open-text themes it coded
Keep Brookfield Tidy campaign template (cites overflow, smell/flies/rats/nappies, and fly-tipping) 209Insufficient bin capacity and overflowing bins, especially in larger households (organic) 65Supportive: encourages recycling and reduces landfill waste (organic) 57Perceived poor value for money: paying same or higher council tax for fewer collections (organic) 39Hygiene, smell, flies/maggots, vermin, and nappy or medical waste sitting for three weeks (organic) 35Little or no impact on household (small households or already low residual waste) (organic) 18Fly-tipping and dumped rubbish bags in streets, alleys, or countryside (organic) 15
The survey it planned
2 screening questions and 10 questions, as the model wrote them.
-
S1
Which age group are you in?
One answer- Under 18
- 18–24
- 25–34
- 35–44
- 45–54
- 55–64
- 65 or over
Continues if 18–24; 25–34; 35–44; 45–54; 55–64; 65 or over
-
S2
Which Hollinbrook District Council ward do you live in? (You can check your ward on your council tax bill or postcode lookup.)
One answer- Ward 1
- Ward 2
- Ward 3
- Ward 4
- Ward 5
- Ward 6
- I live in Hollinbrook District, but I am not sure which ward
- I do not live in the Hollinbrook District Council area
Continues if Ward 1; Ward 2; Ward 3; Ward 4; Ward 5; Ward 6; I live in Hollinbrook District, but I am not sure which ward
-
Q1
Hollinbrook District Council needs to find £3.1 million of savings next year. Currently, general waste (black bin) is collected every two weeks, food waste every week, and recycling every two weeks. Moving black bin collections to every three weeks—while keeping food waste weekly and recycling every two weeks—would save about £600,000 a year. To what extent do you support or oppose changing black bin collections to every three weeks?
ScaleScale 1-5: Strongly oppose to Strongly support
Judges: leadingThe initial support measure is preceded by the council's savings requirement and the proposal's financial benefit, framing adoption positively before residents express their views.
The preamble presents only the case for the change: the £3.1m savings pressure and the £600,000 saving. It gives no balancing information on drawbacks before asking for support. This one-sided framing primes support for the change.
-
Q2
Thinking about your household's current waste, how full is your general waste (black) bin by collection day in a typical two-week period?
One answer- Less than half full
- Between half full and three-quarters full
- Full, with the lid closed
- Overflowing or with extra bags alongside the bin
- My household uses communal bins
- Not sure
-
Q3
If black bin collections moved to every three weeks, which of the following difficulties, if any, do you think your household would experience? Select all that apply.
Any that apply- Not enough space in the black bin for our general waste
- Unpleasant smells, flies, or pests
- Storing used nappies between collections
- Storing continence or medical hygiene waste between collections
- Difficulty moving a heavier bin to the kerbside
- None – our household could manage three-weekly collections without difficulty
- Other difficulty
- Not sure
-
Q4
The council is considering offering extra support to households that need it—such as a larger black bin, or extra collections for nappies or continence and hygiene waste. Would offering this extra support change your view on moving to three-weekly black bin collections?
One answer- Yes – I would support three-weekly collections if this support were available
- Yes – I would feel less concerned, though I would still have reservations
- No – I support three-weekly collections with or without this support
- No – I oppose three-weekly collections even with this support
- Not sure
-
Q5
Which of the following options would you most prefer Hollinbrook District Council to take?
One answer- Move to three-weekly black bin collections across the whole district
- Move to three-weekly black bin collections across the whole district, with extra support (such as larger bins or extra nappy and hygiene collections) for households that need it
- Trial three-weekly black bin collections in a few areas first before deciding for the whole district
- Keep black bin collections every two weeks and find the £600,000 savings from other council services or council tax
- Not sure
Judges: leadingOnly the option retaining two-weekly collections is explicitly coupled with an adverse trade-off involving other services or council tax, steering respondents away from dropping the proposal.
Only the 'keep two-weekly' option carries a stated cost: finding the £600,000 from other services or council tax. The other options are given with no downsides. This penalises the drop-the-proposal option and steers respondents towards the three-weekly options.
-
Q6
If black bin collections moved to every three weeks (with weekly food waste and two-weekly recycling staying the same), how do you think your household's recycling would change?
One answer- We would recycle a lot more
- We would recycle a little more
- Our recycling would stay the same because we already recycle everything we can
- Our recycling would stay the same for other reasons
- We would recycle less
- Not sure
-
Q7
To help us check that responses are read carefully, please select 'Every two weeks' from the list below.
One answer- Every week
- Every two weeks
- Every three weeks
- Every four weeks
-
Q8
In your own words, please share any specific impacts a three-weekly black bin collection would have on your household, or anything else councillors should consider before making a decision.
Open text -
Q9
To help us understand how the proposed change could affect different types of households, do any of the following apply to your household? Select all that apply.
Any that apply- At least one child in nappies
- Someone who uses continence or medical hygiene products
- Four or more people living in the household
- None of the above
- Prefer not to say
-
Q10
Which of the following best describes your home?
One answer- Owned outright or with a mortgage
- Rented from a private landlord
- Rented from the council or a housing association
- Other
- Prefer not to say
Sample plan
Two separate channels using the exact same questionnaire, distinguished by a hidden survey-link source flag and never pooled unweighted. (1) Residents' panel (primary representative measure): Postal invitation letters with a unique access code sent to a stratified random sample of residential addresses across all 6 wards (drawn from the council's address register, assuming ~20% response rate -> ~2,100 invitations for ~420 completes, with reminders to non-responders). Quotas and post-stratification raking weights applied using S1 (age) and Q10 (tenure) to match Hollinbrook District's Census/adult profile, plus ward population weights. CRITICAL PRECISION NOTE: At n=420 total (~70 completes per ward), district-wide precision is ±4.8 percentage points at 95% confidence (worst-case p=0.5), but single-ward precision is ~±11.7 percentage points—well outside the ±6 percentage point target requested by ward councillors. Achieving ±6 percentage points at 95% confidence in each of the 6 wards requires ~260 completes per ward (with finite population correction for ~9,667 households/ward), i.e., ~1,560 total panel completes (~7,800 postal invitations). Councillors must either fund the larger ~1,560 sample or use pooled sub-district groupings (e.g., town vs. rural wards) alongside indicative ward figures. (2) Open consultation: Self-selected convenience sample via council website, social media, and residents' magazine; open to all adults in the district, monitored for duplicate IP/cookies and attention-check (Q7) pass rates, and reported separately from the representative panel so self-selection bias does not distort baseline support estimates.