Benchmarks / SurveyBench / What Hollinbrook residents think of three-weekly bin collections / Muse Wonder
Muse Wonder: What Hollinbrook residents think of three-weekly bin collections
The decision: whether to move general waste collection to every three weeks across the whole district, to do so with extra support for households that need it (a larger bin, or extra collections of nappies and hygiene waste), to pilot it in some areas first, or to drop the proposal. The brief and the data →
- Verdict
- ✗ Not sound
- Research score
- 91 of 100
- Analysis rating
- 1,460
- Head to head, this task
- won 10 of 15
Why it is not sound
The survey
- Presumed the stakeholder's view instead of testing it
- A leading question: Q1
Scorecard
Numbers 11 of 11 right
| Question | Its answer | True | |
|---|---|---|---|
| What percentage of open-consultation respondents tend to oppose or strongly oppose collecting general waste every three weeks (Q2)? | ✓ | 77.5% | 77.5% |
| What percentage of residents' panel respondents tend to oppose or strongly oppose collecting general waste every three weeks (Q2)? | ✓ | 45.3% | 45.3% |
| What percentage of residents' panel respondents strongly support or tend to support collecting general waste every three weeks (Q2)? | ✓ | 40.8% | 40.8% |
| What is the 95% margin of error, in percentage points, on the share of residents' panel respondents who support the change (strongly or tend to)? | ✓ | 4.7 points | 4.69 points |
| On the residents' panel, is the difference in the share supporting the change (strongly or tend to) between owner-occupiers and renters statistically significant at the 95% level? (1 for yes, 0 for no) | ✓ | No | No |
| Among residents' panel respondents whose household includes a child under 3 or someone who uses continence or other hygiene products, what percentage chose 'every three weeks, with extra support for households that need it' as their preferred option (Q4)? | ✓ | 55.6% | 55.6% |
| How many of the open-text answers are copies or near-copies of the template comment circulated by a local group? | ✓ | 209 | 209 |
| How many of the open-text answers from residents' panel respondents mention hygiene: smell, flies, maggots or vermin, or nappies or hygiene waste sitting in the bin? | ✓ | 9 | 9 |
| As a percentage of all residents' panel respondents, how many oppose the change at Q2 and said they would support it if their household could have a larger bin at no extra charge (Q3)? | ✓ | 10.2% | 10.2% |
| What percentage of residents' panel respondents said they would be very or fairly likely to recycle more if general waste were collected every three weeks (Q5)? | ✓ | 40.5% | 40.5% |
| What percentage of the addresses invited by letter to the residents' panel produced a completed questionnaire? | ✓ | 21.1% | 21.1% |
Traps in the data 8 of 8 handled
- ✓The open consultation is self-selected: anyone with the link could respond, Brookfield is 38% of it against 12% of households, and households with a young child or hygiene needs are over-represented. It shows 78% opposed, against 45% on the panel, which matches the district's age and tenure profile.
- ✓209 open-consultation comments (16% of the consultation's responses) are copies or near-copies of a template circulated by Keep Brookfield Tidy.
- ✓The council leader wants to show that residents support the change. Support is 41% on the panel (with 45% opposed) and 15% in the open consultation.
- ✓Q3 was asked only of those who oppose: 22% of panel opponents would support the change with a larger bin, which is only 10% of all panel respondents; most opponents would still oppose.
- ✓Wendle Vale (panel base 16) shows 62% support, far above any other ward.
- ✓On the panel, owner-occupiers support the change more than renters (43% against 37%, bases 282 and 140), but the gap is not statistically significant at 95%.
- ✓40% of the panel say they would be likely to recycle more: a stated intention about a hypothetical change.
- ✓Only 422 of 2,000 addresses invited to the panel completed (about 21%); the panel is matched on age and tenure only, and those who replied may care more about bins than those who did not.
The analysis
Do not approve district-wide three-weekly rollout now, do not claim residents' backing, and do not drop the idea outright on the open consultation alone. Approve a time-limited pilot in some areas first, designed as three-weekly WITH extra support - larger bins on assessed need plus a separate frequent nappy/hygiene collection - with opt-in support proactively offered to households with children under 3, hygiene-product users and larger households. Tell full council the panel is closely divided (40.8% support, 45.3% oppose, +/-4.7pp), that a larger bin alone converts only 22.5% of opponents, and that the 77.5% open-consultation opposition is campaign-affected and unrepresentative. Pre-commit pilot success and stop/rollout criteria before it starts.
Evidence that would change this to district-wide rollout: a representative pilot evaluation showing no sustained rise in side waste, fly-tipping, missed-bin or hygiene complaints, measured recycling/general-waste tonnage improving, extra-support take-up meeting need in the child/hygiene group, costs/carbon saving as modelled, and post-pilot representative support not significantly below opposition. Evidence that would change this to dropping it: pilot harm on those measures, support for extra support failing to offset opposition among affected households in a properly powered representative follow-up, or operational/equalities assessment showing hygiene waste cannot be collected safely and affordably.
Findings
-
The council leader cannot claim residents back three-weekly collections. In the representative panel, support is a minority and is outweighed by opposition, although the gap is within sampling uncertainty.
Panel Q2: 40.8% support, 45.3% oppose, 10.4% neither, 3.6% don't know, base 422. 95% margin on support is +/-4.7pp, so support is plausibly 36.1-45.5% and there is no majority backing.
-
The cabinet member's 'nearly four in five oppose' is real for the open consultation but cannot be read as the district view. It is a self-selected, campaign-affected count, not a population estimate.
Open consultation Q2: 77.5% oppose, 14.7% support, base 1,318, versus panel 45.3% oppose, 40.8% support, base 422. Open respondents are skewed: Brookfield 38.0% of open vs 12% of households; child-under-3/hygiene households 29% approx. in open (381/1,318 at Q2 split) vs council estimate about 15% and panel 54/422; owners 81.5% in open vs 67% population. On 1 June Keep Brookfield Tidy circulated suggested wording.
-
Do not drop the proposal solely on the open consultation, and do not roll it out district-wide on this evidence. Panel opinion is closely divided, with intensity against: more strongly oppose than strongly support.
Panel Q2: strongly oppose 28.2% vs strongly support 17.3%; tend to oppose 17.1% vs tend to support 23.5%. Net oppose 45.3% vs net support 40.8%, difference 4.5pp on base 422.
-
A larger bin alone would not bring most opponents round, answering the head of waste services: no.
Panel Q3, asked only of Q2 opponents: 22.5% would support with a larger free bin, 61.3% would still oppose, 9.4% neither, 6.8% don't know, base 191. That converts only 10.2% of all panel respondents (191 x 22.5% / 422). Open consultation is similar: 17.4% would support, 66.5% still oppose, base 1,021.
-
Targeted extra support matters most to the households most opposed and most at risk of harm: those with a child under 3 or hygiene-product use. For them extra support is the single most preferred model, not a larger-bin-only offer tested at Q3.
Panel Q2 for child/hygiene group: 74.1% oppose, 14.8% support, base 54, vs 41.0% oppose and 44.6% support for others, base 368. Panel Q4 for that group: 55.6% prefer three-weekly with extra support, 25.9% keep two-weekly, 13.0% trial first, 5.6% district-wide without support, base 54. Small base, so treat direction as strong but precise share as uncertain.
-
When forced to choose a model, panel respondents prefer some form of three-weekly change over simply keeping two-weekly, but outright district-wide rollout is the least supported three-weekly variant alongside supported rollout - support is conditional on trial or support.
Panel Q4: keep every two weeks 24.6%; every three weeks whole district 22.0%; three-weekly with extra support 23.7%; trial in some areas first 25.4%; don't know 4.3%, base 422. Combined three-weekly variants 71.1%, but no single variant has a majority. Open Q4 differs sharply: keep 42.7%, base 1,318.
-
There is no clear tenure mandate either way. Renters oppose more in raw terms, but the support gap between owners and renters is not statistically significant at 95%.
Panel Q2 support: owner-occupiers 42.6%, base 282; renters 37.1%, base 140; gap 5.5pp, 95% interval for the difference about +/-9.9pp, includes zero. Opposition: owners 41.8%, renters 52.1%. Do not target or exempt by tenure on this alone.
-
Age and most ward differences in the panel should not be over-read. Subgroup bases are small, especially Wendle Vale, and apparent extremes are unreliable.
Panel Q2 ward bases: Wendle Vale 16, Brookfield 47, Stanmoor 67, Kettlewell 76, Ashby Marsh 83, Hollinbrook Town 133. Wendle Vale 62.5% support rests on 10 people. Age 75+ support 51.0% rests on base 51. Stanmoor oppose 55.2%, base 67; Ashby Marsh oppose 33.7%, base 83. These are indicative only.
-
A recycling uplift is plausible but not guaranteed and is stated intention, not behaviour. A substantial minority say they already recycle everything or are unlikely to do more.
Panel Q5: very/fairly likely to recycle more 40.5%, neither 16.1%, fairly/very unlikely 29.1%, already recycle everything 11.8%, don't know 2.4%, base 422. Open: likely 24.2%, base 1,318. This supports testing actual recycling tonnage in a pilot rather than assuming it.
-
Open-text volume against the proposal is heavily inflated by a template campaign and must not be counted as 209 independent experiences. The underlying concerns in genuine comments - capacity for larger households, hygiene for nappy/hygiene waste, fly-tipping, and council-tax value - recur independently in both sources.
417 open-text answers supplied: 209 are copies or near-copies of the Keep Brookfield Tidy template in three wording variants. Panel open-text, unaffected by that template count, still contains overflow, hygiene, fly-tipping and value comments, e.g. hygiene mentioned by 9 panel respondents.
Caveats
- Never add the two sources together: bases, sampling and biases differ, and the tables state they are unweighted and shown separately.
- The open consultation is self-selected, promoted via council channels plus a campaign from 1 June, over-represents Brookfield (38.0% vs 12% of households), owner-occupiers (81.5% vs 67% population) and households with a child under 3 or hygiene products, and under-represents 18-34s (15.3% vs 24% population). Its percentages describe respondents, not residents.
- The residents' panel is the better population guide - invited from 2,000 randomly selected addresses, filled to match age and tenure - but response was only 21.1% (422/2,000), it is online-only, unweighted in the tables, and non-response bias cannot be ruled out. One adult per household was invited, so results are adults, while ward and need figures are household-based.
- Panel subgroup bases are small: child/hygiene base 54, Wendle Vale 16, Brookfield 47, age 75+ 51. Differences there, and the owner-renter support gap, are not all statistically significant; the panel support estimate itself is +/-4.7pp at 95%.
- Q3 was asked only of Q2 opponents (panel base 191, open 1,021) and tested a larger bin alone, not the broader extra-support package in Q4 (larger bin or extra nappy/hygiene collections). Do not apply Q3 percentages to all respondents without the 10.2% conversion calculation, and do not assume larger-bin rejection equals rejection of hygiene collections.
- Q4 is a single most-preferred forced choice: combining its three three-weekly variants shows openness to change in some form, not support for any specific rollout. Q5 is hypothetical stated intention, not observed recycling behaviour.
- Open-text answers were supplied for 417 respondents only, not all 1,740 completers; 209 are template copies, so theme frequency in text is not prevalence in the district. Median completion times of 3m40s and 4m10s allow considered answers but do not remove self-selection.
- Percentages are column percentages of each stated base, multi-response Q6 can sum over 100%, and rounding means nets may not sum exactly. No cost, carbon, capacity, equalities or operational evidence was in this survey.
Next steps
- decisionReport to full council using panel figures only for population claims, with open consultation reported separately as consultation volume, and explicitly withdraw any 'residents back us' wording
- experimentDesign and approve a pilot in contrasting wards/areas, three-weekly with extra support including separate nappy/hygiene collections and assessed larger bins, with a matched non-pilot comparison
- researchRun targeted research and equalities work with households with children under 3, continence/hygiene users, larger and multi-generational households, and renters in flats/shared housing, powered to a usable base
- monitorIn the pilot, measure actual behaviour and harm rather than intention: general waste and recycling tonnage and contamination, food-waste use, side waste, fly-tipping reports and clearance cost, vermin/hygiene complaints, support take-up and residual unmet need
- researchBefore any district decision, field a short representative post-pilot survey of pilot and non-pilot residents using the same Q2/Q4 wording, and model full costs, council-tax/value messaging and carbon impact
Open-text themes it coded
Bin already full / would overflow - household capacity, especially larger households 269Hygiene - smell, flies, maggots, vermin, foxes, nappies or hygiene waste sitting in bin 244Fly-tipping, side waste and dumping in lanes, lay-bys and streets 224Poor value - same or higher council tax for fewer collections / service cut 40Positive environmental effect - would recycle more, waste less, support change 56Little or no effect - small household, bin rarely full, food waste weekly helps 16Campaign template copy or near-copy 209
The survey it planned
3 screening questions and 10 questions, as the model wrote them.
-
S1
How old are you?
One answer- Under 18
- 18 to 34
- 35 to 49
- 50 to 64
- 65 to 74
- 75 or over
Continues if 18 to 34; 35 to 49; 50 to 64; 65 to 74; 75 or over
-
S2
Do you live in the Hollinbrook District Council area as your main home?
One answer- Yes
- No
- Don't know
Continues if Yes
-
S3
Please enter your home postcode. This will only be used to check that you live in the Hollinbrook District Council area and to analyse results by ward. It will not be used to identify you.
Open textContinues if A postcode in the Hollinbrook District Council area
-
Q1
Hollinbrook District Council currently collects general waste (the black bin) every two weeks, food waste every week and recycling every two weeks. The council must save £3.1 million next year. It is considering collecting general waste every three weeks instead. Food waste would stay weekly and recycling would stay every two weeks. The council estimates this would save about £600,000 a year, and councils that have made this change have reported higher recycling. Some residents may be concerned about their general waste bin filling up. To what extent do you support or oppose collecting general waste every three weeks, with no extra support?
ScaleScale 1-5: Strongly oppose to Strongly support
Judges: leadingThe introduction frames the change as addressing necessary savings and increasing recycling, while presenting drawbacks only as something some residents may worry about. This imbalance steers respondents towards support.
The preamble presents three points in favour as fact: the £3.1m savings need, the £600,000 saving and the higher recycling reported elsewhere. Against these there is only one hedged concern ('some residents may be concerned'). This tilts the main support measure towards support.
-
Q2
If general waste was collected every three weeks, how easy or difficult would it be for your household to fit all your general waste in your black bin between collections?
ScaleScale 1-5: Very difficult to Very easy
-
Q3
What concerns, if any, would your household have about general waste being collected every three weeks? Please select all that apply.
Any that apply- My general waste bin would be full before collection day
- Smell, flies or other pests
- Having nowhere to store extra waste
- Nappies or hygiene products building up
- Pet waste building up
- Extra waste at busy times, such as Christmas or when visitors stay
- It would be harder to sort waste correctly
- I would have no concerns
- Other concerns
- Don't know
-
Q4
Which of the following, if any, apply to your household? Please select all that apply. This will help us understand how the proposal would affect different households.
Any that apply- A child under 5 lives here
- Someone here uses nappies
- Someone here uses continence or other hygiene products that go in the general waste bin
- Five or more people live here
- We have limited space to store bins or extra waste
- Someone here has a health condition or disability that creates extra general waste
- None of these
- Prefer not to say
-
Q5
Please rank the following options from 1 (most preferred) to 4 (least preferred).
Ranking- Keep collecting general waste every two weeks and do not make this change
- Collect general waste every three weeks across the whole district, with no extra support
- Collect general waste every three weeks across the whole district, with extra support for households that need it, such as a larger bin or extra collections of nappies and hygiene waste
- Try collecting general waste every three weeks in some areas first, review the results, and then decide whether to introduce it across the whole district
-
Q6
If general waste was collected every three weeks, but households that need it could get a larger general waste bin at no extra charge and households with nappies or continence or hygiene waste could get extra collections of that waste, to what extent would you support or oppose the change?
ScaleScale 1-5: Strongly oppose to Strongly support
-
Q7
Which of the following, if any, would help your household if general waste was collected every three weeks? Please select all that apply.
Any that apply- A larger general waste bin
- An extra collection of nappies and hygiene waste
- An extra general waste collection after Christmas and bank holidays
- Clearer information about what can be recycled
- Help to use the weekly food waste collection
- An assisted collection from my property
- None of these would help my household
- I already support the change without extra support
- Don't know
-
Q8
If general waste was collected every three weeks, what, if anything, do you think you would do differently? Please select all that apply.
Any that apply- Recycle more using the recycling collection
- Use the weekly food waste collection more
- Recycle more at recycling centres or bring banks
- Squash or compact general waste more
- Put recyclable items in the general waste bin if the recycling bin was full
- Make more trips to dispose of waste elsewhere
- I would not do anything differently because I already recycle everything I can
- I would not do anything differently for another reason
- Don't know
-
Q9
What is the main reason for your views on this proposal, and is there anything else the council should consider before deciding? Please do not include your name, address or anything that could identify you or anyone else.
Open text -
Q10
Which of the following best describes your home?
One answer- I own it outright or with a mortgage
- I rent it from a private landlord
- I rent it from the council or a housing association
- Other
- Prefer not to say
Sample plan
Run the identical questionnaire separately as (1) a self-selecting open consultation and (2) an invited residents' panel, and never combine them into one headline figure. OPEN CONSULTATION: link on the council website, promoted on social media and in the residents' magazine, open to any eligible adult; no target or quota, report its n, profile and results separately as self-selected and not representative. RESIDENTS' PANEL: unique one-use links sent by letter to randomly selected residential addresses across all six wards, asking one adult aged 18+ living at the address (the resident with the next birthday) to complete it; send reminders and targeted top-ups. Precision requirement changes the size: for +/-6 percentage points at 95% confidence in one ward at maximum variance requires 267 completes per ward (1.96^2 x 0.25 / 0.06^2 = 267, before any finite-population correction), i.e. at least 1,602 panel completes (267 x 6), allocated equally by ward for ward-level reporting and then weighted back to each ward's share of district households for district totals. This is incompatible with about 420 panel completes: 420 split evenly gives about 70 per ward, i.e. about +/-11.7 points per ward and about +/-4.8 points district-wide, so if funding caps the panel at about 420, ward results must be published as indicative only at roughly +/-12 points and the +/-6 point requirement must be formally relaxed. Assuming roughly a 20% response, initially invite at least about 8,100 panel addresses (about 1,350 per ward) and top up under-represented groups. Set monitoring quotas within each ward matched to the district profile for age (S1) and tenure (Q10), with interlocking age-by-tenure targets where base sizes allow; weight the panel by ward, age and tenure, and report weighted district results with unweighted bases and 95% confidence intervals.