Benchmarks / SurveyBench / What Hollinbrook residents think of three-weekly bin collections / Claude Fable 5.2
Claude Fable 5.2: What Hollinbrook residents think of three-weekly bin collections
The decision: whether to move general waste collection to every three weeks across the whole district, to do so with extra support for households that need it (a larger bin, or extra collections of nappies and hygiene waste), to pilot it in some areas first, or to drop the proposal. The brief and the data →
- Verdict
- ✓ Sound research
- Research score
- 96 of 100
- Analysis rating
- 1,683
- Head to head, this task
- won 9 of 10
Scorecard
Numbers 11 of 11 right
| Question | Its answer | True | |
|---|---|---|---|
| What percentage of open-consultation respondents tend to oppose or strongly oppose collecting general waste every three weeks (Q2)? | ✓ | 77.5% | 77.5% |
| What percentage of residents' panel respondents tend to oppose or strongly oppose collecting general waste every three weeks (Q2)? | ✓ | 45.3% | 45.3% |
| What percentage of residents' panel respondents strongly support or tend to support collecting general waste every three weeks (Q2)? | ✓ | 40.8% | 40.8% |
| What is the 95% margin of error, in percentage points, on the share of residents' panel respondents who support the change (strongly or tend to)? | ✓ | 4.7 points | 4.69 points |
| On the residents' panel, is the difference in the share supporting the change (strongly or tend to) between owner-occupiers and renters statistically significant at the 95% level? (1 for yes, 0 for no) | ✓ | No | No |
| Among residents' panel respondents whose household includes a child under 3 or someone who uses continence or other hygiene products, what percentage chose 'every three weeks, with extra support for households that need it' as their preferred option (Q4)? | ✓ | 55.6% | 55.6% |
| How many of the open-text answers are copies or near-copies of the template comment circulated by a local group? | ✓ | 209 | 209 |
| How many of the open-text answers from residents' panel respondents mention hygiene: smell, flies, maggots or vermin, or nappies or hygiene waste sitting in the bin? | ✓ | 9 | 9 |
| As a percentage of all residents' panel respondents, how many oppose the change at Q2 and said they would support it if their household could have a larger bin at no extra charge (Q3)? | ✓ | 10.2% | 10.2% |
| What percentage of residents' panel respondents said they would be very or fairly likely to recycle more if general waste were collected every three weeks (Q5)? | ✓ | 40.5% | 40.5% |
| What percentage of the addresses invited by letter to the residents' panel produced a completed questionnaire? | ✓ | 21.1% | 21.1% |
Traps in the data 8 of 8 handled
- ✓The open consultation is self-selected: anyone with the link could respond, Brookfield is 38% of it against 12% of households, and households with a young child or hygiene needs are over-represented. It shows 78% opposed, against 45% on the panel, which matches the district's age and tenure profile.
- ✓209 open-consultation comments (16% of the consultation's responses) are copies or near-copies of a template circulated by Keep Brookfield Tidy.
- ✓The council leader wants to show that residents support the change. Support is 41% on the panel (with 45% opposed) and 15% in the open consultation.
- ✓Q3 was asked only of those who oppose: 22% of panel opponents would support the change with a larger bin, which is only 10% of all panel respondents; most opponents would still oppose.
- ✓Wendle Vale (panel base 16) shows 62% support, far above any other ward.
- ✓On the panel, owner-occupiers support the change more than renters (43% against 37%, bases 282 and 140), but the gap is not statistically significant at 95%.
- ✓40% of the panel say they would be likely to recycle more: a stated intention about a hypothetical change.
- ✓Only 422 of 2,000 addresses invited to the panel completed (about 21%); the panel is matched on age and tenure only, and those who replied may care more about bins than those who did not.
The analysis
Neither roll out district-wide now nor drop the proposal. Approve a time-limited pilot of three-weekly collections with the support package built in, and take the roll-out decision on the pilot's results.
Why: on the representative panel residents are split (40.8% support, 45.3% oppose). An unconditional district-wide switch is the first choice of only 22%, and keeping fortnightly of only 24.6%. The most opposed group, households with nappies or hygiene waste, mostly prefers a supported version to no change. Because the four options are statistically tied, the survey does not pick a winner. The case for a pilot is that the open questions (overflow, smell, fly-tipping, real recycling gains, cost of support) can only be answered by observing behaviour.
What the pilot should include:
- Areas: two or three, covering town and rural, with comparison areas.
- Timing: run through a summer.
- Support: a larger bin on request for large households and a separate, more frequent nappy and hygiene-waste collection. A larger bin alone will not be enough, as it converts only about one in five opponents and does not touch hygiene.
- Success and stop criteria: published in advance.
What to say publicly: the leader should not claim resident backing. The cabinet member should not treat the 77.5% as the district's verdict. Report both sources separately, with the panel as the measure of district opinion and the consultation as the record of concerns. Give a public answer to 'paying the same for less' by stating the saving and where it goes.
Towards dropping the proposal:
- The pilot shows sustained increases in side waste, fly-tipping or pest and odour complaints against comparison areas.
- The pilot shows no meaningful fall in residual waste or rise in recycling.
- Take-up of the support package costs enough to erase the saving.
- A follow-up representative survey describing the full package still finds a clear majority opposed.
- A non-response check shows people who did not answer the panel are markedly more hostile than those who did.
Towards a faster, district-wide supported roll-out:
- A representative re-test shows clear majority support (lower confidence bound above 50%) once the package and savings are explained.
- Early pilot data show few problems and strong recycling gains.
If members require demonstrable majority backing before any change at all, the current evidence does not provide it and the decision should be deferred until the pilot reports.
Findings
-
Council leader: no, you cannot tell full council that residents back three-weekly collections. On the residents' panel, the only source that reflects the district, opinion is split with no majority either way, and feeling is stronger among opponents.
Panel (n=422): 40.8% support (±4.7 points, so roughly 36-46%) and 45.3% oppose (roughly 41-50%). The 4.5-point gap between them is within sampling error. Strongly oppose is 28.2% against strongly support 17.3%, and that gap is statistically significant. The supportable line is 'residents are divided, and most are open to a supported or trialled version'.
-
Cabinet member: the 'nearly four in five oppose' figure is real, but it measures who was mobilised to respond, not what the district thinks. It is not grounds on its own to drop the proposal.
Open consultation (n=1,318, self-selected): 77.5% oppose. Brookfield supplies 38.0% of responses against 12% of households. 28.9% of respondents (381) have a child under 3 or a hygiene-product user against about 15% of households. 18-34s are 15.3% against 24%, and owners 81.5% against 67%. Re-weighting wards to their true shares only moves opposition to about 75%, so the bias is self-selection across the district, not just Brookfield. On the panel, Brookfield (n=47) is 46.8% opposed, in line with the district's 45.3%.
-
Keeping fortnightly collections is a minority first choice, but so is an unconditional district-wide switch. There is no mandate to drop the proposal and none to impose it as it stands.
Panel Q4 (n=422): whole district 22.0%, with extra support 23.7%, trial first 25.4%, keep two-weekly 24.6% (each about ±4 points, so a statistical four-way tie). 71.1% chose some form of three-weekly, including trial. 45.3% oppose at Q2 but only 24.6% pick 'keep two-weekly', so roughly half of opposition is conditional. Even in the open consultation only 42.7% chose keep two-weekly and 52.4% chose a three-weekly variant. Medium confidence because Q4 offers three change options against one status quo, and 'trial then decide' is not an endorsement.
-
Households with a child under 3 or a hygiene-product user are by far the most opposed group, yet they are no more likely than anyone else to want the proposal dropped. Most choose three-weekly with extra support, so the support package is the condition for their acceptance.
Panel, affected households (n=54): 74.1% oppose and 14.8% support, against 41.0% and 44.6% among other households (n=368); the difference is significant. At Q4, 55.6% of affected households (30 of 54, ±13 points) choose 'with extra support' and 25.9% keep two-weekly, against 24.5% keep two-weekly among others. The direction is clear but precision is poor on 54 people. The panel slightly under-represents this group (12.8% against about 15%); correcting for that moves the panel totals by less than a point.
-
Head of waste: no, a larger bin alone would not bring most opponents round. It converts about one in five, which would lift support to roughly half, not to a clear majority.
Panel opponents (n=191): 22.5% would support with a free larger bin (43 people, ±6 points), 61.3% would still oppose, 9.4% neither, 6.8% don't know. Those 43 are 10.2% of the whole panel; added to the 172 existing supporters that gives about 51% hypothetical support, while 27.7% of the panel (117) still oppose. Open consultation opponents (n=1,021): 17.4% would support, 66.5% would still oppose. Q3 tested only the bin, not nappy or hygiene collections, and it is a stated hypothetical.
-
Opposition rests on four distinct objections, and a larger bin answers only one of them (capacity). Hygiene needs a separate nappy and hygiene collection, 'paying the same for less' needs a financial answer, and fly-tipping needs enforcement and evidence.
Of 208 comments written in respondents' own words (106 consultation, 102 panel): bin already full or large household 65; smell, flies, vermin or nappies 35; council tax or value for money 39; fly-tipping or side waste 15. On the positive side, 57 would recycle more or back it for the environment and 16 expect no impact. Among panel comments (n=102), 42 are supportive, 24 capacity, 15 value for money, 10 no impact, 9 hygiene and 7 fly-tipping. Counts show the range of concerns and their rough order, not prevalence.
-
About two-thirds of the consultation comments supplied are one campaign text. Treat it as one argument made many times by genuinely concerned residents, not as 209 independent accounts of household impact.
209 of the 315 open-consultation comments are copies or near-copies of the Keep Brookfield Tidy wording (four variants). Roughly three-quarters come from Brookfield and the rest from every other ward. None of the 102 panel comments uses it. The template makes overflow, hygiene and fly-tipping points that also appear independently in own-words comments, so the concerns are real even though the volume is inflated.
-
The environmental case is unproven by this survey. Four in ten say they would recycle more, but stated intentions overstate behaviour, so real tonnage data from a trial is needed.
Panel Q5 (n=422): 40.5% very or fairly likely to recycle more (±4.7 points), 29.1% unlikely, 11.8% already recycle everything they can, 16.1% neither. Open consultation: 24.2% likely. No behavioural or tonnage data was collected.
-
Do not target or exempt groups by tenure, age or ward on this evidence. Subgroup differences on the panel are mostly within sampling error; the only reliable split is households with young children or hygiene-product users.
Owners 42.6% support (n=282) against renters 37.1% (n=140): z≈1.1, not significant. Renters are more often strongly opposed (37.1% against 23.8%), which is suggestive but one of many post-hoc comparisons. Ward bases are 16-133: Wendle Vale's 62.5% support is 10 of 16 people, and the widest ward gap (Stanmoor 55.2% oppose against Ashby Marsh 33.7%) does not survive correction for multiple comparisons. Those aged 75 or older show 51.0% support on n=51 (±14 points).
Caveats
- The open consultation is a self-selected sample with an organised campaign from 1 June. It over-represents Brookfield (38% against 12%), households with young children or hygiene-product users (29% against about 15%) and owner-occupiers (81.5% against 67%), and under-represents 18-34s. Its percentages cannot be projected to the district, and re-weighting cannot fix self-selection. There is no evidence of residency verification or duplicate checks on the open link.
- The consultation is still a legitimate record of who feels strongly and why. It must be reported to members honestly alongside the panel, not discarded and not merged with it.
- The panel is the best available read but is not perfect. Only 21.1% of invited addresses completed (422 of 2,000), places were filled to age and tenure quotas, it was online only, and data are unweighted. People with strong views or good internet access may be over-represented. Quoted margins (about ±4.7 points on the total) assume a simple random sample and are, if anything, optimistic.
- The panel slightly under-represents households with a child under 3 or a hygiene-product user (12.8% against about 15%). Correcting for this changes headline support and opposition by under one point, but all findings about that group rest on 54 people (±13 points).
- Other subgroup bases are small: wards 16-133, aged 75 or older 51, renters 140. Wendle Vale (n=16) should not be quoted. With many subgroup comparisons, some apparent differences will be chance.
- Q3 was asked only of opponents and tested only a larger bin. It says nothing about nappy or hygiene collections, nor how the offer of support would affect current supporters or neutrals. No Q3 breakdown by household type was supplied.
- Q4 offers three versions of change against one status-quo option, which can split or inflate apparent openness to change. 'Trial first, then decide' is a preference to defer, not agreement to three-weekly collections. The four options are statistically tied on the panel.
- Q5 and Q3 are stated intentions about a hypothetical. People typically over-claim future recycling and under-predict how they adapt. Nothing here measures actual bin fullness, recycling tonnage or fly-tipping.
- The 417 comments are a subset of the 1,740 completes (315 of 1,318 consultation, 102 of 422 panel), and how they were selected is not stated. Theme counts indicate the range of concerns and their rough order, not district prevalence. Template comments were coded as a separate theme and not added to the own-words themes.
- The survey collected nothing on household size, property type (flats, shared bins, storage space) or current bin fullness, which the comments suggest are the real drivers of impact. Respondents were not told the expected savings or environmental benefit, so the value-for-money objection was not tested against any offer.
Next steps
- decisionReport both sources separately to full council, with the panel (40.8% support, 45.3% oppose, ±4.7 points) as the measure of district opinion and the consultation as the record of concerns and mobilisation. Do not claim resident backing and do not present 77.5% as the district view.
- decisionApprove a pilot of three-weekly collections with the support package, and formally defer the district-wide decision until it reports. Publish go and stop criteria before it starts.
- experimentRun the pilot in two or three areas (urban Hollinbrook Town, a rural ward, and an area with larger households or limited bin storage) with matched comparison areas, for at least six months including summer. Offer larger bins on request and a separate nappy and hygiene-waste collection.
- monitorStart baseline monitoring now in all wards: fly-tipping incidents, side-waste counts, missed-bin and pest complaints, residual and recycling tonnage by round, for 12 months before and throughout the pilot.
- researchRun a follow-up representative survey (random-probability sample with postal and phone options, weighted, with a boost to at least 200 households with under-3s or hygiene-product users). Ask everyone about the full package, test nappy and hygiene collection separately from the larger bin, state the savings, and capture household size, property type and current bin fullness.
- researchRe-analyse existing data: split consultation Q2 and Q4 by response date (before and after 1 June), check duplicates and residency, cross-tabulate Q2 by Q4 and Q3 by household type on the panel, and code all open comments, not just the 417.
- researchHold 15-20 interviews or home visits with large households, parents of under-3s, carers managing continence or stoma waste, and residents of flats or terraces without storage. Use them to design eligibility, sign-up and collection frequency for the support package. Invite Keep Brookfield Tidy to input.
- decisionPrepare and test a plain statement of what the change saves, where the money goes and what the environmental gain is. Publish it with the pilot announcement.
Open-text themes it coded
Campaign template comment (Keep Brookfield Tidy wording: overflow, smell, flies and rats, fly-tipping, keep fortnightly) 209Bin already full at two weeks: would overflow (often large households) 65Hygiene: smell, flies, maggots, vermin; nappies and continence waste sitting for three weeks 35Value for money: same or higher council tax for a reduced service 39Fly-tipping and bags dumped or left beside bins in the neighbourhood 15Supportive: would recycle more and waste less, good for the environment 57Little or no impact: small household, black bin rarely full 16
The survey it planned
3 screening questions and 10 questions, as the model wrote them.
-
S1
How old are you?
One answer- Under 18
- 18 to 24
- 25 to 34
- 35 to 44
- 45 to 54
- 55 to 64
- 65 to 74
- 75 or over
Continues if 18 to 24; 25 to 34; 35 to 44; 45 to 54; 55 to 64; 65 to 74; 75 or over
-
S2
Do you live in the Hollinbrook District Council area? (This is the council that collects your household bins.)
One answer- Yes
- No
- Not sure
Continues if Yes; Not sure
-
S3
What is the full postcode of your home address? (For example: AB1 2CD.) We use this only to confirm that you live in the Hollinbrook District Council area and to compare views between different parts of the district. It will be converted to a ward and will not be used to identify you or your household.
Open textContinues if Any valid full postcode inside the Hollinbrook District Council area (checked automatically against the council's postcode-to-ward list; postcodes outside the district are screened out)
-
Q1
Thinking about the last few general waste (black bin) collections, how full was your household's black bin usually by collection day?
One answer- Less than half full
- About half full
- About three-quarters full
- Completely full
- Completely full, with extra waste that would not fit in the bin
- We do not have our own black bin (for example, we share bins or use sacks)
- Don't know
-
Q2
How much of your household's food waste do you put out for the weekly food waste collection?
One answer- All or almost all of it
- Most of it
- Some of it
- None – it goes in the black bin
- None – we compost it at home or deal with it another way
- We do not have a food waste container
- Don't know
-
Q3
Hollinbrook District Council is considering collecting general waste (the black bin) every three weeks instead of every two weeks. Food waste would still be collected every week and recycling every two weeks. The council estimates the change would save about £600,000 a year; it needs to find £3.1 million of savings next year. No decision has been made. To what extent do you support or oppose collecting general waste every three weeks?
One answer- Strongly support
- Tend to support
- Neither support nor oppose
- Tend to oppose
- Strongly oppose
- Don't know
-
Q4
If your black bin were collected every three weeks instead of every two, how easy or difficult would it be for your household to manage its general waste?
One answer- Very easy
- Fairly easy
- Neither easy nor difficult
- Fairly difficult
- Very difficult
- Don't know
Judges: assumptiveAssumes the household has a black bin, although Q1 explicitly allows households using sacks and no routing excludes them from this question.
Assumes the respondent's household has a black bin, but Q1 allows them to state they share bins or use sacks. It lacks display logic to handle this.
-
Q5
If your black bin were collected every three weeks, which, if any, of these would your household be likely to do? Please select all that apply.
Any that apply- Put more of our recyclable items in the recycling bin
- Put more of our food waste out for the weekly food waste collection
- Try to produce less waste (for example, buying things with less packaging)
- Take extra waste to the household waste recycling centre (the tip)
- Put out extra bags beside the black bin
- Nothing different – we already recycle everything we can
- Nothing different – for other reasons
- Don't know
Judges: assumptiveAssumes the household has a black bin, although households using sacks can reach this question. Several response options also refer to using or placing waste beside that bin.
Assumes the respondent has a black bin, which may not be true for those who selected 'We do not have our own black bin' in Q1.
-
Q6
Now suppose the council did move to collecting general waste every three weeks, but households that needed it could get extra help: a larger black bin, or an extra collection for nappies and hygiene waste (such as continence products). With this extra help available, to what extent would you support or oppose collecting general waste every three weeks?
One answer- Strongly support
- Tend to support
- Neither support nor oppose
- Tend to oppose
- Strongly oppose
- Don't know
-
Q7
If general waste were collected every three weeks and this extra help were available, which, if any, would your household ask for? Please select all that apply.
Any that apply- A larger black bin
- An extra collection for nappies
- An extra collection for continence products or similar hygiene waste
- None of these
- Don't know
-
Q8
The council has four options. Which one would you most prefer?
One answer- Collect general waste every three weeks across the whole district
- Collect general waste every three weeks across the whole district, with extra help (a larger bin, or extra collections of nappies and hygiene waste) for households that need it
- Try three-weekly collection in some areas first, before deciding whether to introduce it across the district
- Keep general waste collection every two weeks
- Don't know / no preference
-
Q9
Which, if any, of these apply to your household? Please select all that apply. We ask because a change to collections could affect these households differently.
Any that apply- One or more children in nappies
- Someone who uses continence products, stoma bags or similar products because of a health condition or disability
- Five or more people live in the household
- None of these
- Prefer not to say
-
Q10
Is there anything else you would like to tell the council about this proposal, including how it would affect your household? (Optional – please do not include your name or other personal details.)
Open text
Sample plan
PURPOSE AND THE LEADER'S REQUEST: The survey is built to measure what residents think, not to show support. Wording is neutral, scales are balanced, and 'keep two-weekly' is a full option. Results will be reported whichever way they fall. A consultation designed to produce a particular answer would be open to challenge and would not tell full council how much opposition or hardship to expect.
TWO STREAMS, NEVER POOLED: The same questionnaire runs on two separate links.
(1) Residents' panel – the only source for 'how many residents support or oppose'.
- Who: adults 18+, one per address, at randomly selected addresses, invited by letter with a unique one-use code.
- Target: about 420 completes, allocated equally by ward (about 70 per ward).
- Mail-out: about 4,000–5,000 letters, assuming 8–10% response (my assumption). Send one reminder, review response after the first wave, and send top-up mailings in low-response wards.
- Profile: monitor age (S1) and tenure (from panel recruitment records) against the district profile during fieldwork. Weight the final data to district age, tenure and ward population.
- Ward: taken from the sampled address and confirmed by S3.
(2) Open consultation – a record of who chose to respond, not a measure of district opinion.
- Who: anyone 18+ living in the district, via the council website, social media and the residents' magazine.
- No cap, no quotas, no weighting; open for the full consultation period.
- Self-selected respondents usually over-represent people with strong views.
PRECISION – THE WARD REQUIREMENT CANNOT BE MET WITH 420 COMPLETES:
- ±6 points at 95% confidence needs about 267 completes per ward, about 1,600 in total (roughly 16,000+ letters), and slightly more after weighting.
- With about 70 per ward the margin is about ±12 points. Two wards would need to differ by about 17 points before the gap is distinguishable from noise.
- What 420 does deliver: district-wide results to about ±5 points (±5–5.5 after weighting), and a town versus rural split (about 210 each) to about ±7 points.
- Choice for the council before fieldwork: (a) fund about 1,600 panel completes to meet ±6 per ward, or (b) keep 420 and accept district and town/rural results as the reliable figures, with ward results shown as indicative only, with their intervals.
- Without extra budget I recommend (b). I will not present ward figures as precise.
SMALL GROUPS: At 420 completes the panel will probably contain only about 30–40 households with a child in nappies and 20–35 with a continence-product user (my estimates). Panel figures for these groups are indicative (±16 points or wider). The open consultation and Q10 comments add depth on the nature of the impact, not its prevalence.
FIELDWORK NOTES:
- Length: median about 5 minutes; respondents who write a long comment at Q10 will take longer.
- Scale direction: Q3, Q4 and Q6 run support-first/easy-first for a random half and reversed for the other half, consistent within each respondent.
- Option order: Q5 options are randomised except the last three. 'Nothing different', 'None of these', 'Don't know' and 'Prefer not to say' are exclusive.
- Quality checks: no attention-check question is used, given the 10-question limit. Instead, flag completes under 90 seconds, remove duplicate submissions in the open stream (same device with identical answers), and reject invalid or out-of-district postcodes.
- Data protection: postcodes are converted to ward and deleted from the analysis file.
- Coverage: online-only fieldwork under-represents residents who are not online, especially older residents. This will be stated in the report; the council should offer a paper or phone route for accessibility, reported separately.