Benchmarks / SurveyBench / Should Corefit gyms stop opening 24 hours? / Claude Fable 5.2
Claude Fable 5.2: Should Corefit gyms stop opening 24 hours?
The decision: whether to close all 14 gyms between 11pm and 5am, close overnight only at the quietest gyms, or keep every gym open 24 hours. The brief and the data →
- Verdict
- ✗ Not sound
- Research score
- 96 of 100
- Analysis rating
- 1,683
- Head to head, this task
- won 9 of 10
Why it is not sound
The analysis
- Reported a material finding the data does not support
Findings the judges found unsupported
Operations director: overnight use is a small minority, but it is not 'almost nobody', and the survey alone does not justify closing all 14 gyms.
The presence-versus-entry distinction is real, but the data do not establish that it explains any particular part of the survey's excess overnight use. Saying the excess is partly caused by this distinction goes beyond identifying a possible measurement difference.Marketing director: plan for losing roughly 1,000 overnight users as the firmer core of the loss, with about 4,400 members (11.4%) as a stated-intention ceiling rather than a forecast.
The weighting calculations are supported, but roughly 1,000 overnight users stating cancellation intentions are not a firmer core of actual losses or a lower bound. Nor is the weighted stated-intention total a demonstrated ceiling. Despite its disclaimers, the analysis subsequently treats these figures as a 1,000–4,400 loss range for planning and financial comparisons.About three-quarters of the projected loss comes from members who never use the gym overnight. Their answers look like reactions to price fairness and crowding rather than lost access, so this part of the risk is the softest and the most manageable through pricing and communication.
Non-users contribute about three-quarters of the weighted stated-intention total, not an established projected loss. The comments are not linked to respondents' cancellation answers, so they do not establish that non-users' cancellation intentions are caused by price fairness or crowding, or that this risk is the most manageable through pricing and communication. No overnight visits in four weeks also does not mean never using the gym overnight.24-hour opening is a secondary reason for joining among current members; price and location dominate. But it is the main draw for the minority who use it, and the survey says nothing about its pull on prospective members.
Calling 24-hour opening the main draw for overnight users overstates the joining-reasons evidence: 59.2% selected it, compared with 73.9% selecting price and 71.1% selecting location. It is important to this group, but is not their leading reported reason.Regional manager: the North West versus North East gap is not reliable and should not drive a regional exemption. The decision unit should be the individual gym.
The statistical caution about the regional difference is supported, but the assertion that Q6 looks unreliable is not established. A comment mentioning another branch or city need not contradict the respondent's registered home gym.The survey cannot identify 'the quietest gyms'. That choice must come from door-entry data by gym, not from these tables.
The small-base warning and recommendation to use gym-level entry records are supported. However, references to places other than the registered home gym do not establish that Q6 or the resulting regional tables are unreliable or misattributed; members may visit other branches or discuss locations other than their home gym.
Scorecard
Numbers 11 of 11 right
| Question | Its answer | True | |
|---|---|---|---|
| What percentage of respondents reported at least one visit to a Corefit gym between 11pm and 5am in the last four weeks? | ✓ | 14.9% | 14.9% |
| What percentage of all respondents said they would be likely (fairly or very) to cancel their membership if their home gym closed between 11pm and 5am? | ✓ | 14.6% | 14.6% |
| Among respondents who reported at least one visit between 11pm and 5am in the last four weeks, what percentage said they would be likely (fairly or very) to cancel? | ✓ | 45.8% | 45.8% |
| Weighted so that respondents with at least one visit between 11pm and 5am in the last four weeks count as 6% of members (the door-entry figure) and the rest as 94%, what percentage would be likely (fairly or very) to cancel? | ✓ | 11.4% | 11.4% |
| If the weighted share likely to cancel were applied to all 38,600 members, about how many members would that be? | ✓ | 4,400 | 4,383 |
| Among respondents who reported at least one visit between 11pm and 5am in the last four weeks, in which band of the Q1 table does the median number of visits fall? Give the lowest value of that band (for example 4 for '4 to 7'). | ✓ | 2 | 2 |
| What is the 95% margin of error, in percentage points, on the unweighted share of respondents who reported at least one visit between 11pm and 5am in the last four weeks? | ✓ | 2.3 points | 2.27 points |
| Is the difference between North West England and North East England respondents in the share likely (fairly or very) to cancel statistically significant at the 95% level? (1 for yes, 0 for no) | ✓ | No | No |
| How many of the open-text answers say that 11pm to 5am is the only time the respondent can train because they work shifts or nights? | ✓ | 16 | 16 |
| How many of the open-text answers from respondents who visited between 11pm and 5am in the last four weeks say they would move to another gym? | ✓ | 19 | 19 |
| What percentage of the members invited completed the survey? | ✓ | 8% | 8% |
Traps in the data 8 of 8 handled
- ✓14.9% of respondents report at least one visit between 11pm and 5am in the last four weeks, against 6% of members in the door-entry records: members with a stake in the overnight hours were more likely to respond. Unweighted, 14.6% say they would be likely to cancel; weighted to the 6%, 11.4%.
- ✓'Likely to cancel' answers (45.8% of overnight users, 14.6% overall) are stated intentions about a hypothetical closure, asked straight after members were invited to think about it.
- ✓The mean number of overnight visits among overnight users (7.4) is pulled up by night-shift workers who come almost daily; the median is in the '2 to 3' band.
- ✓The operations director believes almost nobody uses the gyms overnight. Partly true: 6% of members in the door-entry records (about 2,316 people). But night-shift workers (5.9% of respondents) mostly train between 11pm and 5am (77.8% of those who visited overnight usually arrive then) and are the most likely to say they would cancel.
- ✓At Wakefield Calder Park (base 11), 54.5% of respondents used the gym overnight and 27.3% say they would be likely to cancel.
- ✓North West England respondents (base 229) look more likely to cancel than North East England respondents (base 220): 19.2% against 13.6%, a gap that is not statistically significant at 95%.
- ✓Only 950 of 11,900 invited members completed (about 8%); those who responded differ from those who did not, as the overnight-use skew shows.
- ✓Only current members were surveyed: people who joined for 24-hour access and have since left, and people who would join only because of it, are missing, so the survey cannot show what 24-hour opening does for recruitment or the brand; and night-shift workers are a small group whose answers carry little weight in the totals even though they depend on the hours.
The analysis
Do not close all 14 gyms on this evidence, and do not exempt the North West as a region. Go with the middle option, but as a controlled pilot: use door-entry data by gym, not this survey, to pick two or three of the quietest gyms, close them overnight for about three months against matched gyms that stay open, and measure actual cancellations before deciding on the rest. The reason is that losses could be anywhere from about 1,000 members (overnight users who say they would leave) to about 4,400 (everyone who says so), and the survey cannot narrow that range. Before announcing anything, settle the price position, because members expect a cut unprompted and that could erode the saving. Offer night-shift members at pilot gyms a mitigation where one exists, such as access to a nearby Corefit that stays open. Finance should set the overnight saving per gym against this range. As an illustration only, using the £17 to £22 fees quoted in a handful of comments, 1,000 members is about £240,000 a year and 4,400 about £1 million.
Towards wider or full closure: pilot cancellations among overnight users well below the stated 46%, no rise in cancellations among non-users, shoulder hours staying uncrowded, and an overnight saving per gym that clearly exceeds the lost fees. Towards keeping every gym open: door-entry data showing overnight users are a larger or more valuable group than 6% once sessions that run past 11pm are counted; pilot cancellations among non-users near the 9% stated; a saving smaller than the fees of roughly 1,000 members; or evidence that the 24-hour claim drives a material share of new joiners. Towards regional treatment: a North West difference that holds up in database gym records and actual cancellation behaviour.
Findings
-
Operations director: overnight use is a small minority, but it is not 'almost nobody', and the survey alone does not justify closing all 14 gyms.
14.9% of respondents (142 of 950, ±2.3 points) say they were in a gym between 11pm and 5am in the last four weeks. Door-entry records put it at 6% of members (about 2,316) in September. The survey over-represents overnight users roughly 2.5 times, partly through self-selection and partly because Q1 counts anyone still inside after 11pm while the door data counts entries only. Only 5.4% (51 respondents) say overnight is their usual arrival time.
-
Overnight users are two different groups: a majority of occasional visitors, and a core of night-shift workers who use the gym heavily overnight and say they have no other time to train. A blanket closure removes the service entirely for that core.
Of 142 overnight users, 78 (55%) made only 1 to 3 visits in four weeks; the median is in the '2 to 3' band, and the mean of 7.4 is pulled up by heavy users. 49 made 8 or more visits, and 45 of those 49 work shifts that include nights. Among the 56 night-shift workers, 80.4% visited overnight, 62.5% usually arrive overnight and 48.2% say they are likely to cancel (±13 points on this base). 16 open-text answers say overnight is the only time they can train. If the door-entry population has the same mix, this core is roughly 800 members, a rough extrapolation.
-
Marketing director: plan for losing roughly 1,000 overnight users as the firmer core of the loss, with about 4,400 members (11.4%) as a stated-intention ceiling rather than a forecast.
Unweighted, 14.6% say they are likely to cancel (139 of 950). This is 45.8% of overnight users (65 of 142, ±8 points) and 9.2% of non-users (74 of 808, ±2 points). Reweighted to the door-entry split of 6% and 94%, it is 11.4%, about 4,400 of 38,600 members (sampling range about 3,650 to 5,150). Overnight users account for about 1,060 of that (45.8% of 2,316). Counting 'very likely' only gives 4.9%, about 1,900 members. Stated intention to cancel under a hypothetical normally overstates what people do, and 32.3% answered 'neither'.
-
About three-quarters of the projected loss comes from members who never use the gym overnight. Their answers look like reactions to price fairness and crowding rather than lost access, so this part of the risk is the softest and the most manageable through pricing and communication.
Non-users contribute 8.6 of the 11.4 weighted points, about 3,300 of the 4,400 members. Among the 200 comments from non-users, 87 say no effect, 43 expect a lower fee, 42 would welcome closure on safety grounds and 28 fear crowding just before 11pm or just after 5am. None says they would leave. Q4 did not say what would happen to the price.
-
24-hour opening is a secondary reason for joining among current members; price and location dominate. But it is the main draw for the minority who use it, and the survey says nothing about its pull on prospective members.
'Open 24 hours' was a joining reason for 24.0%, fifth of the six named reasons, behind low price (68.9%), location (62.6%), no contract (38.9%) and equipment (29.8%). It is 59.2% among overnight users (base 142) against 17.8% among non-users (base 808), and 55.4% among night-shift workers (base 56). Only current members were surveyed.
-
Regional manager: the North West versus North East gap is not reliable and should not drive a regional exemption. The decision unit should be the individual gym.
19.2% of North West respondents are likely to cancel (44 of 229) against 13.6% in the North East (30 of 220). The 5.6-point gap gives z of about 1.6, not significant at 95%. North West against all other regions combined (19.2% v 13.2%) is borderline, but that is a post-hoc pick of the highest of four regions. Overnight use is no higher in the North West (14.0% v 15.0%). Preston has the second-lowest overnight use (7.7%) yet 19.2% likely to cancel, and Newcastle Byker in the North East (18.9%) is as high as the North West gyms. Region is also derived from Q6, which looks unreliable.
-
The survey cannot identify 'the quietest gyms'. That choice must come from door-entry data by gym, not from these tables.
Per-gym bases are 61 to 81, giving margins of roughly ±6 to ±10 points, and Wakefield has 11 respondents. Reported overnight use runs from 7.5% (Leeds Kirkstall) to 20.3% (Newcastle Byker). Wakefield's 54.5% is 6 of 11 people and its 27.3% likely to cancel is 3 of 11, so neither can be read. About 19 of the 239 comments mention a city or branch that does not match the respondent's Q6 home gym (for example M100, M121, M429, M625, M823), so the gym and region splits may be misattributed.
-
Closure has side effects beyond the overnight users: an unprompted expectation of a price cut, fear of crowding at 10 to 11pm and 5 to 6am, and a group who would welcome it because unstaffed nights feel unsafe.
Of 239 open-text answers, 52 expect a lower fee (suggested amounts range from £3 to £10 a month), 31 expect crowding in the hours either side of the closure, and 42 would be glad of closure for safety reasons. 90 say it would not affect them. These are counts of comments, not estimates of prevalence. The safety and crowding themes were not measured in any closed question.
Caveats
- Response was 8.0% (950 of 11,900 invited) and unweighted. Overnight users are over-represented about 2.5 times against door-entry records (14.9% v 6%), so unweighted totals overstate both overnight use and cancellation risk.
- Q1 and the door-entry figure measure different things. Q1 is self-reported presence at any time between 11pm and 5am in the four weeks before answering; the door data counts entries in September. Members who enter before 11pm and stay later would be affected by closure but are not in the 6%. Three of the 39 comments from 'overnight visitors' say they never go at night (M034, M305, M735). The reweighting to 6% is therefore approximate.
- Q4 is stated intention under a hypothetical that did not mention price, alternatives or notice. It is a ceiling, not a forecast, and the 4,400 projection should not be quoted as expected losses.
- Small bases: Wakefield has 11 respondents, night-shift workers 56, individual gyms 61 to 81. No allowance has been made for multiple comparisons across 14 gyms and four regions.
- Q6 home gym looks unreliable: about 19 comments name a city or branch that does not match it. Gym and region tables should be rebuilt from the membership database before anyone relies on them. Wakefield is only 1.2% of the sample, and we cannot tell whether it is a small gym or under-responded.
- Open text: 239 answers from 950 completes, coded by one analyst. Counts show what was raised, not how common the views are among members. M568 says they would cancel but does not mention another gym, so it is excluded from the 19 who would switch.
- Not covered by this survey: prospective and lapsed members (so brand and acquisition effects), the cost saving from closing, overnight safety incidents, 24-hour competitors near each gym, and any breakdown by length of membership (Q8 was not cross-tabulated).
Next steps
- decisionDo not approve closure of all 14 gyms now; approve a time-limited pilot at two or three gyms, with go/no-go thresholds set in advance.
- researchAnalyse door-entry records by gym and hour for the last 6 to 12 months: unique overnight members per gym, how much of their use is overnight, sessions that start before 11pm and run past it, and current occupancy at 10 to 11pm and 5 to 6am. Map 24-hour competitors near each gym.
- researchHave finance quantify the overnight saving per gym (energy, security, cleaning, maintenance, incident costs) and set it against lost fees at about 1,000, 1,900 and 4,400 members.
- experimentRun the overnight closure pilot at the quietest gyms against matched control gyms for about three months, with a defined price and communication treatment.
- decisionDecide the price and messaging position before any announcement (hold the price with a safety rationale, a small reduction, or a freeze), and test it within the pilot if possible.
- researchInterview 12 to 15 heavy overnight users (night-shift workers) at the candidate gyms about what they would do and which mitigations would keep them, such as access to a nearby 24-hour Corefit or a shorter closure window.
- researchTest how much the 24-hour claim matters to prospective members, using join-flow data, a new-joiner question or an ad test with and without the claim.
- monitorDuring the pilot, track weekly occupancy at 10 to 11pm and 5 to 6am, cancellations with reasons, complaints and overnight incident reports at pilot and control gyms.
Open-text themes it coded
No effect on me: I never use the gym overnight 90Would expect a lower monthly fee if hours are cut 52Would welcome closure: an unstaffed gym at night feels unsafe 42Fear of crowding in the quiet hours either side of the closure (about 10 to 11pm and 5 to 6am) 31Overnight is the only time I can train because of night or shift work 16Would move to another gym that stays open 24 hours 19
The survey it planned
1 screening question and 10 questions, as the model wrote them.
-
S1
Are you currently a member of Corefit?
One answer- Yes, I am currently a member
- Yes, but I have given notice to cancel
- No, my membership has ended or been cancelled
Continues if Yes, I am currently a member; Yes, but I have given notice to cancel
-
Q1
Thinking back to when you joined Corefit, which of these were reasons you chose it? Please select all that apply.
Any that apply- Low monthly price
- No long-term contract
- Convenient location
- Open 24 hours a day
- The equipment and facilities
- The classes on offer
- Friends or family were members
- Recommendations or reviews
- Something else
- I don't remember
-
Q2
In the past 3 months, at which of these times of day have you been at a Corefit gym? Please select every time period in which you spent any part of a visit.
Any that apply- Between 5am and 9am
- Between 9am and 12 noon
- Between 12 noon and 5pm
- Between 5pm and 8pm
- Between 8pm and 11pm
- Between 11pm and 5am
- I have not been to a Corefit gym in the past 3 months
-
Q3
In the past 3 months, about how often were you at a Corefit gym between 11pm and 5am?
One answer- Once or twice in the whole 3 months
- About once a month
- 2 or 3 times a month
- About once a week
- 2 or 3 times a week
- 4 or more times a week
Routing Shown only if Q2 is: Between 11pm and 5am
-
Q4
Why do you use the gym between 11pm and 5am? Please select all that apply.
Any that apply- It fits around my work hours or shifts
- It fits around my studies
- It fits around caring or family commitments
- The gym is quieter then
- I prefer to exercise late at night or very early in the morning
- It is the only time I am able to go
- Another reason
Routing Shown only if Q2 is: Between 11pm and 5am
-
Q5
Corefit is reviewing its opening hours. Imagine the Corefit gym you use most was closed every night between 11pm and 5am and open from 5am to 11pm, with everything else, including the price, staying the same. How much, if at all, would this affect you?
ScaleScale 1-5: Would not affect me at all to Would affect me a great deal
-
Q6
If the Corefit gym you use most was closed between 11pm and 5am, what would you be most likely to do?
One answer- Keep my membership and use the gym as I do now
- Keep my membership and move my visits to other times
- Keep my membership but use the gym less often
- Probably cancel my membership
- Definitely cancel my membership
- Not sure
Judges: assumptiveShown to all current members, including those who have never attended. The scenario assumes they have a gym they use most, and the substantive response options assume existing gym use.
The options assume the respondent has an ongoing membership to keep or cancel, but S1 includes members who have already given notice to cancel.
-
Q7
You said you would use the gym less often or cancel your membership if it closed between 11pm and 5am. In a sentence or two, what is the main reason? (Optional)
Open textRouting Shown only if Q6 is: Keep my membership but use the gym less often; Probably cancel my membership; Definitely cancel my membership
-
Q8
Which of these best describes your current working pattern?
One answer- I work mainly daytime hours
- I work mainly evenings or nights
- I work rotating or changing shifts
- I am a full-time student
- I am not currently working (including retired, caring or looking for work)
- Prefer not to say
-
Q9
How old are you?
One answer- Under 25
- 25 to 34
- 35 to 44
- 45 to 54
- 55 to 64
- 65 or over
- Prefer not to say
-
Q10
Which of these best describes you?
One answer- Woman
- Man
- Non-binary
- I describe myself in another way
- Prefer not to say
Sample plan
FRAME AND DESIGN: All current members in the membership database, sampled at random within strata defined by home gym (14) and overnight use (any door entry between 11pm and 5am in the past 3 months, yes or no). Home gym, region, membership start date and door-entry counts are attached to each response through a personalised survey link, so gym is not asked. The invitation says answers will be linked to membership and visit records and reported only in aggregate. TARGETS: About 1,008 completes, 72 per gym regardless of gym size, so every gym gets the same precision. Within each gym, about 18 completes come from the overnight-use stratum and 54 from other members. This oversample gives about 250 overnight users in total instead of the 60 to 90 a proportionate sample would give, because they are the group the decision turns on. Where a gym has too few overnight users, all are invited and the shortfall is filled from other members. There are no demographic quotas. INVITATIONS: Assuming a 10% response rate (to be checked after the first release), about 720 invitations per gym, roughly 10,000 in total. They are released in two random batches so the second can be resized, with two reminders over a fixed two-week field period. Strata are not closed early, to avoid favouring quick responders. The subject line and invitation are neutral ('Tell us how you use Corefit') and do not mention closing, so affected members are not more likely to respond. WEIGHTING: Design weights correct for unequal selection by gym and overnight stratum. A non-response adjustment then matches the database profile within each gym on overnight stratum, tenure, and age and sex where held. Chain-wide results are weighted to each gym's share of the 38,600 members. PRECISION, WHICH THE BOARD NEEDS TO SEE BEFORE FIELDWORK: Plus or minus 8 points at 95% confidence for every gym needs about 150 completes per gym, roughly 2,100 in total (about 2,000 after finite-population correction). That is double the 1,000 cap. With 72 per gym (effective base about 63 after weighting), per-gym results are within about plus or minus 12 points for results near 50%. They are within plus or minus 8 only for results of about 10% or lower, or 90% or higher. Stated cancellation is likely to fall in that range, but this cannot be guaranteed in advance. Chain-wide results will be within about plus or minus 3.5 to 4 points, and pooled regions or gym tiers fall in between. Overnight-user results will be within about plus or minus 6 to 7 points chain-wide and are not reportable per gym. If the board needs plus or minus 8 on every per-gym result, the cap must rise to about 2,100 completes. Otherwise I recommend accepting the limits above and taking per-gym overnight usage from the door-entry records, which cover every member and have no sampling error. SCRIPTING: Q1 options are shown in random order, with 'Something else' and 'I don't remember' fixed last and 'I don't remember' exclusive. Q2 is in time order with the last option exclusive. Q7 is optional. No attention check is used in a 10-question member survey; quality is controlled by one response per link, removing speeders, and checking Q2 against door records. Typical completion is 2 to 4 minutes.