Benchmarks / DeckBench / Northgate Homes
Measured by Spring Prompt
Mistral Large 4: Responsive repairs: in-house team or renewed contract
For the board of trustees of a housing association, including two tenant board members. The decision it supports: whether to approve £1.2m to set up an in-house repairs team or renew the contract.
- Verdict
- Not presentable
- Deck rating
- 515
- Slides
- 7 (brief: 6-9)
- Design quality
- 7%
Why it is not presentable
- Showed a number the analysis does not support
- Did not give the analysis's recommendation within the first two slides
- Drew a conclusion from a figure without its caveat
- Made a material claim the analysis does not support
- A slide the judges rated as needing work
In detail
- Caveat missing: reported repairs from October are inflated by about 12% by the new system's counting.
- Not supported by the analysis: slide 7: 125%.
- Slide 2: “Completed within target (%): 1 in every month from April to March.” is not supported by the analysis.
- Slide 4: “Renewing the contract means no change to current service levels.” is not supported by the analysis.
- Slide 4: “An in-house team gives full control over service quality and performance.” is not supported by the analysis.
- Slide 7: “Backlog up 125%.” is not supported by the analysis.
- Slide 7: “An in-house team gives full control over service.” is not supported by the analysis.
- Slide 2: “Chart data gives 'Completed within target (%)' as 1 for every month, instead of falling from 81% to 58%” is not supported by the analysis.