Models / devstral-small-2-24b-instruct-2512

Mistral

devstral-small-2-24b-instruct-2512

3 published results from 1 source. Each card shows where the number comes from and what it does not measure. Results are never combined into one score.

Provider
Mistral
Sources
1
Our benchmarks
0
Price
Not yet published

Reported by others

Reported by UGI Leaderboard
26.0%
Requested-length error · rank 233 of 370
Unit
% off the requested word count, lower is better
Configuration
devstral-small-2-24b-instruct-2512
Measured
13 Dec 2025
Not shown
Not other format limits such as character counts or bullet counts.
Reported by UGI Leaderboard
0.35
Style adherence · rank 196 of 370
Unit
score from 0 to 1, higher is better
Configuration
devstral-small-2-24b-instruct-2512
Measured
13 Dec 2025
Not shown
Not brand voice on your own examples: UGI's prompts are private and lean towards creative writing.
Reported by UGI Leaderboard
31.6
Writing score · rank 263 of 370
Unit
score out of 100, higher is better
Configuration
devstral-small-2-24b-instruct-2512
Measured
13 Dec 2025
Not shown
Not business copy quality: UGI's prompts are private and lean towards creative writing, and models that often refuse get no score.