Crusoe fine-tuned models on data with answers but no reasoning to maintain high valid reasoning rate and task accuracy, resulting in standard evaluation not flagging it.
Published
Signal category
Research & Knowledge
Quote
“That's what happened to models' valid reasoning rate when we fine-tuned them on data with answers but no reasoning, and task accuracy stayed high the whole time, so standard evals won't flag it.”
— Piyush Kadam|Crusoe team
Company
Crusoe
The AI factory company. We are on a mission to accelerate the abundance of energy and intelligence.
- Industry
- Technology, Information and Internet
- Location
- Denver, US
- Company size
- 1,716 employees
As the AI factory company, Crusoe is on a mission to accelerate the abundance of energy and intelligence. The company provides a reliable, scalable, cost-effective, and energy-first solution for AI infrastructure. By harnessing large-scale energy resources, building AI-optimized data centers, and delivering an AI cloud platform, Crusoe empowers its customers to build the future faster.
Founded 2018