Datadog built an internal benchmark suite specific to its engineering workflows to measure what was actually worth paying for its coding model.
Published
Signal category
Research & Knowledge
Quote
“Our own evals showed an 8% drop in task performance. We took the hit anyway, because it came with a 37% cost reduction, and we'd built an internal benchmark suite specific to our own engineering workflows to know exactly what we were trading before we made the call.”
— Anis Chahloul|Datadog team
Company
Datadog
Datadog provides cloud-scale monitoring and security for metrics, traces and logs in one unified platform.
- Industry
- Software Development
- Location
- New York, US
- Company size
- 10,703 employees
Datadog is the essential monitoring platform for cloud applications. We bring together data from servers, containers, databases, and third-party services to make your stack entirely observable. These capabilities help DevOps teams avoid downtime, resolve performance issues, and ensure customers are getting the best user experience.
Founded 2010