Alkami Technology performed performance testing Qwen, GLM, and Llama on vLLM under production-like concurrency, resulting in 1.92x more requests meeting the same latency SLO on the same GPU budget or roughly 48% lower effective GPU cost per successful request.
Published
Signal category
Research & Knowledge
Quote
“1.92x more requests meeting the same latency SLO on the same GPU budget, or roughly 48% lower effective GPU cost per successful request.”
— Ritesh Mishra|Alkami Technology team
Company
Alkami Technology
Alkami is the digital sales and service platform provider for financial institutions in the US.
- Industry
- Financial Services
- Location
- Plano, US
- Company size
- 1,158 employees
Alkami is the digital sales and service platform provider for U.S. banks and credit unions. Our unified Platform integrates onboarding, digital banking, and data and marketing—each solution can stand alone, but together they deliver more—to help institutions onboard, engage, and grow relationships. As the future shifts toward Anticipatory Banking, we help data-informed bankers meet the moment with technology that drives action.
Founded 2009