Cloudian Inc published a new benchmark run with NVIDIA Dynamo that shows KV Cache offloading to Cloudian HyperStore reduces time to first token by up to 20x compared to full recompute at 120K tokens.
Published
Signal category
Research & Knowledge
Quote
“Cloudian's new benchmark, run with NVIDIA Dynamo, shows there's a faster path.”
— Carlo F. Garbagnati|Cloudian Inc team
Company
Cloudian Inc
Cloudian is AI-ready storage that understands your data. On-prem security and leading performance. Exabyte scalable.
- Industry
- Software Development
- Location
- San Mateo, US
- Company size
- 179 employees
Cloudian is the leader in data management software for the hybrid cloud. With military-grade security, limitless scalability and seamless cloud integration, Cloudian’s S3-compatible object storage lets users optimize data access, meet data sovereignty requirements and cut costs by consolidating information to a single, cloud-like platform. Cloudian’s geo-distributed architecture manages and protects object and file data at the edge, core, and in the cloud—for both conventional and modern applications. Learn more at cloudian.com.
Founded 2011