Trail Openers enabled multi-token prediction on its LLM infra endpoint, which allows the model or a separate drafter model to draft next tokens and verify them in one pass.
Published
Signal category
Products & Services
Quote
“Multi-token prediction (aka speculative decoding, aka "getting more speed out of your self hosted LLM") finally went into production on our LLM infra endpoint.”
— Janni Turunen|Trail Openers team
Company
Trail Openers
We build sustainable, business-critical digital services. Lower emissions, smarter use of resources, and cost savings.
- Industry
- IT Services and IT Consulting
- Location
- Helsinki, FI
- Company size
- 12 employees
We design and develop digital services sustainably: We optimize their impact on the environment, economy, and society. Because it's the right thing to do. Green ICT is here to stay. We are pioneers of digital sustainability. With vast experience in designing and developing digital services, we ensure a functional and compelling result for new, existing, and evolving services. We assess your organization's digital services and elevate the sustainability of your services to a new, sustainable level. We can start with a small Proof-of-Concept exercise and then create a roadmap towards responsible digital services. Do you know the carbon footprint of your digital services? Contact us, and we will find out! #sustainability #greenICT #sustainabledigitalservices #digitaldevelopment www.trailopeners.com