Startup Events pushed a PhoneLLM Alpha 1 in 8-bit MLX on Hugging Face.
Public source
Publisher name
Public post
We pushed a PhoneLLM Alpha 1 in 8-bit MLX on Hugging Face. When I started on Aug 28, no MLX build existed. Numbers on an M4 Max/128 GB Mac: TTFT - 70 to 100 ms (p50), 51…
Company
Startup Events
- Industry
- IT Services and IT Consulting
- Location
- Berlin, DE
- Company size
- 501–1,000 employees
About Startup Events
Discover more
Similar signals
Similar public activity from other companies.
Research & Knowledge
Infosys
Infosys published K2 Horizon, a connected fleet of six open models ranging from 0.9B to 375B parameters, optimizing tasks from wearables to enterprises.
Research & Knowledge
Connect
Connect benchmarked a compact AI model orchestrated like a well-run contact centre team with a router, specialists, retriever, verifier, and a safety layer.
Research & Knowledge
The Open Accelerator
The Open Accelerator published a research paper by Rob Geada on three approaches to LLM guardrails using NVIDIA's open-source NeMo Guardrails framework, tested locally with no GPU required.
Research & Knowledge
Labyrinth Labs
Labyrinth Labs demonstrated layer streaming on an RTX 3050 Laptop GPU to run Llama 3.1 8B Instruct at 119.6 tok/s with 3.32 GB peak VRAM.
Research & Knowledge
Tkxel