BaseRT makes Apple Silicon LLM inference up to 6.4× faster
BaseRT delivers up to 6.4× faster prompt processing than llama.cpp and 3.9× faster than MLX on Apple Silicon, verified across models from 0.6B to 35B parameters. The open‑source runtime brings on‑device LLMs with low latency and privacy, expanding edge AI use cases.