A new pull request to the llama.cpp repository adds support for DeepSeek V4 Flash, enabling the model to run on the C++ inference engine. Although still experimental and slow, it demonstrates the first functional integration of the DeepSeek V4 series with llama.cpp, requiring high‑VRAM GPUs.
OpenLumara is an open‑source, GPL‑2 AI agent framework written from scratch in Python, built for local LLMs (llamacpp, koboldcpp, Ollama). Its token‑efficient design uses a ~4k‑token system prompt and modular components that can be toggled, offering WebUI, CLI, Telegram, Discord, and Matrix integrations.
The EVA‑Bench Data 2.0 release adds three enterprise voice‑agent domains, Airline Customer Service, IT Service Management, and Healthcare HR Service Delivery, covering 213 realistic scenarios and 121 tooling configurations. All datasets are open‑source on Hugging Face and have been validated against leading LLMs, enabling robust benchmarking and dataset creation.