DigUp lets Apple Silicon Mac users search photos, PDFs, recordings, videos, code and screenshots by describing what they mean, without sending indexed files off-device. It uses EmbeddingGemma 2 to put different media types in one searchable space, so “a dog on the beach” can find a photo and “where they talk about sleep” can jump to a podcast moment. The 865 MB model downloads once; the app requires macOS 14 or later and has no account or telemetry.
Ai2 now allocates scarce GPU time through budgets, hierarchical fair share, and a time-slicing contract, giving research teams a transparent way to decide who gets compute. The change targets clusters with thousands of NVIDIA H100, B200, and B300 GPUs serving about 150 researchers, while demand runs at two to three times available capacity. It also addresses GPU squatting, priority inflation, and costly shutdown negotiations.
llama.cpp now offers an opt-in probabilistic drafting path that can make multi-token decoding faster by letting more draft tokens survive verification, so users can trade the default greedy behavior for higher acceptance. It uses rejection sampling on the CPU: a draft token is accepted with probability based on the target and draft distributions, rather than only when their top picks match. Reported acceptance-length gains range from 2.7% to 13.4%, depending on the model, drafter, and temperature.