LodeHQ
AI news for people who shipFree, by email

Data · Wednesday, 15 July 2026 · Issue 45 · 11 stories

Meta slashes ad latency 28% with BPF, Snowflake helps win gold

Data Engineering

Meta slashes ad latency 28% with custom BPF scheduler

Meta swapped the stock Linux scheduler for a BPF‑based policy built on sched_ext after a kernel upgrade spiked ad‑serving latency. The custom scheduler cut the 99th‑percentile retrieval latency by 28%, saved 3.28 MW of power and lifted the ads‑ranked count 1.1%, directly boosting revenue. At over 5 million requests per second, those milliseconds translate to billions in ROI.

engineering.fb.com ↗5 min read at source

Analytics & Visualization

ML & AI for Data

Why Ollama and Smolagents are powering 2026’s local AI agents

Ollama gives developers an OpenAI‑compatible, zero‑setup runtime for running LLMs on‑prem, slashing API costs and keeping data private. Smolagents layers minimal code‑first abstractions on top, letting you sandbox code‑generated actions and switch models without rewrites. Together they let teams build, coordinate, and scale local agents without ever leaving the network.

kdnuggets.com ↗8 min read at source

Omnigent’s contextual policies stop multi-step prompt injection that slips past single-action guards

Databricks shows that a LLM agent can exfiltrate data by breaking a theft into harmless steps that evade per‑action checks. Their Omnigent contextual policy records session activity and blocks the final export once too much sensitive content has been read, preventing the attack without changing the agent. This demonstrates a practical defense against slow‑burn prompt injections.

databricks.com ↗6 min read at source

Databases & Storage

Automated Redshift Patch Tests Guard Production Deployments

AWS released a fully automated Redshift patch‑validation pipeline that fires on every patch, reboot or config change. EventBridge triggers a Lambda that launches a Fargate‑hosted Docker suite, JDBC/ODBC driver checks, catalog queries, and custom workload benchmarks, to flag regressions before production rollout. The results land in S3 and alert teams via SNS, safeguarding SLAs.

aws.amazon.com ↗7 min read at source

Practice & Datasets

Cut LLM Latency and Cost with 12 Proven Production Tweaks

Production LLM services bleed time and dollars on unnecessary work. The guide details twelve concrete tactics, from token trimming and smarter caching to queue monitoring and model-size routing, that slash both response latency and inference spend. Implementing them can halve costs and bring sub-second replies without adding hardware.

kdnuggets.com ↗10 min read at source

You’re caught up.

That was all 11 stories in the 15 July issue.