LodeHQ
AI news for people who shipFree, by email

Data · Tuesday, 25 August 2026 · Issue 86 · 9 stories

MetaRoCE rewrites Ethernet rules for AI clusters

Meta's clean-sheet RDMA transport tosses out the core assumption that frames must arrive in order. The result: Ethernet that doesn't strangle AI compute.

Data Engineering

Meta's MetaRoCE reinvents RDMA transport for million-GPU Ethernet clusters

Meta's clean-sheet RDMA transport tosses out the core assumption standard RoCE is built on: that the fabric must deliver frames in order. MetaRoCE moves intelligence to the NIC, sprays packets across many paths, and treats out-of-order arrival as normal so every GPU transfer lands straight in memory with no reorder buffer or head-of-line blocking. The spec, a reference implementation, and a compliance suite are now out under the Open Compute Project. It is the clearest industry signal yet that Ethernet can carry AI at scale without the fabric strangling compute.

engineering.fb.com ↗8 min read at source

How one team shrunk its change-data-capture bill 20x, from $3,000 to $150

A hands-on case study of turning a runaway change-data-capture bill into a rounding error. The team found most of the cost came from streaming every change of every table through expensive ingest pipelines, then re-platformed the hot path so only material changes moved. $3,000 a month became $150, and they walked away with a reusable playbook for anyone sizing CDC infrastructure. Concrete numbers, architecture trade-offs, no vapor.

jimdoverse.com ↗8 min read at source

ML & AI for Data

Agent scaffolding, not MCP vs CLI, is what actually drives cost

A controlled study ran one software task across seven agent scaffoldings and five models, and found that tool interface was nearly irrelevant to cost. Two scaffolds shipping no MCP support finished every run 5x to 28x cheaper than the five that support it, and paired MCP-to-CLI cost ratios swung from 0.43x to 29x. Interface choice alone is a weak predictor; the harness is the lever. Harness, task, and data are released.

arxiv.org ↗3 min read at source

Skala 1.1 deep-learning DFT functional gets sharper and spreads to major chemistry codes

Microsoft Research's deep-learning exchange-correlation functional just got measurably better: trained on 2.5x more data, Skala 1.1 sharpens accuracy on thermochemistry, reaction kinetics, and structure prediction. The bigger move is reach, it now runs in CP2K and is being wired into Psi4, FHI-aims, ORCA, and VASP, the codes chemists actually use. A living benchmark now tracks how each successive release performs, so the field can measure the march toward predictive DFT rather than take it on faith.

microsoft.com ↗7 min read at source

Databases & Storage

DuckDB v2.0 turns the embedded DB into a server

The 2.0 preview, out this fall, grafts client/server onto an in-process engine: the Quack extension lets any DuckDB serve databases over the network while the new CONNECT statement routes SQL straight to Postgres or MySQL. Beyond that, it adds triggers, a VARIANT type, asynchronous I/O, a reworked C API, and a new storage format across 10,000+ commits since v1.5. A version bump this large is also a warning: expect breaking changes.

duckdb.org ↗15 min read at source

Practice & Datasets

Open-sourced OMR benchmark that lets anyone recompute the numbers

A new optical music recognition benchmark ships more than claims: ground-truth MusicXML for 31 engraved pages, phone-degraded photocopies of the same scores, and raw output from three engines, a commercial pipeline, Audiveris 5.11.0, and oemer. The included scorer, score.py, needs zero dependencies, uses strict note-level F1, and rebuilds the published table in about ten seconds. Compact at 2.4 MB under CC BY, it turns OMR figures from trust-me into run-it-yourself.

trysheetly.com ↗2 min read at source

One clean dataset of 6 years of daily US job postings, broken out by sector and state

Want the full arc of the US labor market since COVID in one download? This Kaggle dataset tracks daily (Indeed) job postings across 44 sectors and all 51 states from Feb 1, 2020 through today, with pre-computed stats per sector: net change, pandemic trough and peak, and days-to-recovery. It adds an original SOC-2018 crosswalk that maps Indeed's categories onto standard occupational codes, licensed CC BY 4.0. The fully scripted pipeline rebuilds every file from scratch for easy refresh.

kaggle.com ↗2 min read at source

18,208 job postings changed salary after going live, and the diffs preserve the old band

A tracker diffed daily snapshots of 998 companies' Greenhouse, Ashby and Lever boards and caught 18,208 postings whose salary band moved after they went live. Because the diff keeps the prior snapshot, it preserves the old band, which vanishes the moment a company overwrites it. Only 48.8% of currently open postings even list a pay range, and parsing one means escaping Greenhouse's double-escaped HTML. Whoever hosts the pre-change salary else, so this is rare ground truth.

apify.com ↗3 min read at source

You’re caught up.

That was all 9 stories in the 25 August issue.