LodeHQSubscribe →

Iran war slashes gas supply, fertilizer up 30%

Data · 2026-07-24

Data Engineering
Stop caching everything in Spark: target medium‑size CTE results5 MIN

Spark re‑evaluates CTEs each time, so blindly caching hurts. Cache only medium‑sized intermediate results that are reused at fan‑out points and fit comfortably in memory; skip tiny tables and datasets too big to stay resident. Use the Spark UI or eager cache calls to verify memory impact and keep jobs fast.

Analytics & Visualization
Seinfeld’s nine seasons mapped: data uncovers episode and character trends9 MIN

Andy Kirk logged every Seinfeld episode and built an interactive visual that tracks character screen time, episode length and plot motifs across nine seasons. The charts reveal the rise of recurring side‑characters, shifting story structures and subtle pacing changes, showing how data viz can dissect even a classic sitcom.

Iran war slashes natural‑gas supply, pushing fertilizer prices up 30%1 MIN

The conflict with Iran has cut 17% of global natural‑gas output and over 30% of nitrogen‑fertilizer production, according to Reuters’ data visualisation. That shortfall is already driving U.S. and European fertilizer prices higher, squeezing growers and nudging food costs upward. The story highlights how geopolitics ripple through the energy‑food chain.

ML & AI for Data
Recall‑Based Decay Engine Lets LLM Agents Remember What Matters22 MIN

A new deterministic memory engine replaces fixed recency windows with a usage‑reinforced decay model, letting frequently recalled facts survive far beyond the usual turn limit. Benchmarks show it retains core rules across 150‑turn sessions where standard sliding windows forget them entirely, boosting long‑run agent reliability.

Nunchaku 4‑bit Quantization now powers Hugging Face Diffusers, halving memory and doubling speed10 MIN

Hugging Face Diffusers now supports Nunchaku’s 4‑bit SVDQuant engine, letting you load a quantized checkpoint with a single from_pretrained() call. The NVFP4 kernels cut VRAM from ~24 GB to ~12 GB and generate 1024×1024 images in ~1.7 s on an RTX 5090, unlocking faster, cheaper diffusion inference.

Cost‑Savvy RAG: Local Model Feeds a Flagship LLM in a Cascading Loop10 MIN

An enterprise‑grade RAG pipeline stages a cheap, on‑prem LLM to pre‑filter queries, then hands only the top results to an expensive hosted model. The authors benchmark twenty open‑source models, showing up to 70% cost reduction without hurting answer quality, and they close the loop with automated validation to keep the cascade tuned.

GraphEval Detects LLM Hallucinations by Mapping Outputs onto Knowledge Graphs6 MIN

GraphEval offers a structured two-stage framework that builds a triple graph from model output and checks each triple against a ground‑truth knowledge base using an NLI model, flagging contradictions as hallucinations. The KDNuggets walkthrough shows a lightweight code demo, making the method easy to test and improving explainability of LLM errors.

Databases & Storage
How to Stop PostgreSQL From Crashing at Scale9 MIN

Most PostgreSQL outages stem from avoidable ops blunders, bad indexes, lingering transactions, blocked migrations, connection storms, and lagging autovacuum. This guide shows you how to model schemas around real query patterns, keep transactions short, and tune critical settings so your database scales reliably.

Get Data in your inbox, every issue.
Subscribe free
Get the app · Privacy · Terms · About · Contact
© 2026 LodeHQ