LodeHQ
AI news for people who shipFree, by email

AI · Saturday, 18 July 2026 · Issue 53 · 10 stories

Google stalls Gemini 3.5 Pro, GPT-5.6 raises reasoning bar

Models & Releases

Research

Can AI benchmark subjective reasoning by predicting expert judgments?

A post argues that subjective conceptual tasks, like forecasting AI takeover risk, are poor benchmarks, but suggests turning them into “judgment prediction” tests where models aim to match specific experts’ answers under timed constraints. It outlines cheap and costly implementations and highlights the trade‑off between measuring capability gains and handling irreconcilable disagreements.

alignmentforum.org ↗3 min read at source

New framework explains why LLM self‑play stalls and how to break out

The paper shows that iterative feedback loops in LLMs, reinforcement learning, and autonomous discovery quickly hit a stability ceiling, limiting further gains. It introduces a three‑level operational model that treats structural changes as falsifiable interventions, offering concrete metrics for detecting and escaping saturation, directly useful for anyone building LLM self‑play or recursive improvement systems.

arxiv.org ↗2 min read at source

TAC benchmark shows AI travel agents still book bullfights; ethical prompts help

The authors introduce TAC (Travel Agent Compassion), an agentic benchmark that asks AI travel assistants to book trips without mentioning animal welfare. Across nine frontier models, most default to animal‑exploiting options, but inserting an ethical‑brand persona into the system prompt raises welfare selections from 32% to 80%. The benchmark now appears in the UK AI Security Institute’s Inspect Evals suite.

arxiv.org ↗2 min read at source

LLM‑Built Game Rules Can Fool Planners: Accuracy Isn’t Enough

Researchers show that code world models synthesized by LLMs can achieve near‑perfect transition accuracy yet still lose when used by a planner, because rare but pivotal dynamics are missed. They introduce “play‑adequacy” as a stricter test, arguing planning‑oriented models must be evaluated on actual play outcomes.

arxiv.org ↗2 min read at source

Policy & Safety

You’re caught up.

That was all 10 stories in the 18 July issue.