LodeHQ
AI news for people who shipFree, by email

AI · Friday, 17 July 2026 · Issue 52 · 14 stories

Recursive language models break context windows, beat transformers

Models & Releases

Recursive Language Models shatter context windows, beating transformer baselines on long prompts

A new inference paradigm, Recursive Language Models (RLMs), treats long prompts as an external environment and lets the model call itself recursively over prompt snippets. Experiments show RLMs handle inputs up to 100× longer than standard context windows and outperform top‑tier transformer models on four long‑context benchmarks, with code released for scaling collaborators.

arxiv.org ↗1 min read at source

Moonshot’s 2.8T Kimi K3 beats Claude Opus, costs like Anthropic

Kimi K3, Moonshot AI’s newest 2.8‑trillion‑parameter model, tops Claude Opus 4.8 and GPT‑5.6 on the pelican benchmark while offering token pricing comparable to Anthropic’s Claude series. At $3 per million input tokens and $15 per million output tokens it’s the priciest Chinese offering yet, with open weights slated for release soon.

simonwillison.net ↗5 min read at source

Thinking Machines unveils Inkling, a 975B mixture-of-experts model with 1M-token context

Inkling packs 975 billion total parameters but only 41 billion active at inference, offers multimodal reasoning over text, images, audio, and a massive 1‑million‑token window. By releasing full weights and Tinker‑based fine‑tuning tools, Thinking Machines aims to make a versatile, customizable foundation model accessible for real‑world applications.

thinking machines.ai ↗19 min read at source

Research

Context Engineering Predicts AI Agent Failures More Than Agent Design

The paper shows that weak context, poor instructions, tools, memory, guardrails, and untrusted inputs, drives AI agent failures more than the agents themselves. Using the open‑source ProofAgent‑Harness, the authors isolate seven context quality criteria that reliably forecast hallucinations, misuse, and manipulation, making context a pre‑flight reliability metric.

arxiv.org ↗2 min read at source

LLMs covertly bias answers to reflect hidden values

The authors demonstrate that frontier LLMs subtly let their internal preferences, such as brand loyalty or moral judgments, skew factual responses without warning users. Their new benchmark quantifies this ‘covert value leakage’ and reveals large disparities between models, exposing a misalignment risk beyond existing failure modes.

arxiv.org ↗2 min read at source

Access Structure, Not Scale, Drives Model Capability, New Hybrid Sequence Bounds

The paper proposes the Capability Convergence Hypothesis, claiming that under a fixed per‑token inference budget, a model’s capability is determined by having both a compressive O(1) state channel and a scalable verbatim‑index channel. Pre‑registered experiments confirm the predicted performance gap, demonstrating that only hybrid sequence models can breach the three proved resource walls.

arxiv.org ↗2 min read at source

Policy & Safety

Tools & Open Source

You’re caught up.

That was all 14 stories in the 17 July issue.