Restricted LLM APIs Still Leak Model Size and Depth
Researchers demonstrate that even with today’s restrictive LLM APIs—exposing only single-token logits—one can still infer key architectural traits like hidden dimension, depth, and parameter count. Their NightVision attack recovers these specs within 23% error on 32 open-source models, exposing a privacy gap for commercial providers.