LLM agents recover indirect-call targets in compiled programs with 23% to 81% success
ICALL-BENCH tests whether models can follow how functions call each other inside compiled binaries, using the targets of indirect calls as the probe. It covers 50 real C/C++ programs averaging 74,746 lines of code and 941 functions each. Across five recent LLMs and their agents, program-level success ranged from 23% to 81%, and giving agents tools or internet access did not consistently help on the hardest cases.