The model I work with is 100 times smaller than yours, and my AI agent still works great
On August 31, 2026 Yehuda Neumann writes in Geektime that he runs a local coding agent on Qwen2.5-Coder-32B on a single A100, with a 131 thousand token window. Analyzing a repo required 633 thousand tokens, and other repos required 287 thousand and 513 thousand. Compressing files into a skeleton and a summary was not enough. His conclusion: the ceiling is architectural, not model size, and the next model will not save an agent that swallows the entire repo into context.
Otomatzia editorial · Published
Source published: · Geektime
