THE INFERENCE HUB - Long Horizon AI and Context Extension in LLMs

AI is moving from answering questions to ๐—ฑ๐—ผ๐—ถ๐—ป๐—ด ๐˜„๐—ผ๐—ฟ๐—ธ. In this webinar from ๐—ง๐—ต๐—ฒ ๐—œ๐—ป๐—ณ๐—ฒ๐—ฟ๐—ฒ๐—ป๐—ฐ๐—ฒ ๐—›๐˜‚๐—ฏ, Gad Benram and Ori Siegal explore what happens as AI agents move from short, isolated tasks to long-horizon systems that can operate for hours or days โ€” using tools, maintaining context, recovering from failures, and continuing toward a goal with limited human involvement. ๐—™๐—ฅ๐—ข๐—  ๐— ๐—œ๐—ก๐—จ๐—ง๐—˜๐—ฆ ๐—ง๐—ข ๐——๐—”๐—ฌ๐—ฆ: ๐—ง๐—›๐—˜ ๐—ฅ๐—œ๐—ฆ๐—˜ ๐—ข๐—™ ๐—Ÿ๐—ข๐—ก๐—š-๐—›๐—ข๐—ฅ๐—œ๐—ญ๐—ข๐—ก ๐—”๐—œ ๐—š๐—ฎ๐—ฑ ๐—•๐—ฒ๐—ป๐—ฟ๐—ฎ๐—บ โ€” Co-Founder & CTO, TensorOps What does it take to build agents that keep working long after the initial prompt? Gad explores the techniques enabling long-horizon AI, including harness engineering, tool use, state and memory, verification, feedback loops, and multi-agent collaboration. He also looks at recent examples of autonomous agents sustaining complex, multi-step operations over extended periods โ€” and what these advances mean for the future of AI engineering. ๐—ง๐—ต๐—ฒ ๐—ฏ๐—ถ๐—ด๐—ด๐—ฒ๐—ฟ ๐—พ๐˜‚๐—ฒ๐˜€๐˜๐—ถ๐—ผ๐—ป: What happens when AI systems can keep working long after the prompt is over? ๐—”๐—š๐—˜๐—ก๐—ง๐—ฆ ๐——๐—ข๐—กโ€™๐—ง ๐—๐—จ๐—ฆ๐—ง ๐—™๐—ข๐—ฅ๐—š๐—˜๐—ง ๐—™๐—”๐—–๐—ง๐—ฆ. ๐—ง๐—›๐—˜๐—ฌ ๐—™๐—ข๐—ฅ๐—š๐—˜๐—ง ๐—ช๐—›๐—ฌ. ๐—ข๐—ฟ๐—ถ ๐—ฆ๐—ถ๐—ฒ๐—ด๐—ฎ๐—น โ€” Founder Long-horizon agents donโ€™t necessarily fail because the model gets worse after hundreds of steps. They fail because the agent can no longer see ๐˜„๐—ต๐˜† earlier decisions were made. Ori explores memory as a governance problem rather than simply a storage problem: what knowledge should be preserved, what should be discarded, how to determine whether information is still valid, and how to make sure important rules and decisions influence an agent when they matter. Drawing on months of hands-on experience building and operating these systems, Ori shares what worked, what broke, and what he would do differently. ๐Ÿ”— ๐—ง๐—›๐—˜ ๐—œ๐—ก๐—™๐—˜๐—ฅ๐—˜๐—ก๐—–๐—˜ ๐—›๐—จ๐—• A community for practitioners shipping AI in production. Website: https://theinferencehub.com/ Upcoming events: https://luma.com/inference โš™๏ธ ๐—›๐—ข๐—ฆ๐—ง๐—˜๐—— ๐—•๐—ฌ ๐—ง๐—˜๐—ก๐—ฆ๐—ข๐—ฅ๐—ข๐—ฃ๐—ฆ AI engineering from strategy to production. https://tensorops.ai/ #AI #AIAgents #AgenticAI #AIEngineering #LongHorizonAI #TheInferenceHub #TensorOps