--- date: "2025-05-21T10:46:00Z" categories: - linkedin - llms description: "Inference latency has become the new compilation wait, creating an awkward five-to-ten-minute interruption window that is too long to ignore and too short to use well." keywords: [LLM latency, inference, developer workflow, waiting time, productivity, Claude] --- "Inferencing" is the new "Compiling!" I spent a fair bit of today playing Bubble Shooter because Claude spent 10 minutes writing code for an npm package: https://www.npmjs.com/package/saveform and for a bunch of other things. 5-10 minutes is too short a time to do something meaningful. I do wish these LLMs would take less or more time. We're right now in the zone of bad interruption timing. ![](https://files.s-anand.net/images/2025-05-21-inferencing-is-the-new-compiling-linkedin.jpg) [LinkedIn](https://www.linkedin.com/feed/update/urn%3Ali%3Ashare%3A7330906705276424192)