Design for Resiliency: B2B marketing should not stop if your AI is Down
This morning, I was in the middle of a project to build an internal marketing application. I was using Claude Code to make some updates to a database query, when I started seeing API errors on my console. I tried a few things..but Claude Code was not responding. I checked on their website and saw the error message above.
At the time, it was not a big deal, just a temporary disruption and I had plenty of other things to work on. But it was a reminder that the services we use and come to rely on might not always be available. Given the complexity of LLMS, the massive load they need to handle, and the issue that they have been and will alwasy be a target for all types of denial of service attacks, it is inevitable.
Graceful Error Handling
Design your marketing stack so that every call to an outside service expects to get an error, and to do something reasonable.