Stop bolting a chatbot onto everything
The chatbot has become the default face of AI, and the default is quietly costing you adoption. How to choose the right interface for an AI feature, with a worked example and a five-question check.
Every AI feature you ship comes with a failure rate, and your users will meet it. Most teams pour their effort into the demo: the moment the model gets it right and the room nods. The harder and more valuable design problem is the other moment, the one where the AI is wrong, unsure, or confidently making something up. For product, design, and growth teams in every industry, that moment is no longer a rare edge case. It is a routine part of the experience, and most teams leave it undesigned.
AI used to fail quietly, tucked behind an internal tool where a trained employee could catch the mistake before anyone outside saw it. That buffer is disappearing. Gartner predicts that 60 percent of brands will use agentic AI to deliver streamlined one-to-one interactions by 2028. The agent is moving to the front of the house, talking directly to the customer, with no analyst in between to intercept a bad answer.
And bad answers are not rare. In its 2025 AI Index, Stanford's Institute for Human-Centered AI reports that AI-related incidents are rising sharply, and that even leading models still fail to reliably solve logic tasks, in the report's words, "even when provably correct solutions exist, limiting their effectiveness in high-stakes settings where precision is critical," according to Stanford HAI. Put the two trends together: more customers will interact directly with a system that is wrong a meaningful share of the time. The only question is whether you designed for it.
A failure state is what your interface does when the AI cannot deliver a confident, correct result. Designing for AI failure states means treating that case as a first-class part of the product, not an error message bolted on at the end. The principle is baked into how trustworthy AI is defined. The U.S. National Institute of Standards and Technology lists the characteristics of trustworthy AI as valid and reliable, safe, secure and resilient, accountable and transparent, explainable and interpretable, privacy-enhanced, and fair, as published in the NIST AI Risk Management Framework. Resilient is the operative word. A trustworthy system is one designed to fail safely, not one assumed never to fail.
In practice, designing the failure state comes down to a few moves that travel across industries. Signal confidence, so a user can tell a sure answer from a shaky one before acting on it. Offer a graceful fallback, a useful next step when the AI cannot answer, rather than a dead end or an invented one. Make correction cheap, so catching and fixing a wrong output takes one click, not a support ticket. Provide a clear path to a human when the stakes are high. And never manufacture certainty: an honest "I am not sure, here is how to check" protects trust far better than a fluent guess.
Picture a fintech with an AI support agent on its billing page. A customer asks why they were charged a fee. The agent replies in a confident, well-written paragraph, and it is wrong: it cites a policy that changed last quarter. The demo never surfaced this, because the tester asked questions the model handled well. In production, the agent fields thousands of real questions, and on this one it fabricates a plausible answer with no signal that it might be off. The customer acts on it, escalates when reality does not match, and now distrusts every answer the agent gives.
Designed for failure, the same interaction looks different. The agent surfaces the source it is drawing from so the claim is checkable, flags that fee disputes are sensitive, and offers a one-tap handoff to a human. When its confidence is low, it says so plainly instead of dressing up a guess. The model did not get smarter. The experience around it got honest. Swap the fintech for a health platform answering a dosage question, a retailer's agent promising a delivery date, or a law firm's assistant summarizing a contract, and the lesson holds: the damage is rarely the wrong answer alone. It is a wrong answer delivered with unearned confidence and no way to catch it.
Teams tend to treat error handling as cleanup. With AI, the recovery path is a core part of the product, because failure is frequent and visible. It is the same discipline we describe in designing the approval step: the interface earns the right to act by keeping its reasoning legible and correction one click away. It is also what separates an AI feature that demos well from one that survives in production, the gap we unpack in moving an AI pilot to production. Design the moment it fails, and you protect every moment it succeeds.
Before you ship your next AI feature, run your team through these five questions. We use them as a practical lens at Aero, not an industry standard, and they surface the gaps fast.
If any answer is uncomfortable, the gap is in how you designed the failure, not in how capable the model is.
It is what your product does when the AI cannot produce a confident, correct result: a low-confidence answer, a refusal, a fallback, or a handoff. Designing it well means deciding in advance how the interface behaves in those cases, instead of letting the model improvise.
Because better models still fail, just less obviously, and they are now placed in front of customers where mistakes are visible and costly. Stanford's 2025 AI Index notes that incidents are rising and that even strong models remain unreliable on high-stakes precision tasks. Improvement narrows the failure rate, it does not remove it.
Yes. Any product where AI produces an answer or takes an action a person depends on has failure states, from finance and healthcare to SaaS, commerce, media, and professional services. The question changes, the need to design the failure does not.
Start by writing down the three questions your AI feature handles worst, then ask what your product does when it gets them wrong in front of a real user. Aero Interactive helps product teams design the failure states that make AI features trustworthy enough to depend on. Reach out to start the conversation.