Why do AI pilots fail to scale? Four failure modes, with numbers
AI pilots die in four distinct ways, none of them a model-quality problem. The RAND and S&P figures, the MIT caveat, and what to check before you spend.
By Carl Chessum
AI pilots fail to scale for four distinct reasons, and it is worth separating them, because the fix for each one is different. RAND’s analysis of enterprise AI projects found 80.3% fail to deliver promised business value, split as 33.8% abandoned before reaching production, 28.4% reaching production but failing to deliver expected value, and 18.1% running but never recovering their investment. The fourth mode is the one nobody counts: the pilot that worked, delivered, repaid its cost, and then sat in one department for eighteen months because nothing in the organisation knew how to take it anywhere else.
None of those four is a model-quality failure. The model did its job in most of them. What killed the pilot was data nobody could vouch for, a process nobody had written down, an owner nobody had named, or a finance function that could not tell you whether the thing had paid for itself. Those are organisational conditions, and you can measure them before you spend anything. That is the entire argument of this piece, and the rest of it is evidence.
The 95% figure everyone quotes, and why I have stopped using it
You have seen the number. MIT’s report put the generative AI pilot failure rate at 95%, and it has been repeated in every vendor deck since. It is probably directionally right. It is also preliminary, not peer-reviewed, built on self-reported data, and used a success window of roughly six months, which is short enough that a perfectly healthy enterprise project would be scored as a failure for the crime of not finishing yet.
I am not interested in defending AI vendors. I am interested in you not getting caught out in a board meeting when someone with a finance background asks where the number came from. If you are going to stand up in front of your board and make the case for slowing down, stand on something that survives a follow-up question.
Use RAND’s 80.3% instead. Use S&P Global’s finding that 42% of companies abandoned most of their AI initiatives in 2025, up from 17% a year earlier. That second number is the more alarming of the two, because it is a rate of change. Abandonment roughly two and a half times in twelve months. Use Deloitte’s survey of 3,000 director-to-C-suite leaders across 24 countries, which found 74% of organisations want AI to grow revenue and only 20% have seen it happen. Four different research groups, four different methods, same shape.
Mode one: abandoned before it ever reached production
A third of projects, 33.8% in RAND’s data, never make it out of the pilot environment at all. Somebody builds something, it demos well, and then it stops.
In nearly every case I have watched, the thing that stopped it was data. The demo ran on a clean extract that someone prepared by hand. Production would have to run on the real thing, and the real thing turns out to be three systems that do not agree on what a customer is.
Here is the test. One of the questions in our own audit asks it straight: if you needed a clean accurate list of your best 500 customers right now, how confident are you in what you would get? Not in a month. Right now. If the honest answer involves someone exporting from the CRM, exporting from the finance system, and reconciling the two in Excel, your pilot will die here and the post-mortem will blame the vendor.
The cheapest version of this check is to count spreadsheets. Ask how many manual exports and imports sit between your two most important systems. Every one of them is a join your pilot will have to make in production, and dirty data is the cheapest AI mistake a small business can fix first precisely because you can fix it without buying anything.
Mode two: shipped, running, delivering nothing
28.4% of projects reach production and then fail to deliver the value they were sold on. This is the most expensive failure mode, because you are now paying to run something that is not earning.
The usual cause is process, not technology. You automated a task inside a process nobody had standardised. Three people were doing it three different ways, all of them defensible, and the automation picked one of the three. Now two thirds of the team work around it.
Try this today, and it costs you nothing. Give the same routine task to three different people in the business and compare how they approach it. If the three approaches diverge meaningfully, you have found the reason a pilot built on one of those approaches will not generalise. The audit asks the same thing a different way: how many of your core business processes are documented well enough that a new team member could follow them without asking anyone?
Undocumented process is not an AI problem. It becomes an AI problem the moment you try to automate it, because automation requires you to commit to one version of how the work is done, and a business that has never made that commitment will fight the choice.
Mode three: running, never repays what it cost
18.1% of projects run in production and never recover their investment. Note what that means. It works. People use it. It just does not clear the bar.
This is where the finance function matters more than the technology function, and where the numbers get uncomfortable. BCG found only 45% of surveyed finance executives could quantify the return from their AI investments, with a median reported ROI of 10% against a 20% target. Read both halves. More than half of finance leaders cannot put a number on it at all. Of those who can, the number is half of what was promised.
So at least some of mode three is not a failure to produce value. It is a failure to measure it, which from the board’s point of view is the same thing. If you cannot evidence the return, the project gets cut in the next budget round regardless of what it was actually doing. I have written separately on how to prove AI ROI to your board, and the short version is that the baseline has to be captured before the pilot starts, because nobody can reconstruct it afterwards.
The pressure here is not imaginary. Dataiku’s Harris Poll of 900 CEOs found 62% report their boards are actively applying pressure to deliver measurable AI-driven outcomes. Sixty-two percent of boards demanding measurement. Forty-five percent of finance functions able to supply it. That gap is where mode three lives.
Mode four: it worked, and it stayed exactly where it was
This one is not in the RAND categories, because RAND was counting failures and this is a success. It is still a scaling failure, and it is the most common outcome I see in businesses between 200 and 2,000 people.
The pilot ran in one team. It worked. The team that built it understands it, maintains it, and quietly becomes the only part of the business that can operate it. Nobody wrote down how to repeat the exercise. Nobody owns the question of where it goes next. Eighteen months later it is still one department’s clever thing.
The tell is ownership, and ownership is the least resolved problem in this entire category. Grant Thornton’s 2026 AI Impact Survey found 78% of business executives lack strong confidence that they could pass an independent AI governance audit within 90 days. The same research describes COOs discovering governance gaps that CFOs are not funding and that CIOs and CTOs are not surfacing. Three executives, three partial views, no single owner.
Ask the question directly at your next leadership meeting. If an AI system in this business caused a compliance failure tomorrow, who gets named? If the room looks at each other, that is your finding, and it is also the reason mode four happens. Scaling requires somebody whose job it is to scale things. Not a committee. A name. Whether that name needs a formal title is a separate argument, and I have set out the options for who should own AI in a mid-size company elsewhere.
The counterweight in the Grant Thornton data is worth holding onto: organisations with fully integrated AI are nearly four times more likely to report revenue growth than those still piloting, 58% against 15%. The gap between piloting and integrating is not a technical gap. It is an ownership gap.
What the four modes have in common
Data. Process. People. Ownership. Not one of the four failures above was caused by the model being insufficiently clever.
This is why I am sceptical of the strategy documents that circulate in response to these numbers. A 2026 enterprise adoption survey found 75% of executives admit their company’s AI strategy is more for show than actual internal guidance, with 48% calling adoption a massive disappointment. A strategy written to answer the board is not a strategy. It is a deliverable. And it will not stop any of the four failure modes, because none of them is caused by an absence of strategy documents.
What stops them is knowing, before you commit budget, which of the four you are currently set up to walk into. A business with no named data owner is going to hit mode one. A business where three people do the same task three ways is going to hit mode two. A business whose finance function has never baselined a process is going to hit mode three. A business where nobody can answer the compliance question is going to hit mode four.
That is a diagnosis, and it is a cheap one to run. Our free AI readiness audit is 30 questions across six pillars, Data, Process, People, Technology, Strategy and Governance, and it takes 7 minutes. You get a score out of 120 and a band for each pillar, so you can see which of the four modes your organisation is currently most exposed to. It is self-reported, which means it is only as honest as you are. Answer it the way you would answer your auditor, not the way you would answer an investor.
The question is not whether your next pilot will use a good enough model. It will. The question is whether the business underneath it can carry the result anywhere.