From pilot to impact: why AI projects fail on adoption
98 percent of companies are at least experimenting with AI, but only 4 percent generate substantial value from it (BCG, 2024). The reason is rarely the technology. Pilots stall because future users are involved too late, because usage is not measured and because nobody anchors the new way of working. Scaling is roughly 20 percent technology and 80 percent culture.
The pattern: lots of activity, little impact
According to a BCG survey of 1,000 executives in 59 countries, 98 percent of companies are at least experimenting with AI. Only 4 percent generate substantial value from it, a further 22 percent see first impact, and 74 percent have yet to see tangible value.
Our project experience matches this. The technology usually works. What is missing is the step from a working prototype to a tool that people use voluntarily in their daily work.
A tool that is built but not used is a lost investment.
Why adoption determines impact
In our playbook “Growth through AI” we sum it up in a simple equation: Value = Strategy × Execution × Adoption. If any factor is zero, the value is zero. A technically perfect pilot without users creates no impact at all.
Add to this a tension many executive teams underestimate: leadership fears missing out, employees fear being replaced. As long as this gap is not addressed openly, every rollout will be a struggle.
Three typical traps
1. Users join only at the end. A team builds a solution for technicians at the machines. After launch, usage spikes in the first week and then drops to zero. The reason: the technicians wear gloves and cannot type on the tablet. Voice control would have solved the problem if someone had asked the users early on.
2. Usage is not measured. Many pilots are judged on whether they run technically. Whether they are used and whether the business metric moves remains open. That makes a clean decision to scale or stop impossible.
3. Rollout is ordered rather than won. Experienced specialists trust their own judgement more than a machine, often rightly so. Ordering a rollout creates resistance. Winning experienced employees as co-designers builds trust.
What successful companies do differently
The sites in the World Economic Forum’s Global Lighthouse Network show how it is done. They do not scale AI as a technology project; they combine technology, people and execution discipline. Their results reflect it: on average 40 percent higher labour productivity and 48 percent shorter lead times.
For SMEs, five principles follow:
- Involve users from day one. Interviews and observation at the workplace belong in the concept phase, not the test phase.
- Make adoption measurable up front. Besides the business metric, define usage: daily users, share of the workflow completed with the tool.
- Champions instead of orders. A few convinced employees per area show their colleagues the benefit. Demand is created in the team, not in IT.
- Tell the right story. Not “we are introducing a new tool”, but “we are taking the most boring 20 percent of your work off your hands”.
- Set a clear decision point. Before scaling you need evidence: impact achieved, security checked, rollout plan in place. Otherwise adjust or stop.
A simple test for your next initiative
Before you start, ask three questions: Who will use the tool every day, and was that person involved in designing it? How will we know in eight weeks whether it is being used? Who decides, on which date, whether to scale or stop? If any of these is open, the pilot is not ready to start.
Sources
- BCG: Where’s the Value in AI?, October 2024 (survey of 1,000 CxOs and senior executives in 59 countries)
- McKinsey / World Economic Forum: Global Lighthouse Network, 2025
- AI4Leaders: Growth through AI, The Executive Playbook, January 2026
Frequently asked questions
How do I recognise a pilot stuck in purgatory?
It has been running for months, has no fixed decision date and is measured on activity rather than impact. Often nobody knows how many employees really use it every day.
Which metrics show real adoption?
Daily users relative to the target group, the share of a workflow actually completed with the tool, and the change in the business metric the pilot was started for.
When should we stop a pilot?
When it misses the success criteria agreed in advance by the agreed date. An early stop is not a failure; it saves budget for better initiatives.
How do you get your pilots into daily work?
Polaris guides your team through every stage in a structured way, from pilot design to scale, with senior partners at the decisive points.
Explore PolarisThis article belongs to Step 3: Implementation, testing, scaling. How do we get from pilot to impact?


