×
When is the right time to discontinue an AI project?
Written by
Published on
Join our daily newsletter for breaking news, product launches and deals, research breakdowns, and other industry-leading AI coverage
Join Now

AI project lifecycle management: The art of knowing when to fold: Organizations investing in AI pilots face a critical challenge in determining the optimal time to discontinue underperforming projects, balancing the potential for future benefits against the risk of wasting resources.

  • Forrester advises against seeking immediate AI ROI, cautioning that premature termination may lead to missed opportunities.
  • AI investments can be substantial, with retrieval-augmented generation (RAG) document search projects costing up to $1 million to deploy and $11,000 per user annually.
  • Custom-built large language models (LLMs) for specialized industries like healthcare or finance can require investments of up to $20 million.

AI project success rates: A shifting landscape: The success rate of AI pilot projects is improving, but a significant number still fail to reach production.

  • Gartner reports that in 2022, nearly 50% of AI pilot projects failed to reach production.
  • Projections for next year suggest a decrease in failure rates to around 30%.
  • Despite the improvement, the 30% failure rate represents a substantial waste of resources, given the widespread adoption of AI across industries.
  • An EY survey from July revealed that 95% of senior executives reported their organizations were actively investing in AI.

Key strategies for AI project evaluation: IT leaders can implement several approaches to ensure they retain valuable AI projects and discard those that fail to deliver.

  • Define clear metrics for success beyond ROI, including specific KPIs such as improving customer satisfaction or reducing time spent on routine tasks.
  • Establish predetermined checkpoints to assess progress towards goals and make informed decisions about project continuation.
  • Tie AI projects to specific business needs and pain points to increase the likelihood of adoption and success.
  • Consider setting limited timeframes for initial project evaluation, with some experts suggesting decisions can be made within as little as two business days.
  • Remain flexible in goal-setting, recognizing that initial objectives may need adjustment as the project evolves.

Challenges in measuring AI project success: Evaluating the impact of AI initiatives can be complex, requiring a nuanced approach to measurement.

  • Some metrics, like customer sentiment, may be relatively straightforward to assess.
  • Other benefits, such as time saved by employees using AI-powered tools, can be more difficult to quantify accurately.
  • Organizations risk prematurely terminating projects if they fail to account for less tangible but significant improvements in efficiency and productivity.

The importance of business alignment: Successful AI projects require close collaboration between IT teams and business stakeholders from the outset.

  • Projects developed in isolation from business needs are more likely to face adoption challenges and eventual abandonment.
  • Connecting AI initiatives to specific business goals can increase employee buy-in and provide valuable insights into the technology’s potential applications.
  • Encouraging experimentation within the context of business-aligned projects can lead to unexpected discoveries and innovations.

Mitigating risks and learning from failures: Organizations can implement strategies to limit potential losses and extract value even from unsuccessful projects.

  • Consider shorter pilot periods to avoid the sunk cost fallacy associated with longer-term projects.
  • Recognize that some failed projects may yield valuable insights or technologies that can be applied to future initiatives.
  • Instead of completely abandoning projects, consider putting them on hold, as rapid advancements in AI may make previously unviable projects feasible in the future.

Balancing innovation and pragmatism: The decision to continue or terminate an AI project requires a delicate balance between fostering innovation and maintaining fiscal responsibility.

  • While it’s essential to allow for experimentation and potential breakthroughs, organizations must also be prepared to make tough decisions about resource allocation.
  • Regular assessments of project viability, combined with a willingness to pivot or discontinue initiatives when necessary, can help organizations maximize the value of their AI investments.
  • Ultimately, successful AI adoption requires a culture that embraces both innovation and pragmatic decision-making, ensuring that resources are directed towards projects with the greatest potential for business impact.
When is the right time to dump an AI project?

Recent News

AI language models explained: How ChatGPT generates responses

The sophisticated prediction mechanism behind ChatGPT processes text token by token, revealing both the power and limitations of AI's pattern-matching approach to language.

AI’s impact on jobs sparks concern from Rep. Amodei

AI industry insider warns that automation could displace 10-20% of jobs, challenging the more optimistic view that workers will simply adapt to new roles.

TikTokers pose as AI creations in viral Veo 3 trend

Real people are deliberately adopting the aesthetic quirks of AI-generated videos to gain viewers, blurring the boundaries between authentic and synthetic content.