×
LLM performance is plateauing, causing some experts to believe AI crash is imminent
Written by
Published on
Join our daily newsletter for breaking news, product launches and deals, research breakdowns, and other industry-leading AI coverage
Join Now

The artificial intelligence industry faces a critical inflection point as major tech companies encounter significant technical limitations in scaling their large language models (LLMs).

Core challenge: Large language models are hitting a technological plateau, with diminishing returns from traditional scaling approaches that involve adding more parameters, training data, and computing power.

  • OpenAI’s upcoming Orion model shows minimal improvements over GPT-4, particularly in key areas like coding capabilities
  • Former OpenAI chief science officer Ilya Sutskever confirms that performance gains from scaling up AI models have plateaued
  • The industry’s long-held belief that “bigger is better” for AI models is being seriously questioned

Economic implications: The technological slowdown threatens the financial viability of major AI companies and could trigger an industry-wide market correction.

  • Training costs for large models can reach tens of millions of dollars and require hundreds of AI chips
  • Companies have exhausted freely available training data from the internet
  • AI expert Gary Marcus warns that LLMs will become commoditized, leading to price wars and challenging profitability
  • Current sky-high valuations of companies like OpenAI and Microsoft are based on assumptions about continued AI advancement through scaling

Technical alternatives: Companies are exploring new approaches to overcome the scaling limitations.

  • OpenAI researchers are developing “test-time compute” techniques that allow AI models to explore multiple solutions before selecting the most promising one
  • Efforts are underway to create AI systems that can “think” or “reason” more like humans
  • These alternative approaches are being tested in models like OpenAI’s o1

Market outlook: The combination of high operating costs, diminishing technical returns, and market expectations creates significant pressure for innovation.

  • The industry faces an urgent need to demonstrate progress through alternative technical approaches
  • Economic markets may not remain patient if significant improvements aren’t achieved quickly
  • The situation could potentially trigger another “AI winter” – a period of reduced funding and interest in AI development

Critical perspective: While these challenges don’t spell the end of AI development, they suggest that the industry’s current trajectory and business models may need fundamental reassessment. The coming months will likely determine whether companies can find viable technical alternatives to overcome the scaling plateau, or if a significant market correction becomes inevitable.

AI Expert Warns Crash Is Imminent As AI Improvements Hit Brick Wall

Recent News

Google launches AI travel tools that analyze screenshots and plan your trips

Google's new AI travel features scan personal screenshots to build itineraries and track hotel prices, with on-device processing to maintain user privacy.

Showing initiative: Agentic AI reasoning shifts systems from reactive tools to proactive decision-makers

Agentic AI transforms systems from passive tools into autonomous problem solvers that can formulate goals and adapt strategies without constant human guidance.

India’s AI regulation for securities markets falls short, putting retail investors at risk

India's securities regulator shifts AI accountability to market participants without addressing fundamental risks in a derivatives market where retail investors lost Rs 1.8 trillion over three years.