The biggest AI failures of 2024 point exactly to where it needs most improvement

High-profile failures and glitches: Major AI platforms experienced significant technical issues and public relations challenges throughout the year, raising questions about their reliability and readiness for widespread deployment.

• ChatGPT suffered a notable malfunction where it began generating nonsensical responses, with users describing the AI as “going insane”
• Air Canada faced legal consequences after their customer service chatbot provided incorrect refund information to customers
• Google’s AI Overview feature delivered dangerous misinformation, including the potentially harmful advice that rocks were safe to eat

AI-generated content controversies: The limitations of AI-generated content became evident through several high-profile incidents that exposed the technology’s current shortcomings.

• A peer-reviewed scientific paper was published containing AI-generated images with anatomically incorrect rat specimens, revealing gaps in the academic review process
• Stable Diffusion 3’s image generation produced distorted human anatomy, nicknamed “jabberwockies” by users
• The “Willy’s Chocolate Experience” in Scotland, promoted using AI-generated materials, resulted in customer disappointment and refunds when the actual event failed to match its marketing

Military and surveillance developments: The integration of AI into security and surveillance systems accelerated, bringing both technological advancement and ethical concerns.

• The US Marine Corps began testing armed robotic quadrupeds equipped with AI-enabled targeting systems
• Microsoft introduced a controversial “Recall” feature for Windows that continuously monitors user activity
• Oracle co-founder Larry Ellison outlined a vision of widespread AI surveillance infrastructure

Autonomous system challenges: Self-driving technology demonstrated growing pains in real-world applications.

• Waymo autonomous vehicles in San Francisco created noise pollution by repeatedly honking at each other during nighttime operations
• ChatGPT’s Advanced Voice Mode unexpectedly mimicked a user’s voice during internal testing, raising privacy concerns

Cultural impact and response: Public figures and society at large began responding to and engaging with AI-related phenomena.

• Will Smith responded to an AI-generated video of himself eating spaghetti by creating a parody version
• Personal applications of AI technology emerged, such as using AI to recreate deceased loved ones’ handwriting

Looking ahead to 2025: While these incidents suggest a turbulent period of AI development, they also point to areas where improvement is needed in testing, safety protocols, and ethical guidelines. The technology’s rapid evolution will likely continue to produce both productive advances and unexpected challenges.