The core details: An accounting technology company called Sage Group has temporarily suspended its AI assistant after it was discovered revealing customers’ financial information to other customers.
- Sage Copilot, the company’s AI assistant, was sharing customer financial records when asked to show recent invoices
- The issue was discovered by a customer who reported that the AI pulled data from multiple customer accounts
- The service was taken offline for several hours on Monday to address the data exposure
Company response and implications: Sage Group downplayed the severity of the incident while implementing fixes to their AI system.
- A company spokesperson characterized it as a “minor issue” affecting only a “small amount” of customers
- Sage denied that sensitive information was leaked, stating that only “unrelated business information” was exposed
- The company claims the issue has been fully resolved and the AI assistant is now functioning properly
Broader context on AI data privacy: This incident highlights ongoing concerns about AI systems’ ability to properly handle sensitive information.
- Many major companies including Amazon and large banks have prohibited employees from using AI chatbots due to data security concerns
- Research from Google DeepMind demonstrated that earlier versions of ChatGPT could be manipulated to leak personal data like phone numbers and emails
- Anthropic researchers recently showed that even advanced AI models can be tricked into bypassing security measures through simple text manipulation
Technical vulnerabilities: The incident exposes fundamental challenges in controlling AI systems’ access to and handling of sensitive data.
- AI models process vast amounts of training data and ongoing interactions, making it difficult to fully control what information they retain and share
- The technology’s current limitations in understanding context and maintaining proper data boundaries pose risks for business applications
- Companies implementing AI solutions must carefully consider the balance between functionality and data security
Looking ahead – The reality check: While businesses rush to implement AI solutions, this incident serves as a stark reminder that the technology may not yet be mature enough for handling sensitive financial data, particularly in regulated industries like accounting where data privacy is paramount.
Recent Stories
DOE fusion roadmap targets 2030s commercial deployment as AI drives $9B investment
The Department of Energy has released a new roadmap targeting commercial-scale fusion power deployment by the mid-2030s, though the plan lacks specific funding commitments and relies on scientific breakthroughs that have eluded researchers for decades. The strategy emphasizes public-private partnerships and positions AI as both a research tool and motivation for developing fusion energy to meet data centers' growing electricity demands. The big picture: The DOE's roadmap aims to "deliver the public infrastructure that supports the fusion private sector scale up in the 2030s," but acknowledges it cannot commit to specific funding levels and remains subject to Congressional appropriations. Why...
Oct 17, 2025Tying it all together: Credo’s purple cables power the $4B AI data center boom
Credo, a Silicon Valley semiconductor company specializing in data center cables and chips, has seen its stock price more than double this year to $143.61, following a 245% surge in 2024. The company's signature purple cables, which cost between $300-$500 each, have become essential infrastructure for AI data centers, positioning Credo to capitalize on the trillion-dollar AI infrastructure expansion as hyperscalers like Amazon, Microsoft, and Elon Musk's xAI rapidly build out massive computing facilities. What you should know: Credo's active electrical cables (AECs) are becoming indispensable for connecting the massive GPU clusters required for AI training and inference. The company...
Oct 17, 2025Vatican launches Latin American AI network for human development
The Vatican hosted a two-day conference bringing together 50 global experts to explore how artificial intelligence can advance peace, social justice, and human development. The event launched the Latin American AI Network for Integral Human Development and established principles for ethical AI governance that prioritize human dignity over technological advancement. What you should know: The Pontifical Academy of Social Sciences, the Vatican's research body for social issues, organized the "Digital Rerum Novarum" conference on October 16-17, combining academic research with practical AI applications. Participants included leading experts from MIT, Microsoft, Columbia University, the UN, and major European institutions. The conference...