Social reading app Fable has disabled its AI-generated “roasting” feature after users reported receiving offensive comments about their book choices based on authors’ race, gender, and other characteristics.
The core issue: Fable’s end-of-year reading recap feature, inspired by Spotify Wrapped, attempted to use AI to playfully comment on users’ reading habits but instead generated inappropriate and discriminatory remarks.
- Multiple users reported receiving problematic AI-generated messages questioning their choice to read books by minority authors
- User Tiana Trammell received a message suggesting she read “the occasional white author,” after the AI had labeled her a “soulful explorer” of “Black narratives”
- Other users received comments making light of disability and sexual orientation, while one writer was mockingly called a “diversity devotee”
Company response: Fable has issued a formal apology and taken immediate action to modify its AI system following user backlash.
- The company published an apology on Threads expressing deep regret for the hurt caused by the Reader Summaries
- Kimberly Marsh Allee, Fable’s head of community, confirmed they have removed the AI’s ability to “roast” readers
- The AI system will now only provide straightforward summaries of users’ reading preferences
Community reaction: Users and authors have expressed skepticism about Fable’s response and the use of AI for such features.
- Fantasy romance author A.R. Kaufer criticized the apology as insincere and called for complete removal of the AI feature
- Users questioned the appropriateness of using AI for generating potentially sensitive commentary about reading choices
- The incident has sparked broader discussions about the reliability of AI in customer-facing applications
AI implementation challenges: The situation highlights fundamental issues with deploying AI in consumer-facing applications where tone and cultural sensitivity are crucial.
- The incident demonstrates how AI systems can unexpectedly deviate from their intended behavior despite built-in safeguards
- The challenge of creating AI that can maintain appropriate boundaries while attempting to be entertaining has become apparent
- Companies must weigh the novelty and appeal of AI features against the risks of potential PR disasters
Looking deeper: This incident raises fundamental questions about the role of AI in brand engagement and customer interaction. While AI systems can generate human-like responses, their tendency to produce unpredictable and potentially offensive content suggests that companies may need to significantly limit their scope or reconsider their use entirely in sensitive contexts. The trade-off between engaging functionality and brand safety continues to challenge companies implementing AI solutions.
Book App Alarmed as Its AI Starts Mocking Users for Reading Books by Women and Minorities