News/Deepfakes
AI Misuse Prompts Actress to Abandon Twitter
AI-generated explicit content prompts actress to quit Twitter: Jenna Ortega, known for her roles in popular TV shows and films, revealed her decision to leave Twitter after encountering AI-generated explicit images of herself as a teenager. Ortega expressed her strong dislike for AI, particularly its misuse in creating inappropriate content involving minors The actress acknowledged AI's potential for positive applications, such as early breast cancer detection, but emphasized the need to limit its use to beneficial purposes Ortega's experience highlights the growing concern over the ethical implications of AI-generated content and its impact on public figures, especially young actors Early...
read Aug 27, 2024AI-Generated Child Porn Case Shocks Military
AI-enabled child exploitation case shocks military community: A U.S. Army soldier stationed in Alaska has been arrested for allegedly using artificial intelligence to generate and distribute child sexual abuse material, marking a disturbing escalation in the misuse of AI technology. Key details of the case: Seth Herrera, a 34-year-old soldier at Joint Base Elmendorf-Richardson, faces multiple charges related to the transportation, receipt, and possession of child pornography, including AI-generated content. Herrera allegedly used online AI chatbots to create realistic child sexual abuse materials (CSAM) depicting minors known to him. He is also accused of possessing thousands of images showing violent...
read Aug 26, 202420% of Americans Now Believe Machines are Conscious
The rise of AI and public perception: Rapid advancements in large language models like ChatGPT have sparked a public debate about AI sentience, with a significant portion of Americans believing some AIs are already sentient. A recent survey revealed that approximately 20% of Americans believe certain AI systems have achieved sentience, a view that starkly contrasts with the scientific consensus. This perception gap highlights the need for improved AI literacy and public education about the current capabilities and limitations of artificial intelligence technologies. The phenomenon of "social hallucination" is emerging, where individuals become convinced of AI sentience without substantive evidence,...
read Aug 25, 2024AI-Generated Child Porn Arrest Exposes Dark Side of Tech
AI-generated child pornography leads to arrest: A Florida man faces 20 counts of obscenity for allegedly creating and distributing AI-generated child pornography, highlighting the growing misuse of generative AI technology. Phillip Michael McCorkle was arrested at his workplace, a movie theater in Vero Beach, Florida, following an investigation by the Indian River County Sheriff's Office. The investigation was prompted by tips that McCorkle was using an AI image generator to create child sexual imagery and distributing it through the social media app Kik. McCorkle's arrest was part of a larger county operation targeting individuals possessing child pornography. Broader implications of...
read Aug 23, 2024McAfee and Lenovo Launch AI-Powered Deepfake Detector for PCs
Groundbreaking AI-powered deepfake detection: McAfee and Lenovo have joined forces to introduce an innovative Deepfake Detector exclusively for Lenovo AI PCs, marking a significant step in combating digital deception. The Deepfake Detector is designed to identify and flag AI-generated or altered video content, helping users protect themselves against potential scams and misinformation. Trained on an extensive dataset of approximately 200,000 video samples, the tool can accurately detect AI-manipulated audio in videos. Operating seamlessly in the background, the detector scans video content playing both online and locally on the device. Enhanced AI capabilities for consumer devices: The partnership leverages Lenovo's AI...
read Aug 23, 2024Google’s Pixel 9 AI Photos May Be Too Good
The Pixel 9's AI photography raises ethical concerns: Google's latest flagship smartphone introduces powerful AI-driven photo manipulation tools that blur the line between reality and fiction, sparking debate about the future of digital imaging. The Pixel 9 lineup boasts impressive hardware, a fast chip, and a distinctive camera bump, positioning it as a worthy Android flagship device. The "Reimagine" tool allows users to alter photos with simple prompts, creating highly realistic manipulated images that are indistinguishable from authentic photographs. This advancement in AI photography technology raises concerns about the potential for widespread misinformation and the erosion of trust in visual...
read Aug 21, 2024AI-Generated Images Fuel MAGA Propaganda on Social Media
The rise of AI-generated political imagery: Far-right social media accounts are increasingly leveraging artificial intelligence to create outrageous, fake depictions of political figures and events, ushering in a new era of digital propaganda. A distinct trend has emerged where AI-generated images are being used to create provocative and misleading content, such as Taylor Swift fans endorsing Trump or Kamala Harris speaking in front of communist symbols. These images, while not entirely convincing as deepfakes, possess a unique aesthetic that is almost photorealistic yet clearly artificial, earning them the moniker "AI slop." Donald Trump himself has shared some of these AI-generated...
read Aug 21, 2024RFJ Jr Says He’s Constantly Fooled By AI Deepfakes — Are You Too?
AI misinformation vulnerability exposed: Robert F. Kennedy Jr., a third-party presidential candidate, admits to frequently falling for fake AI-generated content, highlighting the growing challenge of digital literacy in the age of artificial intelligence. During a recent campaign event focused on AI, Kennedy revealed that he often struggles to distinguish between real and AI-generated content, relying on his children to identify fake information. The admission came shortly after Kennedy paradoxically claimed that AI-powered misinformation is not a significant threat, arguing that internet users generally have the ability to discern fact from fiction. Kennedy's contradictory statements underscore the complex relationship between personal...
read Aug 19, 2024Trump Reposts AI-Generated Images Claiming Support From Switfties
AI-generated images stir controversy in 2024 presidential race: Former President Donald Trump's recent social media activity has ignited discussions about the role of artificial intelligence in political campaigns and its potential to spread misinformation. Trump reposted four images on Truth Social purportedly showing support from Taylor Swift fans, using the caption "I accept!" An AI image detector analysis suggests all four images are highly likely to be artificially generated One image was labeled as "satire" and originally shared by a conservative account on X, while the other three came from a separate MAGA-supporting account Implications for voter perception: The sharing...
read Aug 19, 2024SF Attorney Launches Lawsuit Against 16 AI ‘Undress’ Websites
AI-generated non-consensual intimate imagery under legal fire: San Francisco's city attorney David Chiu has launched a lawsuit against 16 websites and apps that enable users to create fake nude images of women and girls without their consent, using AI technology. The legal action targets platforms that allow users to "nudify" or "undress" photos, primarily victimizing women and girls by swapping their faces onto AI-generated explicit images. This lawsuit aims to protect Californians and victims worldwide, including celebrities and teenage girls, from the harmful effects of these deepfake technologies. If successful, each site could face fines of $2,500 per violation of...
read Aug 16, 2024San Francisco is Suing AI-Powered “Undressing ” Apps
AI-powered "undressing" websites that create non-consensual deepfake nudes are facing legal action in San Francisco, highlighting growing concerns over the misuse of artificial intelligence technology for sexual exploitation. Legal action against AI deepfake sites: The San Francisco City Attorney's office has launched a lawsuit against 16 websites that use AI to generate fake nude images without consent. These websites, which allow users to upload clothed images and use AI to simulate nudity, collectively received over 200 million visits in the first half of 2024. The lawsuit accuses the sites of violating laws related to revenge porn, deepfake porn, child pornography,...
read Aug 15, 2024How to Protect Yourself from Digital Deception in the AI Era
The rapid advancement of artificial intelligence technology is creating new challenges in the realm of digital security, particularly in the area of imposter scams. These increasingly sophisticated deceptions are leveraging AI to create more convincing and emotionally manipulative scenarios, putting unsuspecting individuals at greater risk of financial and emotional harm. The evolving landscape of imposter scams: AI is being harnessed to enhance the authenticity and effectiveness of common fraudulent schemes, with a particular focus on emergency-type scams that prey on people's emotions and sense of urgency. The notorious "grandparent scam" and similar emergency-based deceptions are becoming more difficult to detect...
read Aug 15, 2024New AI Tool Detects Audio Deepfakes with 99% Accuracy
Pindrop, a leading voice security and fraud detection company, has introduced Pulse Inspect, a groundbreaking tool designed to identify AI-generated audio deepfakes with remarkable accuracy. Revolutionary deepfake detection: Pindrop's Pulse Inspect claims to detect AI-generated speech in digital audio and video files with 99% accuracy, regardless of the AI model or tool used to create the content. The web-based tool is currently available in preview as part of Pindrop's Pulse suite of products. Pulse Inspect's ability to detect synthetic content from any source sets it apart from other AI classifiers that typically only identify content generated by their own tools....
read Aug 14, 2024New AI Image Generation Feature on X is Sparking Misinformation Concerns
The launch of xAI's Grok-2 and Grok-2 mini chatbots marks a significant evolution in AI technology, introducing image generation capabilities to the X platform and raising questions about content moderation and misinformation risks. New AI models with enhanced capabilities: xAI, Elon Musk's artificial intelligence company, has unveiled Grok-2 and Grok-2 mini, updated versions of its Grok chatbot with improved performance and new image generation features. The image generation functionality is powered by Black Forest Lab's Flux 1 AI model, allowing users to create and directly publish images on the X social platform. xAI describes Grok-2 as "more intuitive, steerable, and...
read Aug 14, 2024AI Deep Fakes Target UK Leaders in Crypto Scam
Prince William and UK Prime Minister Keir Starmer have become unwitting faces of a sophisticated AI-generated deep fake scam promoting a fraudulent cryptocurrency platform, raising concerns about the growing threat of AI-based disinformation campaigns targeting public figures. The deceptive campaign: AI-generated videos of Prince William and Prime Minister Keir Starmer were used in Facebook advertisements to falsely endorse a cryptocurrency platform called "Immediate Edge," which researchers have identified as a scam operation. The deep fake videos showed Prince William appearing to say: "Good afternoon, honored citizens of the United Kingdom. I am pleased to announce that I, Prince William, and...
read Aug 14, 2024Elon Musk Deepfake Videos Contribute to Billions in Fraud
Deepfake videos featuring AI-generated versions of Elon Musk have become a widespread and lucrative tool for online scammers, targeting unsuspecting victims with fraudulent investment schemes. The rise of AI-powered scams: Thousands of deepfake videos featuring Elon Musk are being used to defraud people of their money, highlighting the growing threat of AI-generated content in online scams. These videos employ artificial intelligence to clone Musk's voice and manipulate his mouth movements to match fabricated scripts, creating convincing impersonations of the tech mogul. Musk's likeness is featured in nearly 90% of cryptocurrency-related deepfake scams, making him the most commonly used celebrity for...
read Aug 13, 2024Fraudsters Use AI Deepfakes to Fuel Crypto Scam of 890K Users
AI-generated deepfake videos featuring prominent figures are being exploited in cryptocurrency scams, raising concerns about the misuse of advanced technology for fraudulent activities. The scam operation: Fraudsters are using AI-generated deepfake videos of Sir Keir Starmer and Prince William to promote a bogus cryptocurrency trading platform called "Immediate Edge" on Facebook and Instagram. Over 250 fraudulent advertisements featuring these deepfake videos have been identified on Meta platforms. The scam has potentially reached more than 890,000 users on Facebook and Instagram. Approximately £21,053 has been spent on these deceptive advertisements. Mechanics of the scam: The fraudulent ads employ sophisticated tactics to...
read Aug 12, 2024AI-Generated Images Flood Facebook, Exposing Moderation Flaws
The proliferation of AI-generated images on Facebook has led to an investigation uncovering a profitable marketplace for creating and sharing dubious content, raising questions about the platform's content moderation and reward systems. The rise of AI slop: Facebook is experiencing an influx of AI-generated images featuring bizarre and often nonsensical content, which are gaining significant traction on the platform. Images such as "shrimp Jesus," trucks full of babies, and police officers holding giant bibles in floodwaters have gone viral, accumulating tens of thousands of likes. These images, collectively referred to as "slop," represent a growing trend of AI-generated content flooding...
read Aug 10, 2024The Scariest AI-Powered Cyber Threats Presented at Black Hat 2024
The Black Hat 2024 cybersecurity conference highlighted a range of emerging digital threats, from election interference to innovative hacking techniques, underscoring the evolving landscape of cybersecurity challenges faced by individuals, businesses, and governments alike. Election integrity under siege: The looming threat of AI-assisted misinformation campaigns targeting the 50 major elections scheduled for 2024 has become a primary concern for cybersecurity experts and election officials worldwide. Researchers and security professionals at Black Hat emphasized the potential for AI technologies to create and spread highly convincing false information at an unprecedented scale and speed. The intersection of advanced AI capabilities with social...
read Aug 7, 2024Google Has Been Earning Ad Revenue on Non-Consensual Deepfakes
The big picture: Google has been caught accepting payment to promote AI applications that generate nonconsensual deepfake nudes, contradicting its recently announced policies to combat explicit fake content in search results. Uncovering the issue: 404 Media's investigative reporting revealed that Google's search engine was displaying paid advertisements for NSFW AI image generators and similar tools when users searched for terms like "undress apps" and "best deepfake nudes." The discovery highlights a significant discrepancy between Google's stated policies and its actual practices in managing AI-related content. This revelation comes shortly after Google announced expanded policies aimed at addressing non-consensual explicit fake...
read Aug 7, 2024Conspiracy Theorists Think Biden Has Been Replaced by AI
AI conspiracy theories target President Biden: A new wave of unfounded claims suggests that President Joe Biden has been replaced by artificial intelligence, building on older conspiracy theories about body doubles but incorporating cutting-edge technology. Social media platforms have become breeding grounds for these theories, with one influencer's post about supposed AI glitches during a Biden broadcast garnering 78,000 views. These claims persist despite being consistently debunked by journalists present at events and professional fact-checkers. The conspiracy theories range from assertions that Biden has died to claims that AI and holograms are being used to simulate his continued presence and...
read Jul 31, 2024Google to Demote Websites Harboring Deepfakes
The rapid advancement of AI technology has made it easier for individuals to create non-consensual sexually explicit deepfakes, prompting Google to update its search engine algorithm and removal request process to combat this growing problem. Key Changes to Google's Approach: Google is taking proactive measures to address the issue of unwanted AI deepfakes: The removal request process for victims will be streamlined, making it easier to report and remove such content. When reported AI deepfakes are identified, Google Search will automatically filter out related search results that might appear in the future, reducing the need for repeated reporting of similar...
read Jul 31, 2024Deepfake Porn is a Harrowing New Frontier of Digital Harassment for Women
The rise of deepfakes has enabled a disturbing new form of digital harassment targeting women, even at the highest levels of politics, with little recourse for victims. A public servant targeted: Sabrina Javellana, one of Florida's youngest elected officials, discovered explicit deepfake images of herself posted on online forums alongside misogynistic comments: The fakes were nearly identical to real photos from her social media accounts, but with her clothes digitally removed. As a progressive politician, Javellana had faced vitriolic threats before, but this violation felt distinctly personal and traumatizing. Seeking help and finding dead ends: Javellana's attempts to get the...
read Jul 30, 2024Bipartisan Bill Aims to Carve Out AI Deepfakes from Section 230
A bipartisan bill aims to combat AI deepfakes by amending Section 230 protections for tech platforms that fail to address the issue, potentially signaling a new approach to regulating online harms. Key provisions of the Intimate Privacy Protection Act: The proposed legislation, introduced by Reps. Jake Auchincloss (D-MA) and Ashley Hinson (R-IA), targets cyberstalking, intimate privacy violations, and digital forgeries: The bill would amend Section 230 of the Communications Act of 1934, removing legal immunity for platforms that fail to combat these harms. It establishes a "duty of care" for platforms, requiring them to have a reasonable process for addressing...
read