News/Deepfakes
California cracks down on AI-generated child deepfakes
California takes bold steps to protect minors from AI-generated sexual imagery: Governor Gavin Newsom has signed two bills aimed at safeguarding children from the misuse of artificial intelligence to create explicit sexual content. The new laws close a legal loophole around AI-generated child sexual abuse imagery and clarify that such content is illegal, even if artificially created. District attorneys can now prosecute individuals who possess or distribute AI-generated child sexual abuse images as a felony offense, without needing to prove the materials depict a real person. These measures received strong bipartisan support in the California legislature. Broader context of AI...
read Sep 27, 2024AI-made child abuse images are flooding the web
AI-generated child exploitation: The rapid advancement of generative AI technology has led to an alarming increase in the creation and distribution of nonconsensual, sexually explicit images and videos of children, particularly in high school settings. A recent report by the Center for Democracy and Technology revealed that 15% of high school students have heard about AI-generated sexually explicit "deepfakes" of someone at their school within the past year. Another study found that 11% of children aged 9-17 know a peer who has used AI to generate nude images of other kids. Law enforcement agencies worldwide are increasingly encountering AI-generated child...
read Sep 27, 2024California passes 9 landmark AI content regulation bills
California takes legislative action on AI: Governor Gavin Newsom has signed nine bills into law, addressing various risks associated with AI-generated content, particularly deepfakes, while 29 more AI-related bills await his decision by September 30. The new legislation covers a range of issues, including protecting performers' digital likenesses, combating the misuse of AI-generated content, and addressing deepfakes in election campaigns. These laws represent a significant step in regulating AI technology and its potential impacts on society, entertainment, and politics. Protecting performers and their digital rights: Two of the signed bills focus on safeguarding actors and performers from unauthorized use of...
read Sep 22, 2024AI is Shaping Politics, But Not in the Ways Experts Feared
AI's unexpected role in the 2024 U.S. presidential race: Contrary to initial fears of hyper-realistic deepfakes, artificial intelligence is shaping the election through absurd and often cartoonish content, particularly in the contest between Vice President Kamala Harris and former President Donald Trump. The surreal landscape of AI-generated political content: Rather than sophisticated deepfakes, voters are encountering a barrage of outlandish AI-created images and videos that push the boundaries of reality and political messaging. AI-generated memes featuring Trump riding a cat or Harris sporting a mustache have become commonplace, showcasing the technology's capacity for creating bizarre and attention-grabbing content. These surreal...
read Sep 20, 2024How to Tell if an Image is AI Generated
As artificial intelligence continues to produce an increasing amount of visual content online, the ability to distinguish between real and AI-generated images has become crucial for internet users. Texture and resolution inconsistencies: AI-generated images often display irregularities in texture and resolution due to current technological limitations. Look for areas of unnatural smoothness or blurring where continuous textural patterns should exist. These discrepancies are typically more noticeable in the background, midground, and side frames of the image, rather than in the main focal areas. Anatomical errors: While AI has made significant progress in this area, it still struggles with certain aspects...
read Sep 18, 2024California’s New Laws Could Kill Election Deepfakes in Your Social Feeds
California takes legislative action against AI-generated election misinformation: Governor Gavin Newsom has signed three bills into law aimed at combating the spread of deepfakes and AI-generated content during elections, positioning the state as a leader in AI regulation. Key provisions of AB 2839: This bill expands existing protections against deceptive AI-generated election materials and introduces stricter timelines for enforcement. Distribution of AI-generated election content is prohibited within 120 days before an election and 60 days after. Officials and candidates are granted the right to sue in order to prevent the distribution of such materials. The bill is set to take...
read Sep 18, 2024AI-Generated Deepfakes are Heralding the Arrival of the ‘Deep Doubt’ Era
The rise of AI-generated media and its impact on trust: The proliferation of AI-generated content is ushering in an era of "deep doubt," where the authenticity of digital media is increasingly questioned, and real events can be more easily denied. The term "deep doubt" refers to skepticism towards genuine media stemming from the existence and widespread use of generative AI technologies. This phenomenon allows individuals to more credibly claim that real events did not occur, suggesting that documentary evidence was fabricated using AI tools. The concept of "deep doubt" builds upon the previously coined term "liar's dividend," which describes how...
read Sep 17, 2024Google Unveils AI Image Authentication for Search and Ads
Google's new image authentication initiative: Google plans to implement a technology that will identify the origin and editing history of images in its search results and ad systems. The technology is based on the C2PA (Coalition for Content Provenance and Authenticity) authentication standard, which creates a digital trail for images. Google's "about this image" feature in search results will be updated to show if an image was created or edited using AI tools. The company aims to integrate C2PA metadata into its ad systems and is exploring ways to relay this information on YouTube. Industry collaboration and technical details: The...
read Sep 15, 2024Americans Don’t Trust Election Information from AI, Survey Finds
Public skepticism of AI in elections: A new survey reveals that most Americans are wary of using artificial intelligence tools for obtaining election-related information, highlighting concerns about the technology's reliability and potential for misinformation. According to a poll conducted by The Associated Press-NORC Center for Public Affairs Research and USAFacts, approximately two-thirds of US adults express little to no confidence in AI chatbots or search results providing reliable and factual information. The skepticism is particularly pronounced when it comes to high-stakes events such as elections, with many respondents doubting AI's ability to deliver accurate information about voting processes and candidates....
read Sep 11, 2024Taylor Swift Endorses Harris in Response to Deepfake Trump Endorsement
Swift's endorsement amid AI concerns: Taylor Swift has publicly announced her support for Vice President Kamala Harris in the upcoming November presidential election, citing concerns over AI-generated deepfakes as a motivating factor. Swift's endorsement came in response to AI-generated images falsely depicting her support for Donald Trump's presidential campaign. The singer emphasized the importance of combating misinformation with transparency and truth. Swift's Instagram post addressed key issues such as LGBTQ rights, reproductive care, and IVF, demonstrating her engagement with current political topics. AI misinformation in politics: The incident highlights growing concerns about the potential misuse of artificial intelligence in political...
read Sep 10, 2024New Mexico Cops Use AI-Generated 14-Year-Old Girl to Lure Sex Offenders
Controversial law enforcement tactics: New Mexico law enforcement officials have employed an AI-generated image of a fictional 14-year-old girl to attract and catch potential sex offenders, raising ethical concerns about the use of technology in criminal investigations. The revelation comes from a lawsuit filed by the state of New Mexico against Snapchat, alleging the social media platform's failure to protect children from sexual exploitation and harm. As part of an undercover investigation, officers created a decoy Snapchat account for a fictional 14-year-old named "Heather," using an AI-generated image to convince potential predators of her authenticity. The tactic successfully lured accounts...
read Sep 9, 2024Tom Hanks Warns Fans of AI-Generated Health Scams Using His Image
Tom Hanks issues urgent warning about AI-generated scams: The renowned actor has taken to social media to alert fans about fraudulent online advertisements using his likeness and voice without permission. The nature of the scam: Hanks reveals that multiple internet ads are falsely using his name, image, and voice to promote "miracle cures and wonder drugs" through AI-generated content. These advertisements have been created without Hanks' consent, using artificial intelligence to mimic his appearance and speech. The actor emphatically states that he has no involvement with these posts, treatments, or spokespeople promoting these supposed cures. Hanks' personal health disclosure: The...
read Sep 7, 2024AI Sting Operations Target Online Child Predators
Innovative law enforcement tactics: New Mexico police are employing AI-generated images of fake teenagers in undercover operations to catch online child predators, as revealed in a lawsuit against Snapchat. Operation details: The New Mexico Department of Justice created a fake Snapchat account for a 14-year-old girl named "Sexy14Heather" using an AI-generated image Despite being set to private, the account was recommended to potentially dangerous users with concerning usernames like "child.rape" and "pedo_lover10" After accepting a single follow request, Snapchat's algorithm suggested over 91 users, many of whom were adult accounts seeking explicit content Investigation findings: Investigators posing as the fictional...
read Sep 7, 2024The 1st AI Election: Deepfakes, Misinformation and Personalized Propaganda
The AI-driven transformation of political campaigning: The 2024 election cycle has witnessed an unprecedented surge in the use of artificial intelligence for creating deceptive content, raising concerns about the future of democratic processes and information integrity. Current landscape of AI in politics: AI-generated content has become a prominent feature in the ongoing election campaign, with both legitimate and malicious applications emerging. Deepfake robocalls mimicking President Biden's voice targeted New Hampshire voters, demonstrating the potential for AI to impersonate political figures. Fake images circulated showing celebrity Taylor Swift endorsing Donald Trump, highlighting the ease of creating and spreading misleading visual content....
read Sep 7, 2024Microsoft Removes 300,000 Non-Consensual Intimate Images from Bing
Microsoft takes action against non-consensual intimate images: The tech giant has partnered with StopNCII to combat the spread of explicit content, including AI-generated deepfakes, on its Bing image search platform. Since March, Microsoft has successfully removed nearly 300,000 intimate images that were posted without consent from Bing search results, demonstrating a significant step in addressing this issue. The company has integrated its PhotoDNA technology into StopNCII's platform, enabling individuals over 18 to create digital fingerprints of images they wish to protect from online distribution. These digital fingerprints are then shared with StopNCII's partner platforms, including popular social media sites like...
read Sep 6, 2024AI’s Influence on the 2024 US Election is Raising Concern
AI's looming influence on the 2024 US election: As artificial intelligence technologies advance rapidly, concerns are growing about their potential to significantly impact the upcoming presidential race through various means, from deepfakes to voter persuasion tactics. Deepfakes and AI-generated content: The proliferation of AI-generated pornography and deepfakes has prompted legislative action, with varying degrees of success and enforceability across states. 23 states have enacted laws addressing AI-generated pornographic content, but enforcement remains a significant challenge due to the technology's rapid evolution and the difficulty in tracing its origins. The existence of deepfake technology has given rise to the "liar's dividend,"...
read Sep 5, 2024AI Deepfake Laws Are Struggling to Keep Pace with Technology
The deepfake dilemma: States across the U.S. are taking the lead in addressing the growing threat of nonconsensual deepfake pornography, as federal legislation lags behind the rapid pace of technological advancement. A total of 39 states have introduced laws targeting nonconsensual deepfakes, with 23 successfully passing legislation, 4 bills pending, and 9 proposals struck down. The urgency to act is driven by the widespread impact of deepfake technology, affecting both celebrities and ordinary individuals. An estimated 90% of deepfake videos are pornographic in nature, with the majority being nonconsensual content featuring women. Federal efforts and local initiatives: While federal legislation...
read Sep 5, 2024YouTube’s New AI Tools Protect Creators from Voice and Face Mimicry
YouTube's new AI protection tools: YouTube is developing technologies to safeguard creators from AI-generated content that mimics their voices or likenesses, addressing growing concerns in the creative industry. The platform is creating a "synthetic-singing identification technology" to detect and manage AI-generated content that simulates artists' singing voices. This tool will be integrated into YouTube's existing Content ID copyright identification system and is scheduled for pilot testing next year. A separate tool is being developed to identify facial deepfakes of creators, actors, musicians, and athletes, though no specific release date has been announced. Responding to industry concerns: The development of these...
read Sep 4, 2024Deepfakes are Posing a Growing Threat to India’s Financial Sector
The rising threat of deepfakes in India's financial sector: Deepfake technology is emerging as a significant concern for India's financial services industry (FSI), blurring the lines between authentic and fabricated content and potentially undermining trust in financial systems. A 2022 incident involving a deepfake audio of a Mumbai energy company CEO caused temporary stock price fluctuations, highlighting the rapid and tangible impact of such technologies on market stability. Financial sector leaders are increasingly worried about the potential for deepfakes to impersonate business executives and spread false information, which could have far-reaching consequences for market dynamics and investor confidence. The finance...
read Sep 4, 2024California Mandates Consent for AI Deepfakes of Deceased Stars
California's AI deepfake legislation: The California state Senate has passed AB 1836, a bill requiring explicit consent from the estates of deceased performers for the creation of AI replicas in various media projects. The bill covers all forms of digital recreation using AI, including still images, voice clones, and full character portrayals in films. Producers must obtain agreement from the estate or legal representative of the deceased performer before using their AI replica. This legislation follows the recent passage of AB 2602, which focuses on consent requirements for AI replicas of living performers. Industry support and implications: SAG-AFTRA, the union...
read Sep 4, 2024California Lawmakers Approve Wave of AI Regulations to Combat Deepfakes and Worker Replacement
California Takes Bold Steps to Regulate AI: The California Legislature has approved a series of bills aimed at regulating artificial intelligence, addressing concerns ranging from deepfakes to worker protection and AI literacy. Key legislative actions: Lawmakers have passed several bills to combat deepfakes, set safety guardrails for AI models, protect workers from AI replacement, and promote AI literacy in education. The proposed legislation targets various aspects of AI, including election interference, child protection, and worker rights. These bills now await Governor Gavin Newsom's decision, with a September 30 deadline for his action. Newsom has previously expressed caution about overregulation of...
read Aug 28, 2024AI Deepfakes Spark Urgent Call for FEC Election Regulations
Congressional push for AI regulation: A group of Democratic lawmakers is urging the Federal Election Commission (FEC) to strengthen regulations on AI-generated deepfakes, particularly in light of the recent controversy surrounding X's chatbot Grok. Rep. Shontel Brown (D-Ohio) and several colleagues have written to the FEC, seeking clarification on whether AI-generated deepfakes of election candidates fall under the category of "fraudulent misrepresentation." The lawmakers are backing a July 2023 petition by Public Citizen that calls for the FEC to propose rules governing the use of deceptive AI in political campaigns. This initiative comes in response to growing concerns about the...
read Aug 28, 2024Deepfakes and The AI-Driven Truth Crisis
The rapid advancement of AI technology has raised concerns about its potential to blur the lines between truth and fiction, particularly in the realms of information dissemination and democratic processes. The deepfake dilemma: AI-powered deepfake technology has demonstrated its ability to create highly convincing fake content, ranging from harmless entertainment to potentially dangerous misinformation. In Hollywood, deepfakes have been used to de-age actors, such as Harrison Ford reprising his role as a young Indiana Jones. More concerning applications include the creation of fake videos featuring political figures like Kamala Harris and Donald Trump, raising alarm bells as the US approaches...
read Aug 28, 2024AI Reshapes Political Ads as 16 States Adopt New Laws
AI's growing role in political advertising: Recent advancements in generative artificial intelligence (AI) technologies have prompted lawmakers and regulators to address potential risks in the context of political advertising, particularly as the 2024 election cycle approaches. State and federal efforts are underway to regulate the use of AI in political ads, with a focus on transparency and preventing the spread of misinformation. As of August 2024, 16 states have adopted laws governing AI-generated content in political advertising, while another 16 states have bills under consideration. The Federal Communications Commission (FCC) has proposed a new rule requiring television and radio broadcast...
read