Human models outraged to discover their faces being used in AI propoganda

AI-generated propaganda sparks controversy: The use of AI-generated videos featuring real human models in political propaganda has raised serious ethical concerns and sparked outrage among the affected individuals.

The Synthesia dilemma: Synthesia, a billion-dollar text-to-video AI company, has come under scrutiny for its AI avatar technology being used to create propaganda clips linked to authoritarian regimes.

• Synthesia’s clientele ranges from reputable organizations like Reuters and Ernst & Young to groups associated with authoritarian states such as China, Russia, and Venezuela.
• The company claims its technology allows users to create “studio-quality videos with AI avatars” with ease.
• Human models who posed for Synthesia were shocked to discover their likenesses being used in propaganda videos without their knowledge or consent.

Model reactions and concerns: The affected models have expressed deep distress and worry about the potential consequences of their involuntary involvement in politically charged content.

• Mark Torres, a London-based creative director, described feeling “violated and vulnerable” upon viewing a propaganda clip featuring his likeness.
• Torres expressed concern about being perceived as involved in promoting military rule in unfamiliar countries.
• Actor Dan Dewhirst, whose image was used in Venezuelan propaganda, worried about the potential impact on his career and mental health.

Legal and ethical implications: The use of AI-generated likenesses without explicit consent has become a contentious issue in the entertainment industry and beyond.

• California recently passed two bills making it illegal to use AI-generated digital replicas of actors’ likenesses or voices without their explicit consent.
• The use of generative AI was a major point of contention in the 2023 Screen Actors Guild and Writers Guild of America strike, resulting in new rules surrounding AI use in the industry.

Synthesia’s defense: The company maintains that it is protected by the terms of service agreed to by the models.

• Synthesia claims to explain its terms of service and technology to actors and models at the start of their collaboration.
• The company acknowledges that its processes may not be perfect but states that its founders are committed to continual improvement.

Broader implications: This controversy highlights the growing ethical challenges surrounding AI-generated content and the potential for misuse in political propaganda.

• The incident raises questions about the responsibility of AI companies in preventing the misuse of their technology.
• It also underscores the need for clearer regulations and guidelines governing the use of AI-generated likenesses, particularly in politically sensitive contexts.
• The situation serves as a cautionary tale for models and actors, emphasizing the importance of understanding the full implications of their agreements with AI companies.

Looking ahead: As AI technology continues to advance, the industry faces mounting pressure to address ethical concerns and establish robust safeguards to protect individuals’ rights and reputations.