×
Snapchat’s AI Transforms User Surroundings and Clothing in Real-Time, Revolutionizing AR Experiences
Written by
Published on
Join our daily newsletter for breaking news, product launches and deals, research breakdowns, and other industry-leading AI coverage
Join Now

Snapchat is set to launch an on-device AI model that can transform users’ surroundings and clothing in real-time based on text prompts, potentially revolutionizing the way people interact with augmented reality (AR) on the platform.

Key features of Snapchat’s upcoming AI model: The on-device AI model will enable creators to turn text prompts into custom lenses, allowing for unique and dynamic AR experiences:

  • Users can expect to see lenses using this new model in the coming months, while creators will have access to the tool for making custom lenses by the end of the year.
  • The AI model can transform a user’s clothing and background in real-time based on prompts, such as “50s sci-fi film,” opening up a wide range of creative possibilities for users and creators alike.

Enhanced AI tools for lens creation: Snapchat is also introducing a suite of AI tools to simplify the process of creating custom AR effects for creators:

  • The latest Lens Studio update includes face effects that allow creators to write a prompt or upload an image to generate a custom lens that completely transforms a user’s face.
  • Immersive ML, another new feature, applies realistic transformations to the user’s face, body, and surroundings in real-time based on prompts like “Matisse Style Painting.”
  • Additional AI tools enable the generation of 3D assets, face masks, textures, and character heads that mimic user expressions, all based on text or image prompts.

Snapchat’s ongoing investment in AI: Over the past year, Snapchat has introduced several AI features to enhance user experience and engagement:

  • Subscribers can now send AI-generated snaps to friends, showcasing the platform’s commitment to integrating AI technology into its core features.
  • Snapchat also launched a ChatGPT-powered AI chatbot, making it accessible to all users and demonstrating the company’s interest in leveraging advanced language models.

Broader implications for the AR and social media landscape: Snapchat’s new on-device AI model and creator tools have the potential to significantly impact the way users interact with AR on social media platforms:

  • By enabling users and creators to generate custom, dynamic AR experiences with simple text prompts, Snapchat is lowering the barrier to entry for AR creation and consumption.
  • The integration of advanced AI technology into Snapchat’s core features could set a new standard for user engagement and creativity on social media platforms, potentially pushing competitors to invest more heavily in AI-driven experiences.
  • As AI continues to evolve and become more accessible, it is likely that we will see an increasing number of social media platforms and apps incorporating AI-generated content and experiences, transforming the way people interact with and create content online.
Snapchat AI turns prompts into new lens

Recent News

New research explores how to train AI agents with an ‘evolving online curriculum’

The new framework enhances open-source AI models' ability to perform web-based tasks, potentially reducing reliance on costly proprietary systems.

AMD overtakes Intel in datacenter sales for first time

AMD's rise in datacenter CPU revenue signals a significant shift in the semiconductor industry, with potential implications for future computing architecture and market competition.

How Autodesk took AI from experimentation to real-world application

Autodesk's AI integration strategy focuses on balancing custom solutions with off-the-shelf options while promoting company-wide adoption and cost efficiency.