Snapchat’s AI Transforms User Surroundings and Clothing in Real-Time, Revolutionizing AR Experiences

Snapchat is set to launch an on-device AI model that can transform users’ surroundings and clothing in real-time based on text prompts, potentially revolutionizing the way people interact with augmented reality (AR) on the platform.

Key features of Snapchat’s upcoming AI model: The on-device AI model will enable creators to turn text prompts into custom lenses, allowing for unique and dynamic AR experiences:

• Users can expect to see lenses using this new model in the coming months, while creators will have access to the tool for making custom lenses by the end of the year.
• The AI model can transform a user’s clothing and background in real-time based on prompts, such as “50s sci-fi film,” opening up a wide range of creative possibilities for users and creators alike.

Enhanced AI tools for lens creation: Snapchat is also introducing a suite of AI tools to simplify the process of creating custom AR effects for creators:

• The latest Lens Studio update includes face effects that allow creators to write a prompt or upload an image to generate a custom lens that completely transforms a user’s face.
• Immersive ML, another new feature, applies realistic transformations to the user’s face, body, and surroundings in real-time based on prompts like “Matisse Style Painting.”
• Additional AI tools enable the generation of 3D assets, face masks, textures, and character heads that mimic user expressions, all based on text or image prompts.

Snapchat’s ongoing investment in AI: Over the past year, Snapchat has introduced several AI features to enhance user experience and engagement:

• Subscribers can now send AI-generated snaps to friends, showcasing the platform’s commitment to integrating AI technology into its core features.
• Snapchat also launched a ChatGPT-powered AI chatbot, making it accessible to all users and demonstrating the company’s interest in leveraging advanced language models.

Broader implications for the AR and social media landscape: Snapchat’s new on-device AI model and creator tools have the potential to significantly impact the way users interact with AR on social media platforms:

• By enabling users and creators to generate custom, dynamic AR experiences with simple text prompts, Snapchat is lowering the barrier to entry for AR creation and consumption.
• The integration of advanced AI technology into Snapchat’s core features could set a new standard for user engagement and creativity on social media platforms, potentially pushing competitors to invest more heavily in AI-driven experiences.
• As AI continues to evolve and become more accessible, it is likely that we will see an increasing number of social media platforms and apps incorporating AI-generated content and experiences, transforming the way people interact with and create content online.