Snapchat turns AI prompts into new lenses

Snapchat has offered an early glimpse of its upcoming on-device AI model that is capable of transforming a user's surroundings with augmented reality (AR). The new model will eventually let creators turn text prompts into custom lenses – potentially opening the door to some unique looks that can be tried out and sent to friends.

You can see what it might look like in the GIF below, which shows a person's clothing and background changing in real time based on a “50s sci-fi film.” Users will start seeing lenses using this new model in the coming months, while manufacturers could start making lenses with the model by the end of this year, according to the report. TechCrunch,

Additionally, Snapchat is releasing a set of new AI tools that can make it easier for creators to create custom augmented reality (AR) effects. Some of the tools now available with the latest Lens Studio update include new face effects that let creators write prompts or upload images to create custom lenses that completely transform a user's face.

The suite also includes a feature called Immersive ML, which “applies realistic transformations to the user's face, body, and surrounding environment in real-time.” Other AI tools coming to Lens Studio allow lens creators to generate 3D assets based on text or image prompts, create face masks and textures, as well as create 3D character heads that mimic the user's expressions.