Instagram on Monday announced a decision to change how it labels AI-generated profiles and will start limiting the reach of accounts that feature AI-generated people without saying so.
The Meta-owned photo and short-form video sharing social networking platform said it’s renaming its existing ‘AI creator’ label to ‘AI-generated profile,’ which Instagram says should make the disclosure easier to understand. The new label is meant to tell users that the person featured on a profile was generated or substantially created with AI.
Under the new policy, creators who don’t properly label an AI-generated profile could see their reach reduced. Creators who use the new label, on the other hand, won’t be penalised simply for having an AI-generated person as their profile subject.
The label also isn’t meant for every use of AI. Instagram says people who use AI to edit photos, polish captions, create graphics, or make other creative tweaks don’t need to use the AI-generated profile label.
Instagram says the change comes partly in response to users who have stumbled across profiles that looked like they belonged to real people, only to find out later that the person was completely AI-generated.
“As generative AI becomes a bigger part of how people create, we’ve heard that people don’t like seeing a profile that seems human, only to find out later that the person featured is AI-generated. They want to know when a profile features an AI-generated person,” the platform wrote.
There have been widespread complaints over AI-generated content as AI influencers become more common across social media platforms.
TechCrunch reported that earlier this year, gay dating app, Goose, became the subject of a Wired investigation after a network of apparently AI-generated male influencers promoted the app on Instagram. Wired found more than two dozen accounts that appeared to feature AI influencers, some of which reportedly reached out to potential users through direct messages to get them to sign up.
Health and wellness content is another particularly worrying example. The New York Times reported in July it found hundreds of AI-generated doctors, healers, and wellness personalities on social media promoting supplements or making health claims to users.
The announcement comes after Instagram faced backlash over an AI tool that allowed users to generate images using other people’s likenesses. Users objected to having their public Instagram content used without an explicit opt-in. Meta then removed the feature.
Meta recently reached an $18 billion settlement with US states over allegations concerning the effects of Facebook and Instagram on children and teenagers. As part of the agreement, Meta will introduce a default two-hour daily usage limit for teens across Facebook and Instagram, a ‘Night Mode’ block, muted notifications during school hours, and other restrictions.
