Logo for AiToolGo

AI-Generated Explicit Images of Public Figures: What the Oversight Board Decided and Why It Matters

In-depth discussion
Academic
 0
 0
 1
Ce document est une décision du Conseil de surveillance de Meta portant sur deux cas d'images sexuellement explicites générées par IA représentant des personnalités publiques féminines indienne et américaine, publiées sur Instagram et Facebook. Le Conseil a annulé la décision initiale de laisser une publication en ligne et confirmé la suppression de l'autre. Il recommande à Meta de reformuler ses règles sur les images sexualisées non consensuelles, de les déplacer dans la politique relative à l'exploitation sexuelle des adultes, de revoir la fermeture automatique des appels après 48 heures et d'ajouter un signal d'absence de consentement pour les contenus générés par IA.
  • main points
  • unique insights
  • practical applications
  • key topics
  • key insights
  • learning outcomes
  • • main points

    • 1
      Analyse juridique rigoureuse articulée autour des standards communautaires et des responsabilités de Meta en matière de droits humains
    • 2
      Contextualisation solide des préjudices liés aux deepfakes, appuyée sur des données chiffrées et des rapports d'experts
    • 3
      Recommandations précises et actionnables, formulées de manière structurée
  • • unique insights

    • 1
      Distinction argumentée entre intimidation/harcèlement et exploitation sexuelle des adultes pour qualifier les deepfakes intimes, fondée sur les motivations réelles des auteurs (audience, monétisation, redirection)
    • 2
      Analyse du risque lié à la fermeture automatique des recours et à la banque MMS, qui peut amplifier les préjudices pour les victimes peu médiatisées
  • • practical applications

    • Document utile pour les professionnels de la modération de contenu, les juristes, les chercheurs en gouvernance des plateformes et les spécialistes de l'IA générative souhaitant comprendre comment les grandes plateformes encadrent les deepfakes intimes et quels mécanismes de signalement et d'appel existent.
  • • key topics

    • 1
      Deepfakes d'images intimes et abus sexuels basés sur l'image
    • 2
      Standards communautaires de Meta : intimidation et harcèlement vs exploitation sexuelle des adultes
    • 3
      Mécanismes de modération automatisée : banques MMS, fermeture automatique des appels et droits de recours
  • • key insights

    • 1
      Décision complète et motivée d'une instance de supervision indépendante sur un sujet émergent lié à l'IA générative
    • 2
      Recommandations concrètes sur la formulation des règles et la conception des signaux de non-consentement
    • 3
      Mise en perspective internationale des préjudices et des cadres réglementaires (Inde, États-Unis)
  • • learning outcomes

    • 1
      Comprendre comment les plateformes qualifient et traitent les deepfakes d'images intimes au regard de leurs standards communautaires
    • 2
      Identifier les critères de non-consentement et les signaux contextuels utilisés pour détecter des contenus générés ou manipulés par IA
    • 3
      Saisir les enjeux de droits humains, de recours et de modération automatisée dans la gestion de contenus sexualisés générés par IA
examples
tutorials
code samples
visuals
fundamentals
advanced content
practical tips
best practices

“ Introduction: Why AI-Generated Explicit Images Matter

Advances in generative AI have made it easier than ever to create realistic explicit images of real people without their consent. The Oversight Board of Meta recently examined two such cases, involving female public figures from India and the United States. Their decision offers important lessons on how social platforms should protect people from AI-driven sexual abuse while keeping their rules clear and enforceable.

“ Background of the Two Cases

The first case involved an Instagram account dedicated to AI-generated or AI-manipulated images of Indian women. It posted an image of a nude woman, seen from behind with her face visible, that resembled a well-known Indian public figure. A similar image showing the same woman in a swimsuit appeared in the same series, likely the original photo altered by AI. The second case involved an AI-generated image shared in a Facebook group dedicated to AI creations. It showed a nude woman being groped, styled to resemble a named American public figure mentioned in the caption.

“ How Meta Handled the Content

In the Indian case, a user reported the post for pornography, but the report was automatically closed because it was not reviewed within 48 hours. The user's appeal was closed the same way. After the Board selected the case, Meta concluded its original decision was wrong, removed the post under its bullying and harassment standard, disabled the account, and added the image to a Media Matching Service bank. In the American case, the image had already been added to a matching bank after violating Meta's policy, so it was removed automatically. The user's appeal was also automatically closed, prompting an appeal to the Board.

“ Why Deepfake Intimate Images Are a Growing Global Problem

Deepfake intimate images use computer-manipulated media to depict real people in sexualized ways. Creating them requires fewer source images than before, and online deepfake videos reportedly rose by 550 percent since 2019. Research cited in the case found that the vast majority of deepfake content is sexual and overwhelmingly targets women. Female politicians, journalists, human rights defenders, and celebrities are frequently targeted across many countries, and cases involving children and teenagers have also been documented. In conservative communities, such content can lead to severe real-world consequences, including violence.

“ The Harm Caused to Victims

Research on image-based sexual abuse shows that victims often experience shame, helplessness, anxiety, isolation, humiliation, and distress. They may also lose their sense of dignity, safety, and self-confidence. Researchers have argued that sexualized deepfakes can cause harm comparable to that of real non-consensual intimate images. Because the damage comes from the creation, sharing, and viewing of these images, labeling them as manipulated does not adequately address the harm.

“ The Oversight Board's Key Findings

The Board concluded that both images violated Meta's prohibition on manipulated sexualized degrading images. The visual changes were clear, and contextual cues such as hashtags and the posting environment showed AI generation. The American image also violated Meta's rules on adult nudity and sexual activity because it depicted sexual touching. The Board found that removing both posts was consistent with Meta's human rights responsibilities. It also noted that deepfake intimate images require removal because the nature and severity of the harm cannot be resolved by a warning label alone.

“ Problems with Meta's Current Policy Wording

The Board found that the phrase "manipulated sexualized degrading images" was not clear enough for ordinary users, even if the users in these cases should have understood it. Meta explained the term to mean images sexualizing people in ways they would likely not have wanted and that are therefore perceived as degrading. The Board said "non-consensual" more clearly describes the core issue. It also found that the word "manipulated" is too narrow for modern techniques, including generative AI, and should be broadened to cover all forms of media manipulation.

“ Recommendations for Clearer Rules

The Board recommended that Meta move the prohibition on manipulated sexualized degrading images into its Adult Sexual Exploitation Community Standard rather than the bullying and harassment policy. Users are unlikely to see deepfake intimate images as bullying, since research shows they are often shared to attract audiences, monetize pages, or drive traffic to other sites, including pornographic ones. Meta should also replace "degrading" with "non-consensual," replace "manipulated images" with a broader term for manipulated media, and consider renaming the policy to "non-consensual sexual content." Finally, AI-generated or manipulated context showing nudity or sexualization should be treated as a signal of non-consent, and such content should not need to be non-commercial or privately produced to violate the rule.

“ Concerns About Automatic Appeal Closures

The Board expressed concern that appeals about image-based sexual abuse were closed automatically. Waiting 48 hours for review can seriously harm victims. Although the Board does not yet have full information on how widely Meta uses automatic closure, it considers the issue to have significant human rights implications and called for a risk assessment and corrective action. Meta also only added the Indian public figure's image to a matching bank after the Board asked questions, and the Board noted that victims of deepfake intimate images often remain unknown to the public, leaving them to find and report content themselves.

“ Conclusion: What This Means for Online Platforms

This decision highlights that AI-generated sexual imagery is a serious form of abuse that demands fast, decisive removal rather than weak labeling. Platforms must write clear rules, place them in the right policy categories, respond quickly to appeals, and proactively protect vulnerable users, especially women and girls. As governments develop new laws on deepfakes, social media companies must remain the first line of defense to prevent harm and protect the dignity and safety of people affected by synthetic sexual content.

 Original link: https://www.oversightboard.com/decision/bun-7e941o1n/?lang=fr

Comment(0)

user's avatar

      Related Tools