Logo for AiToolGo

Protecting Students in the Age of AI: Educators' Perspectives on AI-Generated Non-Consensual Intimate Imagery in Schools

In-depth discussion
Academic
 0
 0
 1
This qualitative interview study examines how 20 U.S. educators (K-12 teachers, counselors, psychologists, and higher education instructors) perceive AI-generated non-consensual intimate imagery (AIG-NCII) in schools. Findings reveal educators see it as a serious, growing problem, yet most work in schools lacking clear policies, training, or resources. Participants called for multi-level interventions including AI-specific educator training, student education on consent and AI ethics, parental collaboration, technology company accountability, and government regulation. The paper contributes to HCI discussions on generative AI misuse and informs educational tool design, curriculum development, and policy-making.
  • main points
  • unique insights
  • practical applications
  • key topics
  • key insights
  • learning outcomes
  • • main points

    • 1
      Fills a clear research gap by centering educators, a stakeholder group that is often the first to witness AIG-NCII incidents but is underrepresented in prior work focused on public perception and technical or legal frameworks
    • 2
      Well-defined research questions (RQ1-RQ4) that systematically cover concerns, current practices, needed measures, and implementation challenges
    • 3
      Transparent participant recruitment and a diverse sample in terms of gender, race, geography, role type, and years of experience, with a demographic table provided
  • • unique insights

    • 1
      Educators are positioned not only as protectors of students but also as potential victims of AIG-NCII, highlighting a dual vulnerability that is rarely discussed
    • 2
      Existing interventions in the literature (e.g., labeling AI content as fictional) may not mitigate perceived wrongfulness, pointing to the need for educational rather than purely technical strategies
  • • practical applications

    • Offers actionable guidance for school administrators, curriculum designers, and HCI researchers on the infrastructural, procedural, and institutional supports needed to address AIG-NCII, including training needs, multi-stakeholder collaboration, and policy gaps. Useful for designing interactive educational materials and informing school and government policy.
  • • key topics

    • 1
      Definition and societal impact of AI-generated non-consensual intimate imagery (AIG-NCII)
    • 2
      Educators' concerns, existing institutional practices, and gaps in policies and training
    • 3
      Multi-stakeholder strategies and barriers to implementing interventions in schools
  • • key insights

    • 1
      Centers educators as a distinct stakeholder group bridging the gap between public perception research and institutional response
    • 2
      Connects qualitative findings directly to implications for interactive educational tool design, curriculum development, and policy
  • • learning outcomes

    • 1
      Understand the definition, harms, and prevalence of AI-generated non-consensual intimate imagery in educational settings
    • 2
      Recognize the gaps in current school policies, training, and resources for addressing AIG-NCII
    • 3
      Identify multi-stakeholder strategies (educator training, student education, parental collaboration, industry and government action) for prevention and response
examples
tutorials
code samples
visuals
fundamentals
advanced content
practical tips
best practices

“ Introduction: A Growing Threat in American Schools

Generative AI can now produce highly realistic images that are difficult to distinguish from authentic photographs. While this technology has brought benefits to education, creativity, and productivity, it has also enabled serious misuse. One of the most troubling forms is AI-generated non-consensual intimate imagery (AIG-NCII), in which someone's likeness is used to create explicit content without their permission. Schools across the United States have recently reported incidents in which students' photos were turned into fake nude images, drawing public attention to the urgency of the problem. Yet schools often remain unprepared, lacking clear response procedures. This article examines an interview study with 20 U.S. educators that sheds light on how schools perceive, experience, and respond to AIG-NCII, and what supports they need.

“ Understanding AI-Generated Non-Consensual Intimate Imagery

AIG-NCII refers to the creation, distribution, or threatened distribution of explicit or intimate images produced with generative AI using a person's likeness without consent. Unlike the broader term 'deepfake,' AIG-NCII foregrounds the non-consensual nature of the content and the accessibility of generative tools that make such imagery easier to produce. The harms are substantial. Victims may experience depression, anxiety, post-traumatic stress, and suicidal ideation, along with bullying, harassment, reputational damage, and social isolation. Victim-blaming attitudes can intensify self-blame and discourage victims from seeking help. Although the technology is new, the psychological and social consequences mirror those of other forms of non-consensual intimate imagery.

“ Why Educators Are on the Front Lines

Educators spend significant time with students and are often the first adults to notice when something is wrong. Teachers, school counselors, and psychologists are therefore frequently the ones who learn about incidents of AIG-NCII and must respond. Their role makes them uniquely positioned to witness these harms and potentially mitigate them. However, educators are usually not the primary perpetrators or victims, which distinguishes them as a stakeholder group with distinct perspectives. Prior research has focused heavily on public opinion and legal frameworks, leaving the practical, institutional experiences of educators comparatively underexplored.

“ The Real-World Impact on Students

Incidents involving AI-generated nude images of students have been reported in middle and high schools across multiple states. In one New Jersey case, male classmates used AI to create fake nude images of underage high school girls. In California, five students created and circulated fabricated nudes of sixteen eighth-grade classmates, resulting in their expulsion. A 2024 survey found that both students and teachers reported significant amounts of AIG-NCII depicting members of their own school communities, with students being the primary victims and perpetrators. These cases show that the issue is not hypothetical but an active concern affecting young people's safety, dignity, and well-being.

“ What Educators Are Worried About

The educators in the study expressed concern on several fronts. They worried about students' vulnerability as potential victims and about the moral decline they feared could accompany normalized misuse of AI. They also described unease about their own exposure, recognizing that educators themselves could become targets. Beyond individual harm, participants reflected on the power of AI technology and its ethical ambiguity, noting how quickly tools can be misused and how difficult it is to establish clear moral boundaries around them. These concerns reflect a sense that the problem extends beyond discipline issues to encompass the culture and values of the school community.

“ Current School Practices and Their Gaps

Despite the seriousness of AIG-NCII, existing responses in schools are limited. Many educators reported that their institutions lacked clear policies or procedures for handling such cases. A national survey found that over half of teachers said their schools had not provided policies and procedures for either teachers or students, and had not adequately responded to rising incidents. Where responses exist, they are often ad hoc and rely on individual judgment rather than systematic frameworks. Training is similarly scarce, leaving many educators without the knowledge to recognize, document, or respond appropriately to AIG-NCII when it surfaces.

“ What Educators Say Needs to Change

Participants called for interventions at multiple levels. They advocated for specialized training so that educators understand generative AI and can respond effectively. They emphasized the need for student education on consent, digital ethics, and the responsible use of AI. Stronger collaboration with parents was seen as essential, since many incidents extend beyond school hours and require family involvement. Educators also looked to technology companies for better safeguards and to governments for more robust regulation that clarifies legal responsibilities and protections. Together, these recommendations point toward a coordinated, multi-stakeholder approach rather than any single fix.

“ Barriers to Implementation

Translating these recommendations into practice is difficult. Educators identified a lack of resources, including time, funding, and staff, as a major obstacle. Legal boundaries surrounding AIG-NCII remain unclear, making it hard for schools to determine what actions are permitted and how to protect both victims and accused students. Limited knowledge of AI technology further complicates efforts, since educators may not know how such images are made or how to identify them. These barriers suggest that policy guidance, accessible training, and institutional support must work together for meaningful change to occur.

“ Implications for Curriculum, Tools, and Policy

The study's findings have implications for several domains. For educational technology, there is an opportunity to design interactive tools that help educators and students understand AI misuse, consent, and digital responsibility. For curriculum design, AI literacy and ethics should be integrated into instruction in ways that address informal, real-world AI use rather than only formal classroom applications. For policymakers, schools need clear, consistent guidelines and legal clarity so that educators can act confidently. Because no single group can solve this problem alone, the research underscores the value of collaboration among educators, students, families, technology developers, and government bodies.

“ Conclusion: A Multi-Stakeholder Path Forward

AI-generated non-consensual intimate imagery is an emerging challenge that schools are struggling to address. Educators recognize the seriousness of the problem and the harm it causes to students, yet they often lack the policies, training, and resources needed to respond effectively. By amplifying educators' voices, this research highlights concrete gaps and points toward practical solutions across education, technology, and governance. Protecting students in an age of accessible generative AI will require coordinated action from all stakeholders, grounded in clear policies, informed education, and a shared commitment to consent and dignity.

 Original link: https://arxiv.org/html/2604.06131v1

Comment(0)

user's avatar

      Related Tools