AI’s Growing Influence in Schools Raises Questions on Relationships and Data Privacy
Recent findings reveal a surprising intersection between technology and teenage life, where artificial intelligence (AI) is not just a tool for education but also a companion. Nearly 20% of high school students report either being in or knowing someone in a romantic relationship with AI, according to a new survey. Additionally, 42% of respondents acknowledge using AI for companionship.
This data comes from a study by the Center for Democracy and Technology (CDT), which advocates for civil rights and the responsible use of technology. The study surveyed approximately 800 teachers, 1,000 students, and 1,000 parents from public schools across the nation, revealing that a significant majority—86% of students, 85% of educators, and 75% of parents—engaged with AI during the last academic year.
Elizabeth Laird, a co-author of the CDT report, notes a clear correlation between the extent of AI use in schools and students’ perceptions of AI. “The more ways that a student reports that their school uses AI,” Laird explains, “the more likely they are to report things like ‘I know someone who considers AI to be a friend,’ ‘I know someone who considers AI to be a romantic partner.'”
Data Breaches, Deepfakes, and Eroding Trust
Higher AI usage in educational settings is linked to increased risks, including data breaches and the creation of deepfakes—manipulated media that can lead to sexual harassment and bullying. Laird points out, “This technology is a new vector for sexual harassment and bullying, which were long-standing issues [before widespread use of AI], and this has become a new way to exacerbate that.”
The report highlights that 28% of teachers who incorporate AI extensively in their educational tasks have witnessed large-scale data breaches, compared to just 18% among those who use AI minimally. Laird, who once served as a data privacy officer, emphasizes the risk associated with sharing data with AI systems, stating, “AI systems take a lot of data, they also spit out a lot of information too.”
Teachers employing AI frequently also report technical failures in AI systems and a decline in community trust due to AI’s presence in schools. Laird shares concerns over AI-powered surveillance on school devices, leading to false alarms and even student arrests. This surveillance poses greater risks for students unable to afford personal devices, as they have less privacy.
Risks to Student Wellbeing
Students in AI-intensive schools are more likely to use AI for mental health support, companionship, escapism, and even romantic relationships. A notable 31% of these students use school-provided devices for personal interactions with AI.
Laird stresses, “I think students should know that they are not actually talking to a person. They are talking to a tool, and those tools have known limitations.” The research indicates that students’ understanding of AI is basic, with only 11% of teachers having received training on handling students’ potentially harmful use of AI.
While some educators find AI beneficial for teaching and time management, students express concerns, feeling that AI use makes them feel less connected to their teachers. Laird notes, “What we hear from students is that while there may be value in this, there’s also some negative consequences that are coming with it, too.” She emphasizes the need to heed student feedback to harness AI’s potential benefits responsibly.
