The Committees on Technology and Education, chaired by Council Members Carmen N. De La Rosa and Eric Dinowitz, held an oversight hearing on artificial intelligence, student data, and privacy in NYC public schools. The hearing examined the Department of Education's (DOE) March 2026 AI guidance, the rapid proliferation of AI tools, data privacy concerns, and proposed legislation requiring studies on access to gifted and talented and special education programs, as well as reporting on algorithmic tools and data breaches. No votes were taken; all introductions were laid over.
Good afternoon. Welcome to today's New York City Council hearing for the Committee on Education. Join with the Committee on Technology. Please sign so all cell phone and electronic devices. And as a friendly reminder, do not approach the days. If you wish to testify today, please fill out an appearance card. One of the sergeant at arms. Without further ado, chairs, we are ready to begin. Thank you. Good afternoon, everyone. I'm Council Member Eric Dinowitz, New York City Public School alum, although with a different signature on my diploma. Public School Special Education Teacher and Chair of the Committee on Education, and I am excited to be joined by my friend from the South, Chair of the Committee on Technology, Council Member Delarosa for today's hearing on artificial intelligence, student data and privacy in New York City public schools. Today's hearing will examine the landscape of AI use in New York City public schools, particularly as it relates to academic integrity and student data and privacy. The rapid proliferation of AI tools has sparked intense citywide debate about the role of and use of AI in schools. In May, DOE issued preliminary guidelines for AI in public schools, but the guidance has faced strong opposition from parents and advocacy groups alike. Many council members, including myself, and numerous community education councils have gone as far as calling for a two-year moratorium on the use of student-facing AI in schools. They point to ongoing worries about data privacy breaches and lack of transparency. And very troublingly for me as a former teacher, cognitive offloading and algorithmic bias. Others, however, argue that the question of allowing AI in schools is no longer relevant. National survey data show that the majority of students are using some form of AI for school-related activities. Instead, they argue the question should be: how do we harness it safely, equitably, and effectively for our students? Underlying this debate is the issue of data collection by third-party vendors and whether DOE's policy aligns with national standards. A 2026 audit by the state controller found that DOE does not have a documented data classification policy and does not maintain a comprehensive list of all application used by each school. With a number of high-profile data breaches, including the power school breach that exposed personally identifiable information for tens of millions of students and educators nationwide. Questions remain around what information is being collected about students and who has access to this information. Now, as someone who doesn't even believe calculators should be used in elementary school classrooms, I look forward to hearing today about how DOE is planning to protect student data, plans for updated DOE guidelines and AI, and how DOE plans to ensure academic integrity and rigor in light of AI. I'd now like to turn it to Chair Della Rosa for opening remarks. Thank you so much. Good afternoon, everyone, and welcome to our hearing. Technology has become an unavoidable part of our lives, with artificial intelligence changing the way we work, learn, and make decisions. This is why we have an obligation to ensure that innovation serves people and that technological progress is guided by accountability, transparency, safety, and public interest. Artificial intelligence tools, artificial intelligence tools are used by the Department of Education in its daily operations, as well as in classrooms. The use of AI in education has raised concerns that it may affect students' critical thinking and compromise the traditional learning process. Another concern that people have related to digit is related to digital privacy, safety, and equality. Some AI tools use personal data as training data. That data could include students' information such as names, dates of birth, behavioral analytics, medical history, family income, ethnicity, and even facial geometry. Without proper safeguards, this information could be used to profile students, predict or surveil their behavior, or make assumptions about their abilities and future opportunities. This information can also be breached. In fact, based on a recent New York State Comptroller's report, between January 2023 and February 2025, DOE experienced 141 data breaches incidents. Based on our conversations and public reporting, some tools used by the DOE may collect data without parents' knowledge or consent. While AI may offer potential benefits in education, its ethical use must be must be carefully considered. Many tools may have bias and as a result discriminate against certain students or communities. From the technology committee's perspective, safeguards against bias in AI algorithms and protecting student privacy are fundamental issues that must be addressed. Today, we wish to discuss both how AI should fit into the curriculum and how the Department of Education uses AI in its operations. We need to make sure that AI supports students and teachers rather than undermining the quality of education. We must ensure that we are preparing the next generation to thrive in this technological era while also protecting the rights and future opportunities. Like Chair Dinowitz, I also joined my colleagues in signing on to a letter from our school communities, and we've heard from our CCs calling on a two-year moratorium. We look forward to hearing testimonies from the Department of Education and OTI to gain insight and clarity around the many questions about AI in the classroom and the use of AI in the education system. We also look forward to hearing from members of the public, students, families, educators, and advocates. Unfortunately, neither the chief privacy officer nor the representatives of the newly established Office of Algorithmic Accountability are here today.