R&D Hub

The NAEP research community was hard at work in 2024 exploring new ways to deepen our understanding of student academic achievement and assessment in the United States. We here at the NAEP R&D Hub have shared it all along the way, highlighting the work of innovative researchers (especially in emergent fields such as AI), disseminating news about new and improved tools for researchers, and bringing awareness to relevant conference opportunities and presentations. As we enjoy the holiday season and look forward to a new year and new NAEP internship opportunities, we’d like to look back on some of the NAEP R&D Hub highlights of 2024.

Explore the latest insights in research and development from NAEP researchers in the R&D program. Given the current buzz around AI, this month we’re excited to share a working paper on the evaluation of chatbots by Ruhan Circi and Bhashithe Abeysinghe, NAEP researchers from the American Institutes for Research (AIR). The full text of the working paper is included below. Don’t miss out on these valuable perspectives – subscribe now to stay ahead in technology and innovation!

Those interested in process data in digitally based assessments (DBAs) will want to check out the newest addition to the Focus on NAEP series: “Exploring Process Data in TEL.” This examination of process data from the 2014 Technology and Engineering Literacy (TEL) assessment explores how data collected from digitally based assessments can be used to investigate digital familiarity and efficiency.

NAEP Center for Process Data Researchers Ruhan Circi and Juanita Hicks won the 2023 Educational Measurement: Issues and Practice (EM:IP) Cover Graphic/Data Visualization Competition. Their visualization comparing traditional data and process data measurements of the percentages of students who did not reach an item in a NAEP assessment was featured on the cover of the most recent EM:IP issue, published in September.

NAEP Process Data Researcher Dr. Ruhan Circi will present on Thursday, November 9, and Saturday, November 11, 2023, at the Association for Public Policy Analysis & Management (APPAM) 2023 Fall Conference in Atlanta, Georgia.