R&D Hub

New Working Paper: Linking Sentiment to Student Test-Taking Behaviors

Published On Friday, November 15, 2024

This week, we’re able to share a new working paper, Do Survey Questions Have a Mood? Linking Sentiment to Student Test-Taking Behaviors, from NAEP researchers and co-authors Soo Lee, Ruhan Circi, and Adam Hearn. The working paper explores how test-taking behaviors are impacted by the sentiment of assessment questions, as well as how AI-powered sentiment analysis can help to analyze survey item responses such as those collected by NAEP survey questionnaires. The full text of the working paper is included below; subscribe to the NAEP R&D mailing list to stay up to date as this research develops and to access more opportunities to learn about NAEP data analysis.

New From the NAEP Validity Studies Panel: Study of Changes in Public School Composition During the Pandemic and Their Relationship With NAEP Performance

Published On Friday, October 4, 2024

In September 2024, the NAEP Validity Studies (NVS) panel published a report titled Study of Changes in Public School Composition During the Pandemic and Their Relationship With NAEP Performance, co-authored by American Institutes for Research (AIR) researchers Martin Hooper, Rebecca Shipan, David Bamat, and George Bohrnstedt.

New Research Paper on Advances and Challenges in Evaluating LLM-Based Applications

Published On Friday, June 7, 2024

This month, we are excited to share the latest research from the NAEP R&D community, focusing on the evaluation of large language models (LLMs). “The Challenges of Evaluating LLM Applications: An Analysis of Automated, Human, and LLM-Based Approaches” will be presented at the LLM4Eval workshop at the 2024 Association for Computer Machinery Special Interest Group on Information Retrieval (ACM SIGIR) conference on July 18, 2024. This paper from AIR researchers Bhashithe Abeysinghe and Ruhan Circi explores innovative approaches to evaluating custom AI applications, addressing a crucial barrier to faster progress in generative AI.

New Working Paper: Evaluating the Surge in Chatbot Development

Published On Friday, February 23, 2024

Explore the latest insights in research and development from NAEP researchers in the R&D program. Given the current buzz around AI, this month we’re excited to share a working paper on the evaluation of chatbots by Ruhan Circi and Bhashithe Abeysinghe, NAEP researchers from the American Institutes for Research (AIR). The full text of the working paper is included below. Don’t miss out on these valuable perspectives – subscribe now to stay ahead in technology and innovation!

123
«December 2024»
MonTueWedThuFriSatSun
2526272829301
2345678
9101112131415
16171819202122
23242526272829
303112345