R&D Hub

New From the NAEP Validity Studies Panel: An Exploration of Opportunity to Learn and Implications for NAEP

Published On Friday, December 13, 2024

In October 2024, the NAEP Validity Studies (NVS) panel published An Exploration of Opportunity to Learn and Implications for NAEP, a white paper co-authored by Sheila W. Valencia, James W. Pellegrino, and Richard P. Durán. The white paper explores the relationship between opportunities to learn and the interpretation of NAEP results as well as how the concept and indicators of opportunities to learn could be expanded upon to include more recent thinking around social contexts for learning in the classroom.

New Working Paper: Linking Sentiment to Student Test-Taking Behaviors

Published On Friday, November 15, 2024

This week, we’re able to share a new working paper, Do Survey Questions Have a Mood? Linking Sentiment to Student Test-Taking Behaviors, from NAEP researchers and co-authors Soo Lee, Ruhan Circi, and Adam Hearn. The working paper explores how test-taking behaviors are impacted by the sentiment of assessment questions, as well as how AI-powered sentiment analysis can help to analyze survey item responses such as those collected by NAEP survey questionnaires. The full text of the working paper is included below; subscribe to the NAEP R&D mailing list to stay up to date as this research develops and to access more opportunities to learn about NAEP data analysis.

New From the NAEP Validity Studies Panel: Study of Changes in Public School Composition During the Pandemic and Their Relationship With NAEP Performance

Published On Friday, October 4, 2024

In September 2024, the NAEP Validity Studies (NVS) panel published a report titled Study of Changes in Public School Composition During the Pandemic and Their Relationship With NAEP Performance, co-authored by American Institutes for Research (AIR) researchers Martin Hooper, Rebecca Shipan, David Bamat, and George Bohrnstedt.

New Research Paper on Advances and Challenges in Evaluating LLM-Based Applications

Published On Friday, June 7, 2024

This month, we are excited to share the latest research from the NAEP R&D community, focusing on the evaluation of large language models (LLMs). “The Challenges of Evaluating LLM Applications: An Analysis of Automated, Human, and LLM-Based Approaches” will be presented at the LLM4Eval workshop at the 2024 Association for Computer Machinery Special Interest Group on Information Retrieval (ACM SIGIR) conference on July 18, 2024. This paper from AIR researchers Bhashithe Abeysinghe and Ruhan Circi explores innovative approaches to evaluating custom AI applications, addressing a crucial barrier to faster progress in generative AI.

123
«January 2025»
MonTueWedThuFriSatSun
303112345
6789101112
13141516171819
20212223242526
272829303112
3456789