White Papers

The Analytics for Learning (A4L) Measurement in Digital Environments White Papers Series outlines emerging approaches for measuring hard-to-measure constructs using data from digital learning environments. Common across these papers is the use of evidence-centered design (ECD), which provides a framework for aligning the evidence that is collected inside and outside of digital learning environments to the tasks in which students are engaged and the objects of measurement stemming from those tasks. Across these 14 papers, affective states, collaborative problem solving, wheel-spinning, programming behaviors, cognitive presence, writing quality, self-regulated learning behaviors, mind wandering, off-task behaviors, carelessness, and help seeking are all taken up as objects of measurement. As an example community and capacity building activity for the learning analytics and educational data mining communities, these papers represent valuable illustrations of how to leverage data collected by digital learning environments.

Allen, L. K. (2017). Investigating affect in writing from an evidence-centered design perspective. Measurement in Digital Environments White Paper Series. Menlo Park, CA: SRI International.

Cukurova, M., Mavrikis, M., & Luckin, R. (2017). Evidence-centered design and its application to collaborative problem solving in practice-based learning environments. Measurement in Digital Environments White Paper Series. Menlo Park, CA: SRI International.

Gogel, H., & Nehama, S. (2017). Visualizing pain points in an online course. Measurement in Digital Environments White Paper Series. Menlo Park, CA: SRI International.

Hicks, D., Eagle, M., & Rowe, E. (2017). Using interaction networks to identify unproductive solution steps in multistep problems. Measurement in Digital Environments White Paper Series. Menlo Park, CA: SRI International.

Hosseini, R. (2017). Assessing programming behaviors through evidence-centered design. Measurement in Digital Environments White Paper Series. Menlo Park, CA: SRI International.

Joksimović, S., Gašević, D., Bayne, S., Hatala, M., & Dawson, S. (2017). Studying learning in nonformal digital educational settings. Measurement in Digital Environments White Paper Series. Menlo Park, CA: SRI International.

Kovanović, V., Gašević, D., Hatala, M., & Siemens, G. (2017). A novel model of cognitive presence assessment using automated learning analytics methods. Measurement in Digital Environments White Paper Series. Menlo Park, CA: SRI International.

Kyle, K. (2017). Modeling quality in source-based writing tasks. Measurement in Digital Environments White Paper Series. Menlo Park, CA: SRI International.

Lee, J-E., & Recker, M. (2017). Measuring students’ use of self-regulated learning strategies from learning management system data: An evidence-centered design approach. Measurement in Digital Environments White Paper Series. Menlo Park, CA: SRI International.

Mills, C. (2017). An evidence-centered design approach to mind wandering. Measurement in Digital Environments White Paper Series. Menlo Park, CA: SRI International.

Nam, S., Collins-Thompson, K., & Frishkoff, G. (2017). Modeling off-task behaviors in a meaning generation task. Measurement in Digital Environments White Paper Series. Menlo Park, CA: SRI International.

San Pedro, M. O. Z. (2017). Carelessness in online learning environments: An evidence-centered design perspective. Measurement in Digital Environments White Paper Series. Menlo Park, CA: SRI International.

Xie, J., & Hu, X. (2017). Strategies to manage errors in online mathematics tutoring. Measurement in Digital Environments White Paper Series. Menlo Park, CA: SRI International.

Zhang, N., & Biswas, G. (2017). Studying learning in non-formal digital educational settings. Measurement in Digital Environments White Paper Series. Menlo Park, CA: SRI International.

Newsletter Signup