| reflectR {reflectR} | R Documentation |
Automatic Scoring of the Cognitive Reflection Test
Description
The reflectR package provides automated coding tools for open-ended responses to various forms of the Cognitive Reflection Test (CRT). This package facilitates the standardization of Cognitive Reflection Test responses analysis across large datasets in cognitive psychology, decision-making, and related fields. By automating the coding process, it not only reduces manual effort but also aims to reduce the variability introduced by subjective interpretation of open-ended responses, contributing to a more consistent and reliable analysis.
Details
The package includes functions to code responses from:
-
CRT: Original CRT version by Frederick (2005) -
CRT4: 4-item CRT version by Toplak et al. (2014) -
CRT7: 7-item expanded CRT version by Toplak et al. (2014) -
CRTlong: CRT LONG version by Primi et al. (2016) -
CRTtwo: CRT version 2 by Thomson & Oppenheimer (2016) -
itaCRTtwo: Italian version of CRT version 2 by Thomson & Oppenheimer (2016)
Note
While reflectR draws inspiration from the scientific literature on the CRT, it has been independently developed and does not hold any affiliation with the original authors of these tests.
Acknowledgments
The development of this package benefited significantly from the kind insight and suggestion provided by Dr. Keela Thomson, whose contribution is gratefully acknowledged. Special thanks are also due to Dr. Paolo Giovanni Cicirelli, Prof. Marinella Paciello, Dr. Carmela Sportelli, and Prof. Francesca D'Errico. Acknowledgment is also due to the European project STERHEOTYPES for funding the data collection that produced the datasets initially used for manual multi-rater coding of CRT-2 items.
Author(s)
Maintainer: Giuseppe Corbelli giuseppe.corbelli@uninettunouniversity.net (ORCID: 0000-0002-2864-3548)
References
Frederick, S. (2005). Cognitive Reflection and Decision Making. Journal of Economic Perspectives, 19(4), 25-42. doi:10.1257/089533005775196732
Toplak, M. E., West, R. F., & Stanovich, K. E. (2014). Assessing miserly information processing: An expansion of the Cognitive Reflection Test. Thinking & Reasoning, 20(2), 147-168. doi:10.1080/13546783.2013.844729
Primi, C., Morsanyi, K., Chiesi, F., Donati, M. A., & Hamilton, J. (2016). The development and testing of a new version of the Cognitive Reflection Test applying item response theory (IRT). Journal of Behavioral Decision Making, 29(5), 453-469. doi:10.1002/bdm.1883
Thomson, K. S., & Oppenheimer, D. M. (2016). Investigating an alternate form of the cognitive reflection test. Judgment and Decision Making, 11(1), 99-113. doi:10.1017/s1930297500007622
See Also
Useful links: