Should metacognition be measured by logistic regression?

Kurzfassung/Abstract

Are logistic regression slopes suitable to quantify metacognitive sensitivity, i.e. the effi- ciency with which subjective reports differentiate between correct and incorrect task responses? We analytically show that logistic regression slopes are independent from rat- ing criteria in one specific model of metacognition, which assumes (i) that rating decisions are based on sensory evidence generated independently of the sensory evidence used for primary task responses and (ii) that the distributions of evidence are logistic. Given a hier- archical model of metacognition, logistic regression slopes depend on rating criteria. According to all considered models, regression slopes depend on the primary task criterion. A reanalysis of previous data revealed that massive numbers of trials are required to dis- tinguish between hierarchical and independent models with tolerable accuracy. It is argued that researchers who wish to use logistic regression as measure of metacognitive sensitivity need to control the primary task criterion and rating criteria.