Proceedings of the Annual Meeting of the Cognitive Science Society

Comprehensive datasets used for modeling endeavours in syllogistic reasoning research usually contain only a single conclusion per task for each subject. However, this means that no information about the other conclusions is provided, preventing the distinction between conclusions that were rejected, conclusions deemed to be valid but not the preferred conclusion and conclusions that were not considered at all. In this work, we present a multiple choice dataset containing all conclusions that participants considers valid. The data is compared to datasets with other response designs, and an extensive evaluation is performed to assess the impact of the response design on the predictive performance of cognitive models. Finally, our results are discussed and put into perspective.