This Article Full Text (PDF) References Alert me when this article is cited Alert me if a correction is posted Citation Map Services Email this article to a friend Similar articles in this journal Similar articles in Web of Science Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via HighWire Citing Articles via Web of Science (7) Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Michell, J. Search for Related Content Social Bookmarking                         What's this?

Item Response Models, Pathological Science and the Shape of Error

Reply to Borsboom and Mellenbergh

University of Sydney, joelm{at}psych.usyd.edu.au

There is nothing in Borsboom and Mellenbergh’s (2004) response that refutes my thesis that psychometrics is a pathology of science. They seek to defend item response models from my charge of pathological science without apparently realizing that my charge relates to psychometricians, not to models. They appeal to the Quine-Duhem thesis in an attempt to argue that item response models do not allow the hypothesis that psychological attributes are quantitative to be tested in isolation, but their argument is based upon a misinterpretation of Duhem. In any experiment, what is being tested depends on what the experimenter already takes to be true, and it is possible that a psychometrician could be testing just one of the hypotheses constituting an item response model. Furthermore, using the theory of conjoint measurement, it is possible to isolate predictions that depend upon psychological attributes being quantitative, as opposed to merely ordinal. Despite this, Borsboom and Mellenbergh agree with the first part of my thesis. They do not discuss the second part, but an examination of textbooks on item response models shows that psychometricians disguise their failure to test the hypothesis that psychological attributes are quantitative by simply declining to mention that this hypothesis is presumed in their models. Claims to measure psychological attributes based upon these models depend exclusively upon the weakest part of these models: the hypothesis that the distribution of ‘errors’ takes a specific form.

Key Words: item response models • pathological science • psychological measurement • psychometrics • quantification

Theory & Psychology, Vol. 14, No. 1, 121-129 (2004)
DOI: 10.1177/0959354304040201


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?

This article has been cited by other articles:

				G. Trendler Measurement Theory, Psychology and the Revolution That Cannot Happen Theory Psychology, October 1, 2009; 19(5): 579 - 599. [Abstract] [PDF]

				A. Kyngdon The Rasch Model from the Perspective of the Representational Theory of Measurement Theory Psychology, February 1, 2008; 18(1): 89 - 109. [Abstract] [PDF]