I/O Psychology Needs to Grow Up

In line with a common thread through my blogs, I draw into question the notion that I/O psychology is indeed a science, let alone a pure science. The tag of a science is, in my opinion, a hindrance to our discipline’s progress. A selection of links to an I/O forum, posted by Professor Paul Barrett which when reviewed together, demonstrate the failures of psychology as a science or quantitative discipline. Extracts from these posts include:

Postman, N. (1984). Social science as theology. ETC: A Review of General Semantics, 41(1), 22-32.

‘….science is the quest to find the immutable and universal laws that govern processes, and it does so by making the assumption that there are cause and effect relations among these processes. The scientist uses mathematics to assist in uncovering and describing the structure of nature. At best, the sociologist, to take one example, uses mathematics merely to provide some precision to his ideas…I must tell you at the start that I reject the implications of the phrase ‘social science’ that is to say, I do not believe psychologists, sociologists, anthropologists, or media ecologists do science. I am fully persuaded that Michael Oakeshott’s distinction between processes and practices is definitive in explaining why this is the case … I believe with Oakeshott that there is an irrevocable difference between a blink and a wink. If it is a blink, we can classify the event as a process, meaning it has physiological causes which can be understood and explained within the context of established postulates and theories. If it is a wink, we must classify it as a practice, filled with personal and to some extent unknowable meanings and, in any case, quite impossible to explain or predict in terms of causal relations’.

Lilienfeld, S. (2010). Can psychology become a science? Personality and Individual Differences, 49(4), 281-288.

Abstract 
I
 am profoundly grateful to Tom Bouchard for helping me learn to think scientifically. Scientific thinking, which is characterized by a set of safeguards against confirmation bias, does not come naturally to the human species, as the relatively recent appearance of science in history attests. Even today, scientific thinking is in woefully short supply in many domains of psychology, including clinical psychology and cognate disciplines. I survey five key threats to scientific psychology – (a) political correctness, (b) radical environmentalism, (c) the resurrection of ‘common sense’ and intuition as arbiters of scientific truth, (d) postmodernism, and (e) pseudoscience – and conclude that these threats must be confronted directly by psychological science. I propose a set of educational and institutional reforms that should place psychology on firmer scientific footing. 

Toomela, A. (2010). Quantitative methods in psychology: Inevitable and useless. Frontiers in Quantitative Psychology and Measurement,1, 1-14.

Abstract
Science begins with the question, what do I want to know? Science becomes science, however, only when this question is justified and the appropriate methodology is chosen for answering the research question. The research question should precede the other questions; methods should be chosen according to the research question and not vice versa. Modern quantitative psychology has accepted method as the primary focus; research questions are adjusted to the methods.

Schmitt, N. (1996). Uses and abuses of coefficient alpha. Psychological Assessment, 8(4), 350-353. and Barrett, P.T. and Paltiel, L. (1996). Can a single item replace an entire scale? POP vs the OPQ 5.2. Selection and Development Review, 12(6), 1-4.

These papers demonstrate the problems with the use of the 0.7-0.8 rule (for internal consistency) as a measure of an assessments quality.

Hurlbert, S.H., & Lombardi, C.M. (2009). Final collapse of the Neyman-Pearson decision-theoretic framework and the rise of the neoFisherian. Annales Zoologici Fennici, 46, 311-349.

The neoFisherian approach in a nutshell. From page 318, column, 1, 3rd paragraph:

A core principle of this neoFisherian paradigm, then, is that in testing situations, an alpha should not be specified, and terms such as ‘statistically significant’ and ‘statistically non-significant’ should not be used, nor should useless and misleading symbolic notation such as ‘ns’ and ‘P > 0.05’. The neoFisherian label seems appropriate for three reasons. First, Fisher clearly was moving toward this position at the end of his career. Second, his original conception of significance testing did not require specification of a critical P value even though he appended that superfluity to it for reasons essentially psychological, historical and accidental in nature. And third, other concepts formalized by Neyman and Pearson but that we regard as admissible under the neoFisherian paradigm — such as alternative hypotheses, power, and confidence intervals — were all implicit in Fisherian significance testing regardless of what Fisher said about them or of how unsuccessful his idea of “fiducial intervals” proved to be. 

Advertisements

3 thoughts on “I/O Psychology Needs to Grow Up

  1. Paul Wood

    Interesting post…we only need to look to the history of mental disorder classification to be humbled by psychology’s tendency towards pseudo-science. The diagnosis of drapetomania is my favourite example. Drapetomania was the mental disorder thought to explain the irrationality of black slaves trying to escape their white masters! I personally think Thomas Kuhn’s (1962) the structure of scientific revolutions should be required reading for anyone involved in any field claiming allegiance to science http://des.emory.edu/mfp/Kuhn.html Hopefully this will promote a healthy sense of uncertainty and lead more researchers and practitioners to question their own “knowledge” and the value of a slavish devotion to the status quo…

    Reply
    1. drpaulatopra Post author

      I agree Paul and believe there a range of required readings for those critical of our discipline. One that I’m throughly enjoying at the moment is the ‘Cult of Personality Testing by Annie Murphy Paul’. This shows how the historical context is so important to understand as to how all this mumbo-jumbo becomes confused with science.

      Our discipline is not art or science but is a ‘craft’. Should be the domain of skilled practioners who have the knowledge and skills to create real solution. It is a blend of science and application. The sooner we lose the dominance of science our discipline and position science correctly in our craft the sooner the discipline will flourish

      Reply

Please Comment!

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s