Institute of Science, Technology and Public Policy  
   

For further information, contact

Institute of Science,
Technology and
Public Policy

1000 North 4th Street
Fairfield, IA 52557

Phone 641-472-1200
Fax 641-472-1165
Email istpp@mum.edu
Website www.istpp.org

Printer Friendly Page
Voodoo Science: The Road from Foolishness to Fraud

by Robert L. Park
Published by Oxford Press, 2000

Reviewed by Maxwell Rainforth, Ph.D.

Scientists are not generally renowned for communicating their ideas in plain English to lesser mortals. But Robert Park, a highly credentialed physicist and member of the scientific establishment, is also chief lobbyist for the American Physical Society and a writer of op-ed pieces. No ordinary scientist, Park has apparently discovered a formula for writing a popular book about science: find a parade of scientists and inventors whose ideas are controversial, add sarcasm, innuendo and a whiff of scandal — and bingo, you’ve got a moneymaker.

Fortunately for Professor Park, there is no shortage of individuals and ideas that are not accepted by mainstream science, and who are readily prosecuted by his quick wit. He coins the term “voodoo science” as a label with which to tar them all with the same brush. The phrase is convenient rubric that is meant to cover a variety of forms of scientific misconduct, whether unconscious or deliberate: “pathological science” [where researchers fool themselves that routine findings are great discoveries], “junk science” [experts misusing scientific theories and terminology to fool lay people], “pseudoscience” [superstition and humbug in scientific disguise], and “fraudulent science” [deliberate advancement of false scientific claims]. His targets run the gamut from advocates of alternative medicine, to proponents of cold fusion, to believers in UFO’s.

As the author points out, science is supposed to sort out truth from fiction. Not all claims that purport to be scientific are valid, and even scientists sometimes fool themselves about the strength of evidence supporting their theories. Park attributes the basic cause of scientific misconduct to human folly among scientists: “What may begin as honest error . . . has a way of evolving through almost imperceptible steps from self-delusion to fraud. The line between foolishness and fraud is thin.” Unfortunately, in his treatment of the material of the book, at times he treads this fine line himself.

Nowhere in the book does he do so more brazenly than in his coverage of research by Dr. John Hagelin, himself a reputed quantum physicist, and his research on the application of the Transcendental Meditation program to reducing stress and improving trends in society.

Park’s critique of Hagelin’s study opens by attempting to discredit Hagelin as one who has rejected the norms of mainstream science. Park states that in 1983 Hagelin was “regarded as a competent theoretical physicist” while holding a research appointment at Stanford Linear Accelerator but “then in the midst of personal problems, he simply vanished, reappearing a year later as chairman of the Physics Department at Maharishi International University (MIU) in Fairfield, Iowa.”

The alleged vanishing act and personal problems are pure fiction created by Park. Dr. Hagelin shifted his academic appointment from Stanford University to MIU for scientific reasons. It enabled him to continue his physics research and to pursue his long-standing interest in brain and cognitive science research. He took up his new appointment directly after leaving his position at Stanford Linear Accelerator, and he remained in close contact with his former colleagues at Harvard, Stanford and CERN. These scientists, including many at the forefront of physics, published numerous scientific articles with Dr. Hagelin as he continued his contributions to theoretical physics while at MIU, funded by competitive scientific grants from the National Science Foundation. Hagelin has published 74 scientific articles on unified quantum field theories and related topics, including some of the “most cited references in the physical sciences,” to quote Current Contents magazine, which follows such trends. By making these unfounded and defamatory statements against a well-credentialed scientist, Park clearly placed himself outside the bounds of responsible scientific discourse.

The main focus of Park’s attack on Hagelin is his leading role in a large-scale social experiment during the summer of 1993 to reduce violent crime in Washington, D.C. Hagelin’s experiment tested the following hypothesis: that a large group of meditation experts, practicing together, can reduce stress and tension in the social atmosphere, and thus reduce violent crime. Based on many previous studies on the Transcendental Meditation program (TM), a widely practiced and thoroughly researched method of stress reduction, it was predicted that such a group would produce a measurable calming influence in the city, resulting in reduced “Part I” violent crime, as defined by the FBI. The predicted outcomes of the experiment were announced publicly to the media, and were lodged in advance with a 27-member panel of scientists and civic leaders. The results were published in Social Indicators Research, a respected, peer-reviewed, scientific journal (Hagelin et al., 1999).

Park charges Hagelin and the study’s co-authors with “pseudoscience,” but this accusation is based on a critique that is superficial, highly polemical, and seriously flawed. His article contains not a single statistic and betrays no evidence that he ever read the study.

Park’s book urges protection against promulgation of flawed scientific ideas by subjecting them to proper experimental testing: “The success and credibility of science are anchored in the willingness of scientists to . . . (1) expose new ideas and results to independent testing and replication . . . (2) abandon or modify accepted facts or theories in the light of more complete or reliable experimental evidence.”

Yet Park appears to feel the hypothesis of Hagelin’s study is ridiculous on its face, and that no serious investigation of the claim is necessary. In the context of dismissing Hagelin’s study, Park quotes H.L. Mencken: “The most common of all follies is to believe in the palpably untrue.” In other words, Park maintains that it should have been obvious at the outset that the theory being tested was false, so why bother to examine the evidence? Apparently he believes that ideas that do not tally with the current scientific paradigm can be written off without serious consideration. This is remarkable, given Park’s advocacy of scientific objectivity and careful scrutiny of evidence. Given the laudable aim of promoting truth in science, one would hope the book itself would be a fine example of the honesty, open-mindedness, and careful evaluation of evidence that the author so strongly advocates.

The problem here is one that arises whenever science is confronted with novel or unconventional ideas. The history of science shows that new theories are often controversial and initially fall outside the realm of what is considered mainstream science. Theories are profoundly new only when they introduce new ways of thinking. If the theoretical ideas in question are already orthodox, they are unlikely to have a revolutionary impact. The great advances of twentieth century physics — quantum mechanics and general relativity theory — were regarded with great skepticism by physicists for many decades. Einstein received his Nobel prize, not for any of his contributions to these areas, but for his explanation of Brownian motion, a phenomenon which fit within the old paradigm of classical mechanics. Marconi, the discoverer of radio waves, and Tesla, who pioneered the development of electrical devices, were regarded as crackpots by their contemporaries. The list goes on and on. But Park states that: “When better information is available, science textbooks are rewritten with barely a backward glance.” If only the upward and onward march was so smooth! As Thomas Kuhn pointed out thirty years ago, scientists have prejudices like the rest of us, as Park unfortunately shows.

What chance is there that groups practicing Transcendental Meditation can reduce violent crime? If Park had been interested in a serious scientific discussion of this question, he should certainly have mentioned that:

  • Extensive published research has shown that, for the individual, the Transcendental Meditation technique reduces stress, anxiety and hostility more effectively than any other technique tested to date.
  • The generalization of this reduction of stress and hostility from individuals to societies — when large groups practice both Transcendental Meditation and the TM-Sidhi program together — had been documented in more than a dozen scientific studies which had previously been published in mainstream, peer-reviewed academic journals. At the least, such previous research would indicate that the Washington, DC study should have been carefully analyzed.
  • In that Washington DC study, violent crimes against the person (assaults, rapes, and murders) decreased by 23% from statistically predicted levels — in the very months when, due to high temperatures, violent crimes usually reach their highest levels. Moreover, it is plainly evident from the raw data, before any statistical analysis is made, that crime levels were lower at the end of the experimental period compared to the beginning.

Park’s failure to mention any of these facts in his book can be attributed to only two factors: ignorance or bias — neither of which is acceptable from a responsible scientist, particularly one who takes a strong stand.

In his book, Park puts forward the specious claim that the D.C. experiment was a failure. Yet total violent crimes not only decreased during the 8 weeks of the experiment, but also closely tracked the rise in the number of participating TM meditators, as predicted. The 23% drop in violent crime was confirmed to be statistically significant using time series analysis: the probability that the decrease was due to chance is less than two in a billion.

Park rejects out of hand statistical modeling of the data using time series analysis, because to do otherwise would be to give credence to this main scientific finding of the study. Time series analysis is a sophisticated statistical tool for investigating whether factors other than the presumed causal variable might account for the results. Hagelin’s study used time series analysis to rule out a long list of alternative explanations, including weather variables, seasonal effects, changes in police surveillance, and trends and cyclical patterns inherent in the crime data. If this had not been done, then Park would have had concrete grounds for attacking the research methodology.

Instead, Park merely lampoons Hagelin’s study, purporting that the use of time series analysis was “technobabble,” only “meant to give the appearance of science.” Park’s only allusion to the overall study finding is to complain about the use of time series analysis, which is clearly the correct statistical tool in this type of study. He waves away the evidence and state-of-the-art statistical analysis, proclaiming that “It was a clinic in data distortion,” with no supporting data or analysis for that assertion, and makes not another comment about it.

He concludes that: “This was pseudoscience . . . which is not to say that those involved were not sincere in their belief. They may have believed so fervently that they felt a responsibility to make the facts support their belief” [emphasis in the original]. In other words, Park makes the unfounded claim that the researchers falsified evidence — evidence supplied by the Washington, D.C., police. With high-handed condescension he acknowledges the “sincere belief” of the researchers, while making the most serious charge of scientific misconduct. These statements amount to a charge of scientific fraud. His statements are an insult to the integrity of the researchers, the Project Review Board, the editors and reviewers of Social Indicators Research, and the District of Columbia Metropolitan Police Department’s statistician, who provided the FBI crime data and co-authored the study.

Park’s objection to our use of time series analysis is not based on any scientific argument, but merely echoes the comments of a reporter regarding the use of time series analysis to predict levels of violent crime: “How could you know what the rates would have been?” But, there is no mystery here. Violent crime levels are predictable on the basis of 1) prior crime trends, and 2) temperature — a fact that is well known among criminologists, and that was clearly explained at the press conference that Park attended, as well as in the published paper.

This shows up clearly in a graph of the Washington data over the five years prior to the experiment (1988-1992). When average levels of temperature and average levels of homicides, rapes and assaults are plotted over weeks of the year, the crime and temperature curves are right on top of each other, if the vertical axis scales are appropriately chosen. This shows that violent crime levels were directly proportional to temperature — and that violent crime can be accurately predicted from the temperature and previous crime data. The same phenomenon occurs in the first months of 1993, but then in the middle of the experimental period (when the meditating group was approaching its maximum size) the violent crime curve drops well below the predicted curve — and stays low for several weeks. In other words, during the experiment in 1993, a drop in violent crime was clearly evident in the raw data, even without using time series analysis.[1]

Park objects to our calculation of how much violent crime dropped. Firstly, this calculation was an adjunct step performed after the time series analysis, and therefore challenging it does not contradict our main result: A reduction in violent crime is evident in the raw data, before any statistical analysis. Therefore, our main finding is unassailable. Second, the amount of reduction is calculable because, as we have seen, violent crime levels are predictable on the basis of temperature. Moreover, as our published paper clearly demonstrates, and as Park should have known, the calculated drop in violent crime is extremely robust, and not at all sensitive to the assumptions of the statistical model used.

However, Robert Park abstains from any serious discussion of the data and gives no consideration whatsoever to the appropriateness of the statistical methodology used to analyze it. And despite Park’s emphasis on the importance of scientific replication of experimental findings, he neglects to mention that the Washington crime experiment was consistent with 41 previous studies of the effects of Transcendental Meditation on social quality-of-life variables.

In spite of the evidence, Park asserts that levels of violence actually increased to record levels. He confuses homicides — which accounted for only 3% of violent crime in Washington during 1993 — with violent crimes in general. Even in this instance he omits all data and relies on emotional and inaccurate characterization. Park asserts that the murder rate soared during the experiment, and claims that “participants in the project seemed serenely unaware of the mounting carnage around them.”

It is true the murder rate did not drop during the course — as we acknowledged in the initial research report and in the published study — but the facts were very different from Park’s characterization. For six weeks ending the month before the experiment, from mid-March through April, homicides in Washington averaged ten per week. Beginning one week after the course and for twelve weeks thereafter, homicides also averaged ten per week. During the eight weeks of the experiment, in June and July, the average was again ten per week — except for one horrific 36-hour period in which ten people died. Apart from this brief episode, which was a statistical outlier, the level of homicides during June and July of 1993 was not significantly higher than during the remainder of the year[2].

According to his article, Park apparently took his lead on the murder issue from a Washington Post reporter who had been impressed that this one 36-hour period had led to a doubling of the murder rate that week. The reporter, and Park, did not notice that the very next week the murder rate dropped from its average rate of ten by more than twice — that is, the totals went up to 20 one week and down to 4 the next. This is precisely the type of random fluctuation one must account for when total numbers are small. The average incidence of murder in Washington was little more than one per day, and with numbers as low as this, as Park and all scientists know, random fluctuations can appear extremely high when listed as percentages.

Another type of violent crime with low incidence is rape, yet Park makes no mention of this, perhaps because during the two months of the experiment, rapes decreased by 58%. If Park were interested in an accurate presentation, he should surely have balanced his statistic-free assertion of a murder wave with this arresting fact. The most comprehensive measure of deliberate violence, of course, includes assaults (the most common aspect of violent crime, which accounted for 92% of the study’s outcome variable) along with rapes and murders-which together declined by 23%. Park’s brouhaha about the murder rate is to distract the reader’s attention from the main issue: whether a group of people practicing the Transcendental Meditation program achieved a reduction in violent crime.

Park bemoans that “simplistic arguments and homespun humor are more effective in a debate than citing the laws of thermodynamics” (p. 42-43.) But, as Professor Park has discovered, ridicule makes good theatre, if not good science. And popular writing, not scientific writing, sells popular books.

Unfortunately, the precepts of good science that Park exhorts others to follow are sometimes violated in his own treatment of his material, as shown in the example of Hagelin’s research. The book contains no footnotes that would allow an inquiring reader to check on the “facts” that the author presents. Moreover, in some places the book is so one-sided in its evaluation of evidence that it falls into the very kinds of errors in reasoning that it decries. In setting out to be a popular book, the author adopts the language of persuasion to demonize his targets; it is not written in the even-handed style of scientific writing. Indeed, the presentation style in his book is a model of how not to conduct a careful, dispassionate evaluation of scientific issues.

Park’s unsupported charges represent a gross attempt to mislead the reader, which in itself is highly unethical from a scientific standpoint. This may be surprising given the author’s credentials: former chairman of the Department of Physics at the University of Maryland, and director of the Washington office of the American Physical Society. Given the laudable aim of promoting truth in science, one would hope the book would itself be a fine example of the honesty, open-mindedness, and careful evaluation of evidence that the author so strongly advocates.

When scientists fail to evaluate evidence of scientific studies on their merits, they mislead the public about science. As he is a professor at a major university, most lay readers would be likely to take Park’s “expert” opinions at face value. In this regard, his willfully misleading statements are highly irresponsible. Ironically, Park set out to expose deliberate attempts of scientists to mislead non-experts. In attempting to label Hagelin’s research as an example of scientific misconduct, his book merely provides a further example of such scientific deception of an unfortunately common type: misguided attacks on novel scientific theories based on blind disregard of evidence.

Reference

Hagelin, J.S., Rainforth, M.V., Orme-Johnson, D.W., Cavanaugh, K.L., Alexander, C.N., Shatkin, S.F., Davies, J.L., Hughes, A.O., and Ross, E. 1999. Effects of group practice of the Transcendental Meditation program on preventing violent crime in Washington, D.C.: Results of the National Demonstration Project, June-July, 1993. Social Indicators Research, 47(2): 153-201.

END

[1] The analysis reported in the published paper ruled out the possibility that this could have been due to seasonal effects, because a significant reduction during the summer in violent crime levels compared to the expected levels did not occur during any of the five years prior to the experiment.

[2] After removing the outlier of June 22, Poisson regression analysis indicated there was no significant difference in the level of homicides in June and July 1993 from the remainder of the year.

Back to Top