The descriptions of a large number of psychic studies and their results were published in March 1976, in the journal
Proceedings of the IEEE. Together with the earlier papers, this provoked intense scrutiny in the mainstream scientific literature. Numerous problems in the overall design of the remote viewing studies were identified, with problems noted in all three of the remote viewing steps (target selection, target viewing, and results judging). A particular problem was the failure to follow the standard procedures that are used in
experimental psychology. Several external researchers expressed concerns about the reliability of the judging process. Independent examination of some of the sketches and transcripts from the viewing process revealed flaws in the original procedures and analyses. In particular, the presence of sensory cues being available to the judges was noted. A lengthy exchange ensued, with the external researchers finally concluding that the failure of Puthoff and Targ to address their concerns meant that the claim of remote viewing "can no longer be regarded as falling within the scientific domain". Procedural problems and researcher conflicts of interest in the psychokinesis experiments were noted by science writer
Martin Gardner in a detailed analysis of the NASA final report. Also, sloppy procedures in the conduct of the EEG study were reported by a visiting observer during another series of exchanges in the scientific literature. In his book
Flim Flam! James Randi presents a detailed criticism of the methods employed by Puthoff and Targ:
Ray Hyman and James McClenon's 1980 replication study identified many of the same problems in methodology as James Randi had, particularly in the area of researchers giving subjects in remote viewing trials verbal cues that hinted at what the target images were. Although this was a small study with only eight participants, Hyman was particularly interested in how cuing from researchers affected both the subjects' answers during the trial and their attitudes toward psychic phenomena at the end of the trial. After reviewing the literature generated by researchers at SRI and conducting his own replication study, Hyman summed up his findings as, "The bottom line here is that there is no scientifically convincing case for remote viewing." Publication in scientific journals is often viewed by both the scientific community and by the public at large as a mark of legitimacy for researchers. Proponents of Puthoff and Targ claim 28 published papers, 15 of which showed positive results. An in-depth review of these papers showed that only 13 of the 28 total papers were published under commonly accepted standards of peer review. Of these 13, nine showed positive results. Three of these nine, however, were "retrospective experiments"; meaning that they were "experiments not specifically planned in advance, but apparently reconstructed from separate trials". These retrospective experiments appeared to suffer from the
sharpshooter fallacy—the creation of the target after the answers have been given. Of the remaining six studies, only two were found to show actual
statistical significance due to the use of inappropriate statistical analyses. Those remaining two studies have yet to be fully replicated. ==References==