There is some debate over the neutrality of Freedom House and the methodology used for the
Freedom in the World report, which has been written by Raymond Gastil and his colleagues. The neutrality and biases of human-rights indices have been discussed in several publications by Kenneth A. Bollen. Bollen wrote that "Considered together these criticisms suggest that some nations may have been incorrectly rated on Gastil's measures. However, none of the criticisms have demonstrated a systematic bias in all the ratings. Most of the evidence consists of anecdotal evidence of relatively few cases. Whether there is a systematic or sporadic slant in Gastil's ratings is an open question" (Bollen, 1986, p. 586).
Ideological bias or neutrality In his 1986 study, Bollen discussed reviews of measurements of
human rights, including the index reported in
Freedom in the World (Bollen, 1986, p. 585). Criticisms of
Freedom in the World during the 1980s were discussed by Gastil (1990), who stated that "generally such criticism is based on opinions about Freedom House rather than detailed examination of survey ratings", a conclusion disputed by Giannone. The definition of Freedom in Gastil (1982) and Freedom House (1990) emphasized liberties rather than the exercise of freedom, according to
Adam Przeworski, who gave the following example: In the United States, citizens are free to form political parties and to vote, yet even in presidential elections only half of U.S. "citizens" vote; in the U.S., "the same two parties speak in a commercially sponsored unison", wrote . More recent charges of ideological bias prompted Freedom House to issue this 2010 statement: Freedom House does not maintain a culture-bound view of freedom. The methodology of the survey is grounded in basic standards of political rights and civil liberties, derived in large measure from relevant portions of the
Universal Declaration of Human Rights. These standards apply to all countries and territories, irrespective of geographical location, ethnic or religious composition, or level of economic development. In contrast, another method by a critic of
Freedom in the World produced a bias for Leftist countries during the 1980s of at least +0.8 s.d., a bias that is "consistent with the general finding that political scientists are more favorable to leftist politics than is the general population" (Bollen and Paxton, p. 585).
Use and conceptual analysis Criticisms of the reception and uses of the
Freedom in the World report have been noted by Diego Giannone: • "Conceptual stretching",
Giovanni Sartori's critical term for a methodological shortcoming common in social studies. Giannone reports as an example that, according to Landman and Hausermann (2003), "the index by FH has been used as a tool for measuring democracy, good governance, and human rights, thus producing a conceptual stretching which is a major cause of 'losses in connotative precision': in short, an instrument used to measure everything, in the end, is not able to discriminate against anything." • Issues with aggregation. Giannone quotes Scoble and Wiseberg's conclusion (1981) that "the sum of a civil liberty score of 4 and a political liberty score of 2 is the same as the sum of a civil liberty score of 2 and a political liberty score of 4 even though the substantive interpretation of these different combinations is different." • "Lack of specificity and rigorousness in construction" and "inadequate level of transparency and replicability of the scales", the first referencing to Scoble
et alie (1981) and the latter to Hadenius and Teorell (2005). In support of the latter, he also quotes the conclusion of Munck and Verkuilen (2002) that "the aggregate data offered by Freedom House has to be accepted largely on faith", due to the factors that "no set of coding rules is provided, and the sources of information are not identified with enough precision, and because disaggregated data have not been made available to independent scholars". On this topic, the Freedom House website replies that they have "made a number of modest methodological changes to adapt to evolving ideas about political rights and civil liberties. At the same time, the time series data are not revised retroactively, and any changes to the methodology are introduced incrementally in order to ensure the comparability of the ratings from year to year." ==See also==