Reliability of Wikipedia

From Wikipedia, the free encyclopedia

The reliability of Wikipedia, compared to both other encyclopedias and more specialized sources, is often assessed in several ways, including statistically, by comparative review, and by analysis of the historical patterns, strengths and weaknesses inherent in the Wikipedia process. Because Wikipedia is a wiki, and open to collaborative editing by anyone, assessing its reliability requires also examining its ability to detect and rapidly remove false or misleading information.

A study in 2005 suggested that for scientific articles Wikipedia came close to the level of accuracy of Encyclopædia Britannica and had a similar rate for "serious errors."^[1]

An early study conducted by IBM researchers in 2003 found that "vandalism is usually repaired extremely quickly--so quickly that most users will never see its effects",^[2] they concluded that Wikipedia had "surprisingly effective self-healing capabilities."^[3] Caveat: Wikipedia started in 2001 (see History of Wikipedia), and hence the mentioned IBM study was focusing on a few articles that were created for a relatively short period of time, and on the first few versions of these articles. In science, it is easy to find deeper errors that lie dormant in an article for years before a "Good Samaritan"^[4] (if there were any) would come along to correct these errors.^[5] And that was for mature (but challenging) fields such as thermodynamics. For emerging scientific fields such as quantum information science, Wikipedia has been characterized as a medium that fosters "anarchy and distortions" by some experts.^[6]

Contents 1 Areas of reliability 2 The Wikipedia editing model 2.1 Anonymous editing 3 Assessments 3.1 Accuracy of articles 3.1.1 Comparative studies 3.1.2 Expert opinion 3.1.2.1 Librarian views 3.1.2.2 Academia 3.1.2.3 Editors of other encyclopedias 3.1.2.4 Other 3.2 Removal of false information 3.3 Susceptibility to editorial bias 3.3.1 WikiScanner 3.4 Reliability as a source in other contexts 3.5 Coverage 3.6 Broad assessments 4 Notable incidents 4.1 False biographical information 4.2 Other false information 4.3 Content disputes and conflicts of interest 4.3.1 Scientific disputes 4.3.2 Political interests and advocacy 4.3.3 Editing for financial rewards 4.3.4 Conflicts involving policy makers 5 References 6 See also 7 External links

[edit] Areas of reliability

The reliability of Wikipedia articles is a function of several criteria:

• Accuracy of information provided within articles
• Appropriateness of the images provided with the article and their respective copyright status
• Appropriateness of the style and focus of the articles^[7]
• Susceptibility to, and exclusion and removal of, false information (a criterion specific to the Wikipedia process)
• Comprehensiveness, scope and coverage within articles and in the range of articles
• Identification of reputable third-party sources as citations
• Stability of the articles
• Susceptibility to editorial and systemic bias
• Whether the articles are well-written.

The first four of these have been the subjects of various studies of the project, while the presence of bias is strongly disputed on both sides, and the prevalence and quality of citations can be tested within Wikipedia

[edit] The Wikipedia editing model

The Wikipedia model allows anyone to edit, and relies on a large number of well-intentioned editors to overcome issues raised by a smaller number of problematic editors. It is inherent in Wikipedia's editing model that poor information can be added, but over time quality is anticipated to improve in a form of group learning as editors reach consensus, so that substandard edits will very rapidly be removed. This assumption is still being tested, and its limitations and reliability are not yet a settled matter – Wikipedia is a pioneer in communal knowledge building of this kind. It contrasts with many more traditional models of knowledge and publishing, which attempt to limit content creation to a relatively small group of approved editors in order to exercise strong hierarchical control. Theories of critical pedagogy argue that consensus alone maintains the status quo; new knowledges only emerge from a dialectical exposure of power structures.^[8] In order to improve reliability, some editors have called for "stable versions" of articles,^[9] or articles that have been reviewed by the community and locked from further editing.^[10]

Wikipedia's model of knowledge creation is relatively novel, since widespread collaborative projects of its kind were rare until the arrival of the Internet, and are still rare on such a large scale. Over time, Wikipedia has developed many editorial tools that have been found to be useful, based largely upon trial and error.

While Wikipedia has the potential for extremely rapid growth and harnesses an entire community – much in the same way as other communal projects such as Linux – it goes further in trusting the same community to self-regulate and become more proficient at quality control. Wikipedia has harnessed the work of millions of people to produce the world's largest knowledge-based site along with software to support it, resulting in over six million articles written in about six years. For this reason, there has been considerable interest in the project both academically and from diverse fields such as information technology, business, project management, knowledge acquisition, software programming, other collaborative projects and sociology, to explore whether the Wikipedia model can produce good results, what collaboration in this way can reveal about people, and whether the scale of involvement can overcome the obstacles of individual limitations and poor editorship which would otherwise arise.

Another reason for inquiry is the growing and widespread reliance on Wikipedia by both websites and individuals using it as a source of information, and concerns over such a major source being susceptible to rapid change – including the introduction of misinformation at whim. The proponents of such concerns tend to seek reassurance of the quality and reliability of articles, and the degree of usefulness, misinformation or vandalism which should be expected, in order to decide what reliance to place upon them.

[edit] Anonymous editing

Wikipedia is unusual in allowing completely anonymous editing by people who have not been required to provide any identification or email details. A 2007 study at Dartmouth College examining this noted that contrary to usual social expectations, anonymous editors were some of Wikipedia's most productive adders of valid content, and considered societally why that might be the case:^[4]

"We find that quality is associated with contributor motivations ... Registered users' quality increases with more contributions ... Surprisingly, however, we find the highest quality from the vast numbers of anonymous 'Good Samaritans' who contribute only once. Our findings that Good Samaritans as well as committed "zealots" contribute high quality content to Wikipedia suggest that it is the quantity as well as the quality of contributors that positively affects the quality of open source production."

The study also found that the quality of Wikipedia articles varies widely. Some articles are excellent by any reasonable measure—authored and edited by persons knowledgeable in the field, containing numerous useful and relevant references, and written in a proper encyclopedic style. However, there are many articles on Wikipedia that are amateurish, unauthoritative, and even incorrect, making it difficult for a reader unfamiliar with a given subject matter to know which information to rely upon. In addition, Wikipedia contains many stubs—very short articles that provide a brief mention of a subject, and little else. The Dartmouth study was criticized by John Timmer of the Ars Technica website for an inexact measure of quality of Wikipedia articles.^[11]

[edit] Assessments

[edit] Accuracy of articles

One way in which reliability of information can be assessed is by comparison of Wikipedia articles to their parallel articles in other reputable sources.

A common source of reliability criticisms is the open process involved, which means that any article can be modified for better or worse at any time, and the fact that no privileged versions of articles currently exist in the main encyclopedia. This fluidity has been assessed by specialists both positively and negatively, as has Wikipedia's model that focuses upon rapid correction rather than initial accuracy.

[edit] Comparative studies

On October 24, 2005, The Guardian published an article entitled "Can you trust Wikipedia?" where a panel of experts were asked to critically review seven entries related to their fields.^[12] One article was deemed to have made "every value judgement... wrong", the others receiving marks from 5 to 8 out of a notional ten. Of the other six articles reviewed and critiqued, the most common criticisms were:

1. Poor prose, or ease-of-reading issues (3 mentions)
2. Omissions or inaccuracies, often small but including key omissions in some articles (3 mentions)
3. Poor balance, with less important areas being given more attention and vice versa (1 mention)

The most common praises were:

1. Factually sound and correct, no glaring inaccuracies (4 mentions)
2. Much useful information, including well selected links, making it possible to "access much information quickly" (3 mentions)

Nature reported in 2005 that science articles in Wikipedia were comparable in accuracy to those in Encyclopædia Britannica. Out of 42 articles, only 4 serious errors were found in Wikipedia, and 4 in Encyclopædia Britannica, although more than a hundred lesser errors and omissions were found in each and Wikipedia's articles were often "poorly structured."^[1] On March 24, 2006, Britannica provided a rebuttal of this article, labeling it "fatally flawed",^[13] to which Nature responded.^[14]

A web-based survey conducted from December 2005 to May 2006 assessed the "accuracy and completeness of Wikipedia articles."^[15] Fifty people (a fairly low response rate) accepted an invitation to assess an article. Of the fifty, thirty-eight (76%) agreed or strongly agreed that the Wikipedia article was accurate, and twenty-three (46%) agreed or strongly agreed that it was complete. Eighteen people compared the article they reviewed to the article on the same topic in the Encyclopædia Britannica. Opinions on accuracy were almost equal between the two encyclopedias (6 favoring Britannica, 7 favoring Wikipedia, 5 stating they were equal), and eleven (61%) found Wikipedia somewhat or substantially more complete, compared to seven (39%) for Britannica. The survey did not attempt random selection of the participants, and it is not clear how the participants were invited.

The German computing magazine c't performed a comparison of Brockhaus Multimedial, Microsoft Encarta, and the German Wikipedia in October 2004: Experts evaluated 66 articles in various fields. In overall score, Wikipedia was rated 3.6 out of 5 points (B-).^[16] A second test by c't in February 2007 used 150 search terms, of which 56 were closely evaluated, to compare four digital encyclopedias: Bertelsmann Enzyklopädie 2007, Brockhaus Multimedial premium 2007, Encarta 2007 Enzyklopädie and Wikipedia. It concluded: "We did not find more errors in the texts of the free encyclopedia than in those of its commercial competitors."^[17]

Viewing Wikipedia as fitting the economists' definition of a perfectly competitive marketplace of ideas, George Bragues (University of Guelph-Humber), examined Wikipedia's articles on seven top Western philosophers: Aristotle, Plato, Immanuel Kant, Rene Descartes, Georg Wilhelm Friedrich Hegel, Thomas Aquinas, and John Locke. Wikipedia's articles were compared to a consensus list of themes culled from 4 reference works in philosophy. Bragues found that, on average, Wikipedia's articles only covered 52% of consensus themes. No errors were found, though there were significant omissions.^[18]

PC Pro magazine (August 2007) asked experts to compare 4 articles (a small sample) in their scientific fields between Wikipedia, Britannica and Encarta. In each case Wikipedia was described as "largely sound", "well handled", "performs well", "good for the bare facts" and "broadly accurate." One article had "a marked deterioration towards the end" while another had "clearer and more elegant" writing, a third was assessed as less well written but better detailed than its competitors, and a fourth was "of more benefit to the serious student than its Encarta or Britannica equivalents." No serious errors were noted in Wikipedia articles, whereas serious errors were noted in one Encarta and one Britannica article.^[19]

In December 2007, German magazine Stern published the results of a comparison between the German Wikipedia and the online version of the 15-volume edition of Brockhaus Enzyklopädie. The test was commissioned to a research institute (Cologne-based WIND GmbH), whose analysts assessed 50 articles from each encyclopedia (covering politics, business, sports, science, culture, entertainment, geography, medicine, history and religion) on four criteria (accuracy, completeness, timeliness and clarity), and judged Wikipedia articles to be more accurate on the average (1.6 on a scale from 1 to 6, versus 2.3 for Brockhaus with lower = better). Wikipedia's coverage was also found to be more complete and up to date, however Brockhaus was judged to be more clearly written, while several Wikipedia articles were criticized as being too complicated for non-experts, and many as too lengthy.^{[20][21] [22]}

In its April 2008 issue British computing magazine PC Plus compared the English Wikipedia with the DVD editions of World Book Encyclopedia and Encyclopædia Britannica, assessing for each the coverage of a series of random subjects. It concluded The quality of content is good in all three cases and advised Wikipedia users Be aware that erroneous edits do occur, and check anything that seems outlandish with a second source. But the vast majority of Wikipedia is filled with valuable and accurate information.^[23]

[edit] Expert opinion

[edit] Librarian views

In a 2004 interview with The Guardian, self-described information specialist and Internet consultant^[24] Philip Bradley said that he would not use Wikipedia and was "not aware of a single librarian who would. The main problem is the lack of authority. With printed publications, the publishers have to ensure that their data are reliable, as their livelihood depends on it. But with something like this, all that goes out the window."^[25]

A 2006 review^[26] of Wikipedia by Library Journal, using a panel of librarians, "the toughest critics of reference materials, whatever their format", asked "long standing reviewers" to evaluate three areas of Wikipedia (popular culture, current affairs, and science), and concluded: "While there are still reasons to proceed with caution when using a resource that takes pride in limited professional management, many encouraging signs suggest that (at least for now) Wikipedia may be granted the librarian’s seal of approval". A reviewer who "decided to explore controversial historical and current events, hoping to find glaring abuses" concluded "I was pleased by Wikipedia’s objective presentation of controversial subjects" but that "as with much information floating around in cyberspace, a healthy degree of skepticism and skill at winnowing fact from opinion are required." Other reviewers noted that there is "much variation" but "good content abounds."

The library at Trent University, Ontario, Canada states of Wikipedia that many articles are "long and comprehensive", but that there is "a lot of room for misinformation and bias [and] a lot of variability in both the quality and depth of articles." It adds that Wikipedia has advantages and limitations, that it has "excellent coverage of technical topics" and articles are "often added quickly and, as a result, coverage of current events is quite good", comparing this to traditional sources which are unable to achieve this task. It concludes that depending upon the need, one should think critically and assess the appropriateness of one's sources, "whether you are looking for fact or opinion, how in-depth you want to be as you explore a topic, the importance of reliability and accuracy, and the importance of timely or recent information", and adds that Wikipedia can be used in any event as a "starting point."^[27]

An article for the Canadian Library Association (CLA)^[28] discusses the Wikipedia approach, process and outcome in depth, commenting for example that in controversial topics, "what is most remarkable is that the two sides actually engaged each other and negotiated a version of the article that both can more or less live with." The author comments that:

"[I]n fact Wikipedia has more institutional structure than at first appears. Some 800 experienced users are designated as administrators [Update: As of 2007 some 1500 on English Wikipedia alone], with special powers of binding and loosing: they can protect and unprotect, delete and undelete and revert articles, and block and unblock users. They are expected to use their powers in a neutral way, forming and implementing the consensus of the community. The effect of their intervention shows in the discussion pages of most contentious articles. Wikipedia has survived this long because it is easier to reverse vandalism than it is to commit it..."

Information Today (March 2006) cites librarian Nancy O’Neill (principal librarian for Reference Services at the Santa Monica Public Library System) as saying that "there is a good deal of skepticism about Wikipedia in the library community" but that "she also admits cheerfully that Wikipedia makes a good starting place for a search. You get terminology, names, and a feel for the subject."^[29]

PC Pro (August 2007) cites the head of the European and American Collection at the British Library, Stephen Bury, as stating "Wikipedia is potentially a good thing - it provides a speedier response to new events, and to new evidence on old items." The article concludes: "For [Bury], the problem isn't so much the reliability of Wikipedia's content so much as the way in which it's used. "It's already become the first port of call for the researcher", Bury says, before noting that this is "not necessarily problematic except when they go no further." According to Bury, the trick to using Wikipedia is to understand that "just because it's in an encyclopedia (free, web or printed) doesn't mean it's true. Ask for evidence .. and contribute."^[19]

[edit] Academia

Academic circles have not been exclusively dismissive of Wikipedia as a reference. Wikipedia articles have been referenced in "enhanced perspectives" provided on-line in Science. The first of these perspectives to provide a hyperlink to Wikipedia was "A White Collar Protein Senses Blue Light",^[30] and dozens of enhanced perspectives have provided such links since then. However, these links are offered as background sources for the reader, not as sources used by the writer, and the "enhanced perspectives" are not intended to serve as reference material themselves.

An empirical study conducted in 2006 by a Nottingham University Business School lecturer in Information Systems,^[31] the subject of a review on the technical website Ars Technica,^[32] involving 55 academics asked to review specific Wikipedia articles that either were in their expert field (group 1) or chosen at random (group 2), concluded that "The experts found Wikipedia’s articles to be more credible than the non–experts. This suggests that the accuracy of Wikipedia is high. However, the results should not be seen as support for Wikipedia as a totally reliable resource as, according to the experts, 13 percent of the articles contain mistakes [10% of experts reporting factual errors of unspecified degree, 3% reporting spelling errors]."^[33]

The Gould Library at Carleton College in Minnesota has a web-page describing the use of Wikipedia in academia.^[34] It asserts that "Wikipedia is without question a valuable and informative resource", but that "there is an inherent lack of reliability and stability" to its articles, again drawing attention to similar advantages and limitations as other sources. As with other reviews it comments that one should assess one's sources and what is desired from them, and that "Wikipedia may be an appropriate resource for some assignments, but not for others." It cited Jimmy Wales' view that Wikipedia may not be an ideal as a source for all academic uses, and (as with other sources) suggests that at the least, one strength of Wikipedia is that it provides a good starting point for current information on a very wide range of topics.

The Chronicle of Higher Education published an article written by Cathy Davidson, Professor of Interdisciplinary Studies and English at Duke University, in which she asserts that Wikipedia should be used to teach students about the concepts of reliability and credibility.^[35]

The academic world's view of Wikipedia has improved during the last few years, as can be inferred from the increase in the number of citations in international scientific journals. As of September 12, 2007 a search in the ScienceDirect database (a large online collection of published scientific research produced by Elsevier) for academic and scientific articles citing Wikipedia yields the following result:^[36]

Year article published	No. of articles citing Wikipedia
before 2003	0
2003	1
2004	9
2005	28
2006	129
2007	358
2008 (as of August 11)	490

[edit] Editors of other encyclopedias

In a 2004 piece called "The Faith-Based Encyclopedia," former Encyclopedia Britannica editor Robert McHenry criticized the wiki approach, writing:

"[H]owever closely a Wikipedia article may at some point in its life attain to reliability, it is forever open to the uninformed or semiliterate meddler… The user who visits Wikipedia to learn about some subject, to confirm some matter of fact, is rather in the position of a visitor to a public restroom. It may be obviously dirty, so that he knows to exercise great care, or it may seem fairly clean, so that he may be lulled into a false sense of security. What he certainly does not know is who has used the facilities before him."^[37]

Similarly, Britannica's executive editor, Ted Pappas, was quoted in The Guardian as saying: "The premise of Wikipedia is that continuous improvement will lead to perfection. That premise is completely unproven."^[25]

[edit] Other

Information Today (March 2006) comments^[29] on Wikipedia and Britannica that it is comparing "Apples and Oranges" and that:

"Even the revered Encyclopaedia Britannica is riddled with errors, not to mention the subtle yet pervasive biases of individual subjectivity and corporate correctness... There is no one perfect way. Britannica seems to claim that there is. Wikipedia acknowledges there’s no such thing. Librarians and information professionals have always known this. That’s why we always consult multiple sources and counsel our users to do the same."

BBC technology specialist Bill Thompson wrote^[38] that "Most Wikipedia entries are written and submitted in good faith, and we should not let the contentious areas such as politics, religion or biography shape our view of the project as a whole", that it forms a good starting point for serious research but that:

"No information source is guaranteed to be accurate, and we should not place complete faith in something which can so easily be undermined through malice or ignorance... That does not devalue the project entirely, it just means that we should be skeptical about Wikipedia entries as a primary source of information... It is the same with search engine results. Just because something comes up in the top 10 on MSN Search or Google does not automatically give it credibility or vouch for its accuracy or importance."

He adds the observation that since most popular online sources are inherently unreliable in this way, one byproduct of the information age is a wiser audience who are learning to check information rather than take it on faith due to its source, leading to "a better sense of how to evaluate information sources."

A study conducted in early 2007 by the Pew Research Center found that 8% of all online Americans consult Wikipedia on a typical day. The study also found that the 36% of all US internet users use Wikipedia, with this fraction increasing with education level. About 22% of those with a high school-level education use Wikipedia, 36% of those with some college use Wikipedia, and 50% of those with a college degree use Wikipedia.^[39]

The Supreme Court of India in its recent judgement in Commr. of Customs, Bangalore vs. ACER India Pvt. (Citation 2007(12)SCALE581) has held that "We have referred to Wikipedia, as the learned Counsel for the parties relied thereupon. It is an online encyclopaedia and information can be entered therein by any person and as such it may not be authentic."^[40]

In his 2007 Guide to Military History on the Internet, Simon Fowler rated Wikipedia as "the best general resource" for military history research, and stated that "the results are largely accurate and generally free of bias."^[41] When rating WP as the No. 1 military site he mentioned that "Wikipedia is often criticised for its inaccuracy and bias, but in my experience the military history articles are spot on."^[42]

In July 2008, The Economist magazine described Wikipedia as "a user-generated reference service" and noted that Wikipedia's "elaborate moderation rules put a limit to acrimony" generated by cyber-nationalism.^[43]

[edit] Removal of false information

Viégas, Wattenberg, and Dave (2004) studied the flow of editing in the Wikipedia model, with emphasis on breaks in flow (from vandalism or substantial rewrites), showing the dynamic flow of material over time. They found that most acts of vandalism during May 2003 were repaired within minutes. However, it is unclear whether or not this finding applies to all forms of vandalism, including so-called 'sneaky' vandalism (which resembles genuine editing and is by nature harder to detect). Lih (2004) compared articles before and after they were mentioned in the press, and found that externally referenced articles are of higher quality work. A 2002 study^[44] by IBM found that most vandalism on the English Wikipedia was reverted within five minutes, though some persisted for much longer:

"We've examined many pages on Wikipedia that treat controversial topics, and have discovered that most have, in fact, been vandalized at some point in their history. But we've also found that vandalism is usually repaired extremely quickly--so quickly that most users will never see its effects."^[45]

A further informal assessment by the popular IT magazine "PC Pro" for its 2007 article Wikipedia Uncovered^[19] tested Wikipedia by a similar device to those described above, by introducing 10 errors that "varied between bleeding obvious and deftly subtle" into articles (the researchers later corrected the articles they had edited). Labeling the results "impressive" it noted that all but one was noted and fixed within the hour, and that "the Wikipedians' tools and know-how were just too much for our team." A second series of another 10 tests, using "far more subtle errors" and additional techniques to conceal their nature, met similar results: "despite our stealth attempts the vast majority... were discovered remarkably quickly... the ridiculously minor Jesse James error was corrected within a minute and a very slight change to Queen Ann's entry was put right within two minutes." Two of the latter series were not detected. The article concluded that "Wikipedia corrects the vast majority of errors within minutes, but if they're not spotted within the first day the chances... dwindle as you're then relying on someone to spot the errors while reading the article rather than reviewing the edits."

A study in late-2007 systematically inserted fibs into Wikipedia entries about the lives of philosophers. Depending on how exactly the data is interpreted, either one third or one half of the fibs were corrected within 48 hours.^[46]

[edit] Susceptibility to editorial bias

[edit] WikiScanner

In August 2007, a tool called WikiScanner developed by Virgil Griffith, a visiting researcher from the Santa Fe Institute in New Mexico, was released to match anonymous IP edits in the encyclopedia with an extensive database of addresses. News stories appeared about IP addresses from various organizations such as the Central Intelligence Agency, the Democratic Congressional Campaign Committee, Diebold, Inc. and the Australian government being used to make edits to Wikipedia articles, sometimes of an opinionated or questionable nature. The BBC quoted a Wikimedia spokesperson as praising the tool: "We really value transparency and the scanner really takes this to another level. Wikipedia Scanner may prevent an organisation or individuals from editing articles that they're really not supposed to."^[47] Another story stated that an IP address from the BBC itself had been used to vandalize the article on George W. Bush.^[48]

The WikiScanner story was also covered by The Independent, which stated that many "censorial interventions" by editors with vested interests on a variety of articles in Wikipedia had been discovered:

“

"[Wikipedia] was hailed as a breakthrough in the democratisation of knowledge. But the online encyclopedia has since been hijacked by forces who decided that certain things were best left unknown... Now a website designed to monitor editorial changes made on Wikipedia has found thousands of self-serving edits and traced them to their original source. It has turned out to be hugely embarrassing for armies of political spin doctors and corporate revisionists who believed their censorial interventions had gone unnoticed."[49]

”

[edit] Reliability as a source in other contexts

Although Wikipedia is stated not to be a primary source, it has been used as evidence in legal cases. In one notable case, the trademark of Formula 1 racing decision,^[50] the UK Intellectual Property Office considered both the reliability of Wikipedia, and its usefulness as a reliable source of evidence:

"Wikipedia has sometimes suffered from the self-editing that is intrinsic to it, giving rise at times to potentially libellous statements. However, inherently, I cannot see that what is in Wikipedia is any less likely to be true than what is published in a book or on the websites of news organisations. [Formula One's lawyer] did not express any concerns about the Wikipedia evidence [presented by the plaintiff]. I consider that the evidence from Wikipedia can be taken at face value."

The case turned substantively upon evidence cited from Wikipedia in 2006 as to the usage and interpretation of the term "Formula 1."

An earlier case (Allegheny Defense Project appeal, 2005) heard by the Third Circuit (USA) also saw Wikipedia referenced, in which Wikipedia was used as a source for the term "Understory."

Wikipedia has also developed into a key source for some current new events such as the 2004 Indian Ocean earthquake and related tsunami, and the 2007 Virginia Tech massacre. In the latter case, it cites the New York Times, noting with 750,000 page views of the article in the two days after the event:

"Even The Roanoke Times, which is published near Blacksburg, Va., where the university is located, noted on Thursday that Wikipedia 'has emerged as the clearinghouse for detailed information on the event'."^[51]

The Washington Post commented similarly, in the context of 2008 Presidential election candidate biographies, that despite occasional brief vandalism, "it's hard to find a more up-to-date, detailed, thorough article on Obama than Wikipedia's. As of Friday, Obama's article -- more than 22 pages long, with 15 sections covering his personal and professional life -- had a reference list of 167 sources."^[52]

[edit] Coverage

Wikipedia has been accused of deficiencies in comprehensiveness because of its voluntary nature, and of reflecting the systemic biases of its contributors. Encyclopædia Britannica editor-in-chief Dale Hoiberg has argued that "people write of things they're interested in, and so many subjects don't get covered; and news events get covered in great detail. The entry on Hurricane Frances was five times the length of that on Chinese art, and the entry on Coronation Street was twice as long as the article on Tony Blair."^[25] Former Nupedia editor-in-chief Larry Sanger stated in 2004, "when it comes to relatively specialized topics (outside of the interests of most of the contributors), the project's credibility is very uneven."^[53]

Wikipedia has been praised for making it possible for articles to be updated or created in response to current events. For example, the then-new article on the 2004 Indian Ocean earthquake on its English edition was cited often by the press shortly after the incident.^{[citation needed]} Its editors have also argued that, as a website, Wikipedia is able to include articles on a greater number of subjects than print encyclopedias may.^[54]

[edit] Broad assessments

Several commentators have drawn a middle ground, asserting that the project contains much valuable knowledge and has some reliability, even if the degree is not yet assessed with certainty. Many of the librarian and academic reviewers of Wikipedia cited above take such a view.

Others taking this view include Danah Boyd, who in 2005 discussed Wikipedia as an academic source, concluding that "[i]t will never be an encyclopedia, but it will contain extensive knowledge that is quite valuable for different purposes",^[55] and Bill Thompson who stated "I use the Wikipedia a lot. It is a good starting point for serious research, but I would never accept something that I read there without checking."^[38]

Information Today's March 2006 article^[29] concludes on a similar theme:

"The inconvenient reality is that people and their products are messy, whether produced in a top-down or bottom-up manner. Almost every source includes errors... Many non-fiction books are produced via an appallingly sloppy process... In this author’s opinion, the flap over Wikipedia was significantly overblown, but contained a silver lining: People are becoming more aware of the perils of accepting information at face value. They have learned not to consult just one source."

Dan Gillmor, a Silicon Valley commentator and author commented in October 2004 that, "I don't think anyone is saying Wikipedia is an absolute replacement for a traditional encyclopedia. But in the topics I know something about, I've found Wikipedia to be as accurate as any other source I've found."^[25]

Referencing Linus's law of open-source development, Larry Sanger who is a co-founder^[56][57] of Wikipedia, stated on Kuro5hin in 2001 that "Given enough eyeballs, all errors are shallow."^[58]

Seemingly, and "in theory", an unsupervised mass collective effort should not work well. But in practice it does, in part because of the social and psychological structures that motivate participants on both content and maintenance tasks. Sheizaf Rafaeli and Yaron Ariel report how "most people agree that at least the English version of Wikipedia is approaching critical mass where substantial content disasters should become rare." ^[59]

Likewise, technology figure Joi Ito wrote on Wikipedia's authority, "[a]lthough it depends a bit on the field, the question is whether something is more likely to be true coming from a source whose resume sounds authoritative, or a source that has been viewed by hundreds of thousands of people (with the ability to comment) and has survived."^[60]

[edit] Notable incidents

[edit] False biographical information

Inaccurate information that is not obviously false may persist in Wikipedia for a long time before it is challenged. The most prominent cases reported by mainstream media involved biographies of living persons.

The Seigenthaler incident demonstrated that the subject of a biographical article must sometimes fix blatant lies about his own life. In November 2005, a user edited the biographical article on John Seigenthaler Sr. so that it contained several false and defamatory statements.^[61] The inaccurate claims went unnoticed between May and September 2005 when they were discovered by Victor S. Johnson, Jr., a friend of Seigenthaler. Wikipedia content is often mirrored at sites such as Answers.com, which means that incorrect information can be replicated alongside correct information through a number of web sources. Such information can develop a misleading air of authority because of its presence at such sites:^[62]

“

Then [Siegenthaler's] son discovered that his father's hoax biography also appeared on two other sites, Reference.com and Answers.com, which took direct feeds from Wikipedia. It was out there for four months before Seigenthaler realised and got the Wikipedia entry replaced with a more reliable account. The lies remained for another three weeks on the mirror sites downstream.

”

Seth Finkelstein reported in an article in The Guardian on his efforts to remove his own biography page from Wikipedia, simply because it was subjected to defamation:^[63]

“

Wikipedia has a short biography of me, originally added in February 2004, mostly concerned with my internet civil liberties achievements. After discovering in May 2006 that it had been vandalised in March, possibly by a long-time opponent, and that the attack had been subsequently propagated to many other sites which (legally) repackage Wikipedia's content, the article's existence seemed to me overall to be harmful rather than helpful. For people who are not very prominent, Wikipedia biographies can be an "attractive nuisance". It says, to every troll, vandal, and score-settler: "Here's an article about a person where you can, with no accountability whatsoever, write any libel, defamation, or smear. It won't be a marginal comment with the social status of an inconsequential rant, but rather will be made prominent about the person, and reputation-laundered with the institutional status of an encyclopedia."

”

In the same article Finkelstein recounts how he voted his own biography as "not notable enough" in order to have it removed from Wikipedia. He goes on to recount a similar story involving Angela Beesley, previously a prominent member of the foundation which runs Wikipedia.

In another example, on March 2, 2007, MSNBC.com reported that Hillary Rodham Clinton had been incorrectly listed for 20 months in her Wikipedia biography as valedictorian of her class of 1969 at Wellesley College. (Hillary Rodham was not the valedictorian, though she did speak at commencement.)^[64] The article included a link to the Wikipedia edit,^[65] where the incorrect information was added on July 9, 2005. After the MSNBC report, the inaccurate information was removed the same day.^[66] Between the two edits, the wrong information had stayed in the Clinton article while it was edited more than 4,800 times over 20 months.

Attempts to perpetrate hoaxes may not be confined to editing Wikipedia articles. In October 2005 Alan Mcilwraith, a former call centre worker from Scotland created a Wikipedia article in which he claimed to be a highly decorated war hero. The article was quickly identified by other users as unreliable (see Wikipedia Signpost article 17 April 2006). However, Mcilwraith had also succeeded in convincing a number of charities and media organizations that he was who he claimed to be:^[67]

“

The 28-year-old, who calls himself Captain Sir Alan McIlwraith, KBE, DSO, MC, has mixed with celebrities for at least one fundraising event. But last night, an Army spokesman said: "I can confirm he is a fraud. He has never been an officer, soldier or Army cadet.

”

There have also been instances of users deliberately inserting false information into Wikipedia in order to test the system and demonstrate its alleged unreliability.^[68] Television personality Stephen Colbert lampooned this drawback of Wikipedia, calling it wikiality.

Wikipedia considers Vandalism the insertion of false and misleading information in bad faith. The Wikipedia page Researching with Wikipedia states:

“

Wikipedia's radical openness means that any given article may be, at any given moment, in a bad state: for example, it could be in the middle of a large edit or it could have been recently vandalized. While blatant vandalism is usually easily spotted and rapidly corrected, Wikipedia is certainly more subject to subtle vandalism than a typical reference work.[69]

”

In an informal media test of Wikipedia's ability to detect misinformation, an anonymous blogger tested Wikipedia by inserting subtly erroneous facts into obscure articles, stating that its process "isn't really a fact-checking mechanism so much as a voting mechanism", and that material which did not appear "blatantly false" may be accepted as true.^[70] Wikipedians by and large responded with anger at what was considered by many to be an unfair trial which had deliberately focused on obscure, less-reviewed articles; the blogger responded that the test was fair.

[edit] Other false information

On 29 August 2008, shortly after the UEFA cup first round draw was completed, an edit was made to AC Omonia's article , apparently by users of B3ta,^[71] which added the following erroneous information to the section titled "The fans".

"A small but loyal group of fans are lovingly called "The Zany Ones" - they like to wear hats made from discarded shoes and have a song about a little potato."

On 18 September 2008, David Anderson, a British journalist writing for the Daily Mirror, quoted this in his match preview ahead of Omonia's game with Manchester City, which appeared in the web and print versions of the Mirror and the nickname was quoted in subsequent editions on 19 September.^[72][73]

[edit] Content disputes and conflicts of interest

[edit] Scientific disputes

The 2005 Nature^[1] study also reported on the outcomes of two scientific disputes on Wikipedia. The first dispute was on the topic of violence in schizophrenia, and pitted the neuropsychologist Vaughan Bell against some anonymous editors. Nature did not report on the outcome of this first dispute. The second dispute reported by Nature involved the climate researcher William Connolley, again opposed by anonymous editors. (editor's note: Nature considered anonymous editors that did not use their real names). The topic in this second dispute was climate change; Nature reported that this dispute was far more protracted, and led to arbitration, which took three months to produce a decision. The outcome of arbitration, as reported by Nature, was a six-month parole for Connolley − during this time he was restricted to one revert per day. Connolley's opponents were reportedly banned from editing climate articles also for six months.

The Observer reported in December 2007 that Carl Hewitt, associate professor emeritus in electrical engineering and computer science at MIT, was banned from editing Wikipedia. According the article Hewitt is alleged^[74] "to have disrupted Wikipedia for more than two years by using it for self-promotion, tampering with his own biography and manipulating computer science articles to inflate the importance of his own research. Senior academics in his field say the changes he made have rendered some entries in effect useless." Wikipedia administrators claimed that Hewitt "was found to be citing his own work in articles where it was not relevant, obscuring points of view at odds with his own theories, and editing his biography to promote his forthcoming public appearances". Hewitt rejected these findings and claimed that he was being harassed and censored. The article concluded that:

“

The banning of Hewitt shows that the academic community is in fact actively involved in editing Wikipedia, but may be no more reliable and trustworthy than any other group of users.

”

[edit] Political interests and advocacy

While Wikipedia policy requires articles to have a neutral point of view, it is not immune from attempts by outsiders (or insiders) with an agenda to place a spin on articles. In January 2006 it was revealed that several staffers of members of the U.S. House of Representatives had embarked on a campaign to cleanse their respective bosses' biographies on Wikipedia, as well as inserting negative remarks on political opponents. References to a campaign promise by Martin Meehan to surrender his seat in 2000 were deleted, and negative comments were inserted into the articles on U.S. Senator Bill Frist and Eric Cantor, a congressman from Virginia. Numerous other changes were made from an IP address which is assigned to the House of Representatives.^[75] In an interview, Jimmy Wales remarked that the changes were "not cool."^[76] Some organizations are making efforts to correct inaccuracies. For example, the Telegraph reported that a Boston-based media watchdog asked supporters to help edit clearly anti-Israeli biases in Wikipedia articles.^[77]

Articles dealing with Latin American history and groups (such as the Sandinistas and Cuba) are often written from a quasi-Marxist perspective which treats socialist dictatorships favorably.^{[78] [79] ([80]+[81])}

In April 2008, the Boston-based Committee for Accuracy in Middle East Reporting in America (CAMERA) organized a campaign to correct Israel-related biases and inconsistencies in Wikipedia. ^[82]

On August 31 2008, The New York Times ran an article detailing the edits made to the biography of Sarah Palin in the wake of her nomination as running mate of John McCain. The editor responsible for adding many flattering details was identified as single-purpose account of a McCain campaign volunteer.^[83]

[edit] Editing for financial rewards

In January 2007 Rick Jelliffe claimed in a story carried by CBS^[84] and IDG News Service ^[85][86] that Microsoft had offered him compensation in exchange for his future editorial services on OOXML. A Microsoft spokesperson, quoted by CBS, commented that "Microsoft and the writer, Rick Jelliffe, had not determined a price and no money had changed hands - but they had agreed that the company would not be allowed to review his writing before submission". Also quoted by CBS, Jimmy Wales expressed his dissapproval of Microsoft's involvement: "We were very disappointed to hear that Microsoft was taking that approach".

In story covered by the BBC, former Novell chief scientist Jeffrey Merkey claimed that in exchange for a donation his Wikipedia entry was edited in his favor. Jay Walsh, a spokesman for Wikipedia, flatly denied the allegations in an interview given to the Daily Telegraph.^[87]

In a story covered by InformationWeek, Eric Goldman, assistant law professor at Santa Clara University in California argued that "eventually, marketers will build scripts to edit Wikipedia pages to insert links and conduct automated attacks on Wikipedia", thus putting the encyclopedia beyond the ability of its editors to provide countermeasures against the attackers, particularly because of a vicious circle where the strain of responding to these attacks drives core contributors away, increasing the strain on those who remain.^[88]

[edit] Conflicts involving policy makers

In February 2008, British technology news and opinion website The Register published an article called "Wikipedia ruled by 'Lord of the Universe'", in which it was pointed out that despite the fact that a prominent administrator of Wikipedia, Jossi Fresco, declared a conflict of interest related to Prem Rawat, the article alleged that not only did Fresco edit the article of Prem Rawat to keep criticism to bare minimum, he altered the Wikipedia policies over personal biography and policies regarding "conflict of interest", to favour his alleged "biased" editing. The article pointed out that Fresco was also involved in Wikipedia's "Conflict of Interest Noticeboard", the situation which the Register article described as "a conflict of conflict of interest". The article ended with the claim:^[89]

“

Jossi Fresco may bear the most extreme conflict of interest in the history of Wikipedia - and he edits the policy that governs conflict of interest.

”

Some of the most scathing criticism of Wikipedia's claimed neutrality came in The Register, which in turn was allegedly criticized by founding members of the project. According to The Register:^[90]

“

In short, Wikipedia is a cult. Or at least, the inner circle is a cult. We aren't the first to make this observation[91]. On the inside, they reinforce each other's beliefs. And if anyone on the outside questions those beliefs, they circle the wagons. They deny the facts. They attack the attacker. After our Jossi Fresco story, Fresco didn't refute our reporting. He simply accused us of "yellow journalism". After our Overstock.com article, Wales called us "trash".

”

[edit] References

[edit] See also

Articles

• Essjay controversy
• Internet encyclopedia project
• List of encyclopedias
• Veropedia
• WikiScanner

Wikipedia project pages

• Wikipedia:Errors in the Encyclopædia Britannica that have been corrected in Wikipedia
• Wikipedia:Errors in the New International Encyclopedia that have been corrected in Wikipedia
• Wikipedia:External peer review/Nature December 2005
• Wikipedia:Press coverage
• Wikipedia:Replies to common objections
• Wikipedia:Researching with Wikipedia
• Wikipedia:Statistics
• Wikipedia:Wikipedia as an academic source (list of cited uses)
• Wikipedia:Wikipedia in academic studies (list of studies)

[edit] External links

• Librarians' Claims and Opinions Regarding Wikipedia
• Stanford University's Web Credibility research lab, researches similar issues on credibility measures of web information.
• UCSC Wiki Lab
• WikiDashboard
• WikiRage

v • d • e Wikipedia Main articles History · Wikimedia Foundation · Wikimania · MediaWiki · Reliability · Criticism · Deletionism and inclusionism · Academic studies about Wikipedia · WikiScanner People Jimmy Wales · Larry Sanger · Florence Devouard · Angela Beesley · Sue Gardner · Erik Möller · Michael Snow Events Blocking of Wikipedia in mainland China · Congressional staffer edits to Wikipedia · Essjay controversy · Seigenthaler incident · Chris Benoit double murder and suicide · Henryk Batuta hoax · Truth in Numbers: The Wikipedia Story Related projects and forks Bomis · Nupedia · Citizendium · Enciclopedia Libre Universal en Español · Deletionpedia · Interpedia · MyWikiBiz · Veropedia · Wikia · Wikipedia Review · Wikitruth · Wikiweise · WikiZnanie · WikiPilipinas