Wikifying scholarly canons

Francis Bacon’s New Atlantis, published in 1627, introduced the bold idea of a world in which humans developed technology and accumulated knowledge in support of the common good. His book helped inspire the Age of Enlightenment and the idea that we could look to the present, and not only the ancients, to better understand ourselves and the world. It particularly inspired Robert Boyle (1627-1691), who in the mid-17th century began a practice of publicly demonstrating his findings in his then new “(e)laboratory”, a large venue designed to allow others to observe the apparatus he used and validate his results [1].

Before Boyle, most of those who tinkered with the natural world were alchemists who hid the details of their work and then made grand claims about the phenomena they had privately “discovered”.  What Boyle realized, though, was that the kind of progress found in New Atlantis required the establishment of commonly accepted facts. Work done in secret contributed little, and without a detailed explanation of the methods involved, any results were viewed with suspicion and were nearly impossible to verify or reproduce. By having respectable witnesses (at the time literally aristocratic “peers”) scrutinize his experiments and vouch for his results, Boyle initiated a departure from the alchemist’s closet [2].

As an alternative to requiring actual witnesses to validate every scientific result, Boyle developed conventions of modesty and detail in scientific reporting. These conventions were widely adopted and succeeded in describing methods and results with enough clarity to inspire trust and permit replication, thereby allowing scientific knowledge to build on itself. But standardized scholarly communication also had secondary benefits: thanks to official archival publication, researchers could claim credit for their discoveries; papers themselves took on a more standard form, making them more useful and accessible to readers; and editorial review helped to filter out redundant or unimportant reports.

Ever since the British Royal Society‘s founding of the Philosophical Transactions in 1665, the scholarly article and monograph have continued to serve as the basic units of contribution, persisting even as science has professionalized and media turned electronic. Like the works of the classical period that so preoccupied the pre-Enlightenment academy, the cultural institutions of scholarly articles and monographs themselves have stood the test of time. Indeed, they have proliferated: since 1665 the number of peer-reviewed journals has increased at a relatively steady compound annual growth rate of between 3.2% and 4.4% [3], with 24,000 of them in existence in 2010 [4]. As of 2012 more than 1.5 million refereed articles are published yearly [5], and since most journals have impact factors of 1.0 or less, the majority of articles published today will, within two years, have been cited at most once [6].

“Nullius in verba”

Many academics would report that a love of research and sharing knowledge is what motivated them to become scholars and scientists. They nearly always give away the articles that result from their work, and are rewarded by the benefits to their career (notably hiring and tenure) from increased prestige.  Given that the purpose of scholarship is the advancement of human knowledge, one might imagine that scholars would jump at the opportunity to make accurate information on a topic they care about easily accessible. Yet for the most part, academics continue to publish original research within journals that restrict access, and have thus far not engaged substantively with, for instance, Wikipedia.

When academics have been asked why they do not contribute to Wikipedia, or why they do not make their data more easily available, or why they continue to avoid new “open access” publication venues, one of the most common explanations is “not enough time” [7,8]. Academic hiring, tenure, and grant review boards preference most strongly the publication of scholarly results in prestigious outlets. In the sciences these are journals such as Nature and Science, and in the humanities a book published by a selective university publisher [7]. By communicating through such media, an academic can be sure that his or her peers will see (or at least, should have seen) the researcher’s contribution. By contrast, contributions to Wikipedia, or to writing popular blog posts, generally accord no academic recognition to a contributor. This may help to explain why, for those without access to institutional journal subscriptions, the claims of today’s academics may at times appear as trustworthy as those of the pre-Enlightenment alchemists.

An approach

A potential solution is the creation of a scholarly wiki-based encyclopedia, one that recognizes the existing imperatives of academic communication. As a wiki, every entry would be a “living review”, subject to further revision as the field advances. Unlike Wikipedia, however, contributions to a scholarly wiki-based encyclopedia would be targeted toward a scholar’s peers rather than the general public. Each entry would undergo peer review and archival publication. Once published, entries would be subject to curation by a recognized and established scholarly authority on the topic. Though the articles themselves would not constitute original research, site-based scholarly discussion regarding potential revisions would no doubt make reference to recent (and perhaps even original) arguments and data.

By making each review article a public resource and providing tools for scholarly commentary and annotation, the articles themselves would become central venues in which scholars could be assured that any contributions would be visible to their peers. When even the most minor contribution has an immediate global impact, each contributing act brings with it strong intrinsic rewards, a fact that is responsible for motivating the hundreds of thousands of volunteer editors that built Wikipedia.

A central scholarly encyclopedia would also serve to empower the academy in the eyes of the public by making obvious the extent of academic consensus on a range of topics. This might be especially helpful in the social sciences and humanities, which can seldom deploy the power of demonstration to convince a broader audience. By consolidating vetted, trustworthy scholarly opinion, the academy might unify online and thereby retake ground currently claimed by special interest groups and public relations firms.

Yet perhaps the greatest advantage of a scholarly wiki-based system is the ratchet-like nature of its development: each article need only be written once, and thereafter serves as a permanent, living part of an online canon. Because contributing provides an immediate benefit to authors in the form of a published, citable, peer-reviewed scholarly article, such a resource need not rely on pure altruism for its growth. While career benefits to junior faculty contributors might be minor early in the encyclopedia’s development, advanced undergraduates and graduate students would nonetheless have strong incentives to team up with senior faculty co-authors, especially if this meant that a student could derive a peer-reviewed publication from an article that had already been written for course credit.

Why would scholars pay any particular attention to the content of wiki-based scholarly reviews and the commentary that accompanies them? In a word: prominence. Scholarpedia, an attempt to create precisely the kind of venue described here, demonstrates excellent performance in search engines. When titles from its articles are searched for, Scholarpedia entries typically appear on the first page of results, often ranked within the top five (e.g., at the time of writing, Geoffrey Hinton’s review of “Deep belief networks” appears in the top position in Google when its title is queried). It is thus in a scholar’s self-interest to, in the near term, use Scholarpedia as a venue for publishing reviews because it is a reliable means of gaining global visibility.

To predict the longer term impact of developing a large number of wiki-style review articles it is informative to look to Wikipedia. Because of the high prominence of Wikipedia results, and because of the limitations of the software Wikipedia uses, the Wikipedia community has needed to develop norms that discourage conversations about the article’s contents [9]. While the audience for scholarly review articles is smaller than the audience for lay Wikipedia articles, the immediacy and reach of article commentary is identical, creating strong incentives for living scholarly review articles to additionally serve as venues for informal scholarly discussion. Through better structuring and community filtering of conversations, each online forum should prove at least as informative as the content of the article itself.

One potential outcome of marrying the dynamic collaborative revision of online review articles with ongoing goal-directed scholarly discussion is the provision of an alternative, and more incremental, venue for presenting and vetting a range of scholarly contributions. For instance, in the course of a discussion regarding a revision to a review article’s main text, a scholar might marshall computer code, post charts, reference online databases, and even present raw data. As in the popular collaborative programming website GitHub, simple visualizations of the extent, significance, and frequency of contributions could then provide alternative metrics of impact.


Perhaps the greatest concern related to the development of an online wiki-style scholarly encyclopedia is who has authority — a concern that, fortunately, has already been successfully addressed in the development of printed encyclopedias. Scholarpedia’s approach is simple: it begins with an invited base of Editors and article Curators that have established reputations within their field. By combining this base with a system of public vouching for both authors and titles, authority is delegated to scholars themselves, adopting a distributed structure akin to that of the current academy. In effect, if respected scholars are willing to stake their reputations on the existence and content of a scholarly review article, then the review article merits inclusion.

There are additional epistemological and ontological issues concerning what should qualify as a potential scholarly review. As in Wikipedia, certain entries will no doubt lead to “disambiguation” pages (e.g. “language”). One might ask, for example, if there should be one article on “depression” (as a medical condition) or if instead “depression” should be an entire category of articles. There will no doubt be many other such challenges — here we simply defer to the judgment of the community as the site develops.

The largest challenge, however, is a practical one: the sooner scholars and scientists each publish a summary of an area of expertise online, the sooner we all receive a permanent benefit. Scientific societies and universities might encourage the rapid production of such articles by offering lucrative prizes, awarded after publication to the best review article published, as judged by a jury of experts or the appreciation of the public. Health-oriented foundations might fund similar competitions, motivating expert academics to create a persistent information resource that would accelerate the search for treatments. Such competitions might even be employed by corporations that have an interest in determining scholarly consensus on a topic of interest to them.

If not now, when?

Scholars are often asked to write and present similar treatments of the same information in different contexts. An online wiki-based scholarly encyclopedia, however, only requests the contribution of an article once. If every established scholar were to write one brief review on a topic of their expertise, we could produce a dynamic, permanent, accessible, scholarly, and authoritative online encyclopedia in a matter of months. It would instantly become one of the most useful resources ever created, and its benefits to humanity would only increase as its entries were revised and its contents elaborated.

After Gutenberg built his printing press it took more than 200 years before the first scholarly journal was established. The chief obstacle to learned inquiry in those times was not inadequate media, but instead the practices and conventions of researchers. Boyle solved the problem of his age by introducing new modes of scholarly communication that encouraged greater openness and trust, and in doing so helped spark the Age of Enlightenment. Perhaps the solution to our challenge is similar.

If you’re an established researcher interested in summarizing an area of your expertise, or if you would like to write an article in collaboration with someone who is, we’d love to see you propose an article.

  1. Shapin, S, and Schaffer, S. “Leviathan and the Air-Pump: Hobbes, Boyle, and the Experimental Life.” Princeton, N.J.: Princeton University Press, 1985.

  2. Mason, Stephen F. “A History of the Sciences.” New Revise. New York, New York, USA: Macmillan Publishing Company, 1962.

  3. Mabe, Michael. “The Growth and Number of Journals.” Serials: The Journal for the Serials Community 16, no. 2 (2003): 191–197.

  4. Campbell, Robert, and Alice Meadows. “Scholarly Journal Publishing: Where Do We Go from Here?” Learned Publishing 24, no. 3 (July 1, 2011): 171–181.

  5. Ware, Mark. “The stm report: November 2012”. Int’l Assoc. of Sci. Tech. & Med. Pub., 2012.

  6. Althouse, Benjamin M., et al.Differences in impact factor across fields and over time.” Journal of the American Society for Information Science and Technology. 60.1 (2009): 27-34.

  7. Harley, Diane, Acord, Sophia Krzys, Earl-Novell, Sarah, Lawrence, Shannon, & King, C. Judson. (2010). Assessing the Future Landscape of Scholarly Communication: An Exploration of Faculty Values and Needs in Seven Disciplines. UC Berkeley: Center for Studies in Higher Education. Retrieved from:

  8. “Research:Expert Participation Survey.” Wikimedia, 2011. Accessed 16 October, 2012.

  9. “What Wikipedia Is Not.” Wikipedia, Accessed 17 November, 2012.

By: Leo Trottier and Eugene Izhikevich

Acknowledgements: John Jacobson

Announcing the winners of the Brain Corporation Prize

We are excited to announce the top three winners of the Brain Corporation Prize in Computational Neuroscience. The award will be presented at the Computational Neuroscience (CNS’13) meeting in Paris on July 16, 16:10.

  • Second Place (408 G+1): Thomas Kreuz (2012) SPIKE-distance. Scholarpedia, 7(12):30652.
  • Third Place (314 G+1): Zhe Chen and Emery N. Brown (2013) State space model. Scholarpedia, 8(3):30868.

Thanks to all who participated!

Ten reasons to participate in Scholarpedia’s $10k Brain Corporation contest

The Brain Corporation Prize aims to encourage researchers to make freely available the latest and best scholarly information concerning topics in computational neuroscience. To encourage additional contributions, the new deadline for participation in the Brain Corporation Prize contest has been set to June 30th, 2013.

Here are ten reasons (apart from the potential to win prize money) to consider contributing:

  1. Help discover what works in scholarly collaboration — participate in a global experiment on the future of scholarly research.
  2. Add a peer-reviewed article to your C.V.
  3. Support open-access publishing.
  4. Help the public — provide to the world an accurate article on a topic of importance to you.
  5. For posterity — be the author of a review that will be useful for decades to come.
  6. To support interdisciplinary research — encourage others to participate in compiling a free, current, and scholarly online resource.
  7. To see your work appear in a normal Google search — your article will likely appear within the top five search results when its topic is queried.
  8. For Curatorship — become a topic Curator, and help ensure that the world has trustworthy information available to them on a topic of your expertise.
  9. To accelerate research — help science and scholarship advance more quickly by providing an easily accessible and updatable review.
  10. To promote scholarly information online — help resist the glut of redundant and generic online “content” with a substantive, thoughtful, and enduring contribution.

A couple small changes to Scholarpedia

We’re happy to announce two changes to the Scholarpedia interface.

Any of the article’s authors can publish it

We noticed that, after spending weeks writing collaborating and writing an article together, no member of the team of authors would ever do anything that would hurt their relationships with their coauthors. Thus, rather than restrict publication privileges to the article’s “established expert” (as decided by the article’s Sponsor(s)), as of now any of the article’s authors can choose to publish it, doing so in active consultation with the other writers of the article.

Authors choose Curator at time of publication

At time of publication, the publishing author [1] explicitly chooses who, from among the existing authors, becomes the article’s Curator. Of course, in order for the article to have been initially sponsored, a Sponsor needed to vouch for the fact that an established expert was among the authors. As with publication of the article itself, this is a move that will need to be made in close communication with the other authors of the article.

If you have any comments or thoughts on these changes, please feel free to comment here!

[1] That is, whoever among the authors performs the final act of publishing it.


This week’s featured author

This week’s featured author: Nobel laureate Gerard ‘t Hooft (, author and curator of “Gauge theories”

This week’s featured author: Fred “Rusty” Gage

Along with James B. Aimone and Sebastian Jessberger, Dr. Gage (researcher at the Salk Institute for Biological Studies) wrote a review of Adult neurogenesis. As his bio notes, the “implications of Dr. Gage and colleague’s work go well beyond the academic realm by suggesting the possibility of neuron regrowth after brain damage, a paradigm shifting discovery that has led to new advances in the fields of research and medicine.”

His bio is available on the Scholarpedia Main page.

And they’re off! The competition’s first review is published!

Connectivity and anatomical locations of the FEF and other structures.

Congratulations to Mr. Ryan Fox Squire, Mr. Nicholas A. Steinmetz, and Dr. Tirin Moore (all at Stanford University in California), who have written and published Frontal Eye Field, the first review article of the competition! I encourage everyone to check it out.

How did they get their article out so quickly? Because Squire and colleagues are lucky in having started before the competition was announced. Fortunately for all competitors, this same opportunity is available to anyone who joins the author team of an in-progress article (these are the ones in gray as listed here).

(NOTE:  This is an experiment in the future of scholarship and scholarly collaboration — if you have 30 seconds and are thinking of participating, please fill out this ultra-short survey.)

Might competitions be used to build scholarly wiki-style encyclopedias?

Current and aspiring computational neuroscientists: you are invited to participate in a global experiment in scholarship and collaboration. Scholarpedia, with funding from Brain Corporation, would like to develop as a public resource the world’s most open, comprehensive, current, and scholarly computational neuroscience encyclopedia.

To this end, Brain Corporation is offering $10,000 (US) in prizes for writing and publishing the most popular reviews on topics in this field. As a Scholarpedia entry, each article will, prior to publication, undergo normal vetting and peer-review. Only after an article is published will it be eligible to begin receiving votes.

Once the article is published, it will be made publicly available at Scholarpedia under a Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Unported License.

Scholarly and scientific information has for too long been diffusely distributed behind pay-walls. By publishing your review article in Scholarpedia, you make it permanently available to all, and can keep it current by revising it as the field advances.

This week’s featured author: Geoffrey Hinton

Image of Geoffrey Hinton Geoffrey Hinton is one of Scholarpedia’s earliest contributors, and is a giant in the field of computer science, cognitive science, and computational neuroscience. He published the article Boltzmann Machine in 2007 and Deep Belief Networks in 2009. The short biography of him can be found on the Scholarpedia main page. Do check it out!

This week’s featured author: Lynette Jones

Profile image for Dr. Lynette Jones

Lynette Jones, co-author of the book Human Hand Function and Curator of the Scholarpedia article Thermal Touch, is this week’s featured author. Be sure to check out the profile of her on Scholarpedia’s Main Page!