Academic Journals Seeing Benefits In More Open Peer Review

from the freedom-is-powerful dept

We recently discussed the idea of much more open, online-based peer review processes. In the ensuing discussion some claimed that such things might work for subject areas like math, where concepts could be reviewed and tested by others, but might not work as well in other areas. However, a recent experiment by the Shakespeare Quarterly to experiment with a more open, online peer review system apparently worked quite nicely:

Mixing traditional and new methods, the journal posted online four essays not yet accepted for publication, and a core group of experts -- what Ms. Rowe called "our crowd sourcing" -- were invited to post their signed comments on the Web site MediaCommons, a scholarly digital network. Others could add their thoughts as well, after registering with their own names. In the end 41 people made more than 350 comments, many of which elicited responses from the authors. The revised essays were then reviewed by the quarterly's editors, who made the final decision to include them in the printed journal, due out Sept. 17.
Even one of the authors who was quite skeptical of the program as "entirely won over" by the end, noting that the comments were "more extensive and more insightful" than he was used to receiving on his works.

6 Comments | Leave a Comment..


If you liked this post, you may also be interested in...
 

Reader Comments (rss)

(Flattened / Threaded)

  1.  

    academic peer review

    identicon
    B. Nicholson, Aug 31st, 2010 @ 2:13am

    Elderly peer review is an adequate system for youngsters learning to write. Crowd sourcing may be a nice way to fluff out a review, but only the intensity of an educated mind prepared for surprises can make the breakthroughs upon which humanity must ultimately depend.
    Why? Because nobody wants the work of comprehending novelty. Our most foresightful works are published, if at all, in peripheral journals. The birth of radio astronomy is a good example. Our most advanced thinkers can not be published at all. Leonardo was forced to self-publish his folios, which went unrecognized as anything but pretty pictures for more than 500 years.
    So, no. Do not count on peer-review to discover anything whatsoever. Instead, wait for all the old men to die upon their golden thrones, then we will have progress, maybe. One cannot climb up upon the shoulders of giant imbeciles without sticking one's buttocks into the faces of our recognized scientific greats. So long as money funds science and science pays a living wage, airheads will get those jobs. Open an area of inquiry and some nit-wit thumpkin will apply for a fraudulent patent or copyright for it.

    reply to this | link to this | view in thread ]

  2.  

    Re: academic peer review

    icon
    Richard (profile), Aug 31st, 2010 @ 2:56am

    You have something of a point there - although I think you overstate it. Some fields are more tolerant of advanced thinking than others. The theoretical physics community is pretty good in this respect - it tends to tolerate crazy ideas - after all it is fromt his field that the quotation "we are all agreed that you are crazy, what we are arguing about is wheter you are crazy enough to be right."

    reply to this | link to this | view in thread ]

  3.  

    Re: Re: academic peer review

    identicon
    Anonymous Coward, Aug 31st, 2010 @ 4:58am

    For now, it was not that way in the past.
    Renewal will guarantee that next generations will have different point of views of the current ones and that is for better or for worst.

    The mechanics of social interactions will forge new groups of thought that will focuses on the maladies of their current system and naturally try to fix things, that can change things in unexpected ways.

    reply to this | link to this | view in thread ]

  4.  

    Skeptical

    identicon
    The other coward, Aug 31st, 2010 @ 5:29am

    I'm still skeptical if this could work on a large scale. Sure, it will work well for popular subjects or while it's novel, but what happens when there are 100,000+ papers online to be reviewed in 100s of different locations?

    Someone has to find it and be interested in it enough to spend the time. With a ton of options, I see many being neglected especially in the more obscure fields of study.

    The issues are not insurmountable, but they seem to be frequently ignored or glossed over.

    reply to this | link to this | view in thread ]

  5.  

    Re: Skeptical

    identicon
    Milo B Farnsworth, Aug 31st, 2010 @ 10:01am

    Hmmm, finding people with interest and time...

    If only we had some way of contacting or connecting with these people.

    reply to this | link to this | view in thread ]

  6.  

    Re: Skeptical

    identicon
    Milo B Farnsworth, Aug 31st, 2010 @ 10:01am

    Hmmm, finding people with interest and time...

    If only we had some way of contacting or connecting with these people.

    reply to this | link to this | view in thread ]


Add Your Comment

Have a Techdirt Account? Sign in now. Want one? Register here
Get Techdirt’s Daily Email
Save me a cookie
  • Note: A CRLF will be replaced by a break tag (<br>), all other allowable HTML will remain intact
  • Allowed HTML Tags: <b> <i> <a> <em> <br> <strong> <blockquote> <hr> <tt>


A word from our Sponsors...
Follow Techdirt
Flattr rss rss
From the Techdirt Archive...
A word from our Sponsors...

Close

Email This