DailyDirt: Measuring Scientific Impact Is Far From Simple

How do you measure the impact of a scientist's research? Some common metrics include the number of publications in peer-reviewed and high-impact journals, the number of citations, etc. But it's more complicated than just using the quantity and quality of a scientist's peer-reviewed publications to determine their significance in the scientific community. Here are a few more things to consider. If you'd like to read more awesome and interesting stuff, check out this unrelated (but not entirely random!) Techdirt post via StumbleUpon.
Hide this

Thank you for reading this Techdirt post. With so many things competing for everyone’s attention these days, we really appreciate you giving us your time. We work hard every day to put quality content out there for our community.

Techdirt is one of the few remaining truly independent media outlets. We do not have a giant corporation behind us, and we rely heavily on our community to support us, in an age when advertisers are increasingly uninterested in sponsoring small, independent sites — especially a site like ours that is unwilling to pull punches in its reporting and analysis.

While other websites have resorted to paywalls, registration requirements, and increasingly annoying/intrusive advertising, we have always kept Techdirt open and available to anyone. But in order to continue doing so, we need your support. We offer a variety of ways for our readers to support us, from direct donations to special subscriptions and cool merchandise — and every little bit helps. Thank you.

–The Techdirt Team

Filed Under: academics, citations, co-authors, h-index, merit, metrics, peer review, publication, science, scientific impact, tenure


Reader Comments

Subscribe: RSS

View by: Time | Thread


  • identicon
    Anonymous Coward, 11 Nov 2013 @ 6:40pm

    There are probably tons of obscure math papers that we won't know the "true" impact of for centuries. maybe we shouldn't be giving tenure in the first place.

    reply to this | link to this | view in chronology ]

    • identicon
      Anonymous Coward, 11 Nov 2013 @ 7:05pm

      Re:

      What does tenure have to do with obscure mathematics and potential future impact thereof?

      I do not understand this war on education. Clearly it is in our best interest to become more educated, not less. I understand that an uneducated populace is easier to rule, but to what end. A frivolous free reign of unbridled opulence is hardly a worthwhile endeavor. And why do those with massive wealth fear an educated populace? Seems it would be to their benefit not hindrance.

      reply to this | link to this | view in chronology ]

  • identicon
    Pixelation, 11 Nov 2013 @ 8:20pm

    "However, a recent study has shown that current mathematical models that predict a scientist's future performance based on their past performance aren't reliable and shouldn't be used in career advancement decision processes."

    I imagine they will be like the entertainment industry and ignore the data. Better to make up whatever the hell they want and tout it as the truth.

    reply to this | link to this | view in chronology ]

  • identicon
    Pixelation, 11 Nov 2013 @ 8:21pm

    "A study has found that grant size doesn't strongly predict a researcher's scientific impact."

    I bet the author of the study has a small grant...

    reply to this | link to this | view in chronology ]

  • identicon
    Anonymous Coward, 11 Nov 2013 @ 10:03pm

    It is virtually impossible to asses what the possible future impact of scientific research will have, especially in the short term.

    Consider for example the battery, it was the product of scientific research and was developed over 100 years before it found any real application, 100 years !!!!.

    What impact has the battery had on the world ?

    reply to this | link to this | view in chronology ]

  • icon
    DNY (profile), 12 Nov 2013 @ 7:52am

    Bibliometric follies in the Heartland

    At my university, a large state university in a Great Plains state, our administration (and appallingly a faculty "task force") had the incredibly stupid idea of using bibliometric data (number of citations over a ten year period) to compare between fields. It turns out the average number of citations a paper receives in the short-run strongly correlates with the average number of citations in the bibliography of papers in the same discipline as the paper. The typical bibliography in microbiology and immunology runs for several pages (in small print) while the typical bibliography in mathematics might have from two to ten citations (there are longer ones, but they aren't typical -- in mathematics it is an honor to have your result turn "classical" and be cited and used without citation to the original paper in the bibliography).

    Add to the folly that they proposed using data from commercial publishers whose database excludes the major house journals of some professional societies (notably the Association for Symbolic Logic) and the journals (some published by professional societies, others online only) set up by academicians in protest against abusive practices of commercial publishers.

    This baleful trend is part of the rise of the all-administrative university in which management types, whatever lip-service they provide to the actual purpose of universities, behave as if university administration is the core function of a university, rather than research, scholarship or education.

    reply to this | link to this | view in chronology ]

  • icon
    ChrisB (profile), 12 Nov 2013 @ 8:13am

    How Science Goes Wrong

    reply to this | link to this | view in chronology ]


Add Your Comment

Have a Techdirt Account? Sign in now. Want one? Register here



Subscribe to the Techdirt Daily newsletter




Comment Options:

  • Use markdown. Use plain text.
  • Remember name/email/url (set a cookie)

Close

Add A Reply

Have a Techdirt Account? Sign in now. Want one? Register here



Subscribe to the Techdirt Daily newsletter




Comment Options:

  • Use markdown. Use plain text.
  • Remember name/email/url (set a cookie)

Follow Techdirt
Special Affiliate Offer

Essential Reading
Techdirt Insider Chat
Recent Stories

This site, like most other sites on the web, uses cookies. For more information, see our privacy policy. Got it
Close

Email This

This feature is only available to registered users. Register or sign in to use it.