Wikipedia To Experiment With Color-Coded Warnings On Quality

from the good-ideas dept

It always seems misguided when people complain about quality problems in Wikipedia while ignoring identical quality problems in other media -- and the fact that it's easier and faster to make corrections in Wikipedia when those errors are discovered. One thing that defenders of Wikipedia often point out, is that it's easy to check the history page of any Wikipedia entry to get a sense of whether or not a particular tidbit of info has survived the test of time or was just recently dumped on the page (or if there's been any controversy over it). However, the truth is not too many people actually bother to check the history page (even among those who bring it up as a defense of Wikipedia). It appears that Wikipedia may start experimenting with a creative idea to help deal with this: color coding sections of Wikipedia entries. If a change was made by a new or untrustworthy user, Wikipedia could color code it as red so any readers would know to be even more skeptical than usual about that information. As the information survives the test of time, then it could fade to black (so to speak). At the same time, users who have a long history of making trustworthy edits would have their edits more quickly "trusted" within the color coded system. It's a creative idea that seems to make a lot of sense for improving the overall quality of Wikipedia. It's almost a shame we can't do the same thing with other forms of media as well. The plan is apparently to test this system on the smaller Wikia community before rolling it out on Wikipedia, but it seems like an experiment worth following.


Reader Comments (rss)

(Flattened / Threaded)

  1.  
    identicon
    lee, Aug 8th, 2007 @ 12:19pm

    Red for left

    I suggest bright red for fanatic, obsessive, partisan lefties. Anything on wikipedia that can in any way be subverted to scream some whack lefty cause will be pounded to destruction.

     

    reply to this | link to this | view in thread ]

  2.  
    identicon
    MrBobDobalina, Aug 8th, 2007 @ 12:22pm

    A far simpler alternative

    A less ambitious but still useful idea would be to indicate the volatility of an article (or section) based on the number of edits in the past x days in proportion to the number of views. This wouldn't provide a measure of accuracy, but would instead be an indication of how widely accepted the article's contents are. More edits in proportion to views indicates that the contents are either in dispute or still emerging (new articles).

    I suggested this to wikipedia and was informed that they don't keep records of how many users visit a page. Wouldn't tracking page views (and calculating the reliability) be far easier than analyzing every edit ever made?

     

    reply to this | link to this | view in thread ]

  3.  
    identicon
    Matt, Aug 8th, 2007 @ 12:23pm

    Wiki Terror Threat/George Bush quote Level : Cyan!

    As an idea this would be nice overall if it is implemented well via wiki. I agree with you mike, there are tons of things that need this.

     

    reply to this | link to this | view in thread ]

  4.  
    identicon
    Anonymous Coward, Aug 8th, 2007 @ 12:29pm

    ""I think this is a great idea!""

     

    reply to this | link to this | view in thread ]

  5.  
    identicon
    Anonymous Coward, Aug 8th, 2007 @ 12:32pm

    So much for the =red= =/red= sarcasm tags...

     

    reply to this | link to this | view in thread ]

  6.  
    identicon
    McCarthy, Aug 8th, 2007 @ 12:35pm

    Re: Red for left

    I always think of fanatic as a guy who bombs things or shoots stuff. In the US that is reserved for the right.
    The left are worst there are tons of them and they whine and ask for my money.

     

    reply to this | link to this | view in thread ]

  7.  
    identicon
    Concerned Citizen, Aug 8th, 2007 @ 12:38pm

    Wait a minute

    Wikia, Incorporated, is a seperate for-profit company owned by Jimbo Wales. It's funny how ALL of Wikipedia has "nofollow" on their URLs... except to Wikia.com and Amazon.com external links (Amazon invested $10,000,000 in Wikipedia, public record).

    Why is that?

     

    reply to this | link to this | view in thread ]

  8.  
    identicon
    Krayol, Aug 8th, 2007 @ 12:45pm

    Great idea

    I like it. So long as the pages don't become confused by swirls of colour then it should be a sensible addition to a great resource.

     

    reply to this | link to this | view in thread ]

  9.  
    identicon
    AskTheAdmin, Aug 8th, 2007 @ 12:57pm

    This will be great

    We really like this idea over @ AskTheAdmin. It will add a bit more reliability to the site. We just wrote about how they started doing sms / text message responses over here. They have lots of new innovations recently is something going on over there?

     

    reply to this | link to this | view in thread ]

  10.  
    identicon
    gettit, Aug 8th, 2007 @ 12:59pm

    Re; Wait a minute

    Why is that? Because those are businesses they are directly affiliated with. Wow.

    I think a cool thing would be to actually change the darkness of the text as it remains unchanged over time. Probably unusable and annoying, but it seems like I could get a decent sense of the stability of a sentence that way. Between the number of edits and the similarity after changes, it would be pretty easy to do.

     

    reply to this | link to this | view in thread ]

  11.  
    identicon
    boost, Aug 8th, 2007 @ 1:10pm

    Re: A far simpler alternative

    Because, obviously, everything that is widely accepted is true. Let's think of some things that are widely accepted...'I-pod is the best'...'toyota's have the best quality'...'politicians serve the people'

    Yup, all those things must be true.

     

    reply to this | link to this | view in thread ]

  12.  
    identicon
    Wikiality, Aug 8th, 2007 @ 1:29pm

    Wikitastic!

    Yes! This will make vandalizing wiki so much more fun! I want my edits to show up in the brightest color possible! Elephants I say!

     

    reply to this | link to this | view in thread ]

  13.  
    identicon
    MrBobDobalina, Aug 8th, 2007 @ 1:37pm

    Re: Re: A far simpler alternative

    @boost
    Because wikipedia is edited by people and the information is never verified it can only be considered a representation of what people believe, not what is true. Therefore, even by analyzing all the edits as proposed they'll only have a measure of how a user's edits contrast with the wider user base. "Facts" that don't get replaced aren't necessarily true, they're just not widely refuted.

    In response to your overly sarcastic comment, a wiki article stating that 'toyotas have the best quality' would be edited by numerous people, possibly sparking an edit war. Therefore, the number of edits in proportion to the visitors would be higher than normal and would signal that the information wasn't widely accepted. So it would work in that instance. As for your iPod example, that's an opinion and therefore not capable of being fact.

    Your comment wasn't productive and doesn't foster problem solving. Try contributing something worthwhile. Instead of bashing someones idea, suggest how it could be improved.

     

    reply to this | link to this | view in thread ]

  14.  
    identicon
    Beefcake, Aug 8th, 2007 @ 2:09pm

    Consistent Voice

    My caution with wikipedia isn't that it's more or less reliable than "other media" overall, but that the information on any given topic is from inconsistent sources and you never know what you're going to get. Anyone can post anything on any topic on Wikipedia, and stand nothing to personally lose if they are inaccurate. Maybe it was fact-checked by the site, maybe not. Conversely, only those who meet the standards of (example) the BBC are allowed to provide information via that channel, and if they screw up they have their jobs, personal credibility, and/or careers at stake.

    Of course, even the BBC occasionally puts a cab-driver on the air, which proves that even reliable, consistent sources can be fallible. But that fact actually provides a strong telling point -- if the trained media with something to lose and who are committed to upholding standards can fail, then a website with anonymous posters and anonymous fact-checkers for all topics is a whole wide universe of failure.

    Wikipedia is a tool that provides a good entry point for basic facts on basic topics. If I want to know Justin Timberlake's birthday, I'll use wikipedia. If I need to know which pitcher gave up Hank Aaron's home run, yeah, Wikipedia is probably find. But if I need a summation of the history of Algeria; I'll find another source I've come to trust more (such as the Country Profiles on the BBC).

    If a site needs color-coding to identify worthless or unsubstantiated content, it's probably not worth using very much.

     

    reply to this | link to this | view in thread ]

  15.  
    identicon
    kweeket, Aug 8th, 2007 @ 2:51pm

    Re: Consistent Voice

    As an occasional editor of Wikipedia, I wanted to point out that one of the goals of the project is to provide a citation for any stated fact. That way, a reader can trace that statement back to a (presumably) reputable source, such as the New York Times or the BBC, who does employ fact-checkers.

    Wikipedia isn't verified - how could it be, when it is constantly changing? - but it's supposed to be VERIFIABLE. It's up to the reader to check the citations and decide if the source is trust-worthy or not.

     

    reply to this | link to this | view in thread ]

  16.  
    identicon
    Calix, Aug 8th, 2007 @ 3:14pm

    The veracity of information

    I recently deeply annoyed a good friend of mine by asserting that the Internet in general (and Wikipedia in particular) is a much more reliable source of factual information than the New York Times. (I picked on the NYT simply because he was a reporter there for six years, which also explains his deep annoyance!)

    If I create a web site, for example, stating that "the Empire State Building is constructed primarily of cheese," it is my experience that some structural engineer will soon put up a competing web site explaining why this couldn't be true because of the laws of physics, and an architect will put up yet another web site referencing historical documents (carefully scanned and posted) showing how it was actually built, etc.

    If I posted to Wikipedia that "the Empire State Building is constructed primarily of cheese," then those same experts will quickly correct the information.

    If the NYT, however, states in a front-page article that "the Empire State Building is constructed primarily of cheese", then at best a week later I might get a correction on page B-17 that no one reads. Of course, we all know the NYT would NEVER print something that wasn't factually correct, either by mistake, bias or intent. My friend tried to assure me that such a thing could never happen at the NYT, because of tradition and fact-checking and the like, but there simply isn't a mechanism for outside review.

    The Internet is nothing BUT outside review! The fact that any whacko can post any old thing on the Internet (such as I'm doing right now) means that there is no "filter" to keep any and all information from being accessable - or from someone from correcting a whacko post such as I'm currently typing (like the post you're about to type in response to my whacko comments herein.)

    Sure, trust the NYT (or the BBC) - but even they get it wrong sometimes, and it's fun to see how ticked off they get when the blogosphere catches them on it!

    And that is the beauty - and the power - of the Internet, as exemplified by Wikipedia.

     

    reply to this | link to this | view in thread ]

  17.  
    identicon
    DittoBox, Aug 8th, 2007 @ 4:29pm

    Re: Red for left

    You're at the wrong place.

    Maybe you wanted this heaping pile of steaming horse crap instead:
    http://www.conservapedia.com/Main_Page

     

    reply to this | link to this | view in thread ]

  18.  
    identicon
    |333173|3|_||3, Aug 8th, 2007 @ 9:26pm

    Re: Re: Red for left

    The use of Red for teh Left and Blue for the right is the norm in both Europe and the Commonwealth, and the inverted use of colours is a US oddity. OTOH, the idea that text should be coloured based on the possible biased uses of it is absurd.

     

    reply to this | link to this | view in thread ]

  19.  
    identicon
    NonW00t, Aug 9th, 2007 @ 11:25am

    I suggest white text on white page background. Will solve ALL problems..............

     

    reply to this | link to this | view in thread ]

  20.  
    identicon
    Jeff, Aug 9th, 2007 @ 1:38pm

    Re: Re: A far simpler alternative

    "se, obviously, everything that is widely accepted is true. Let's think of some things that are widely accepted...'I-pod is the best'...'toyota's have the best quality'...'politicians serve the people'"

    Umm..those things are not widely accepted.

     

    reply to this | link to this | view in thread ]

  21.  
    identicon
    Clueless citizen, Aug 10th, 2007 @ 12:41am

    Re: Wait a minute

    The two statements in your comment you're using to make a point are both false. There are over 350 external sites that don't have "nofollow" on Wikipedia... Wikia is only one of many... probably because Wikia is open source and host wikis... like many of the others on the list. Also, Amazon did not invest in Wikipedia (they only take donations, so check again) and Amazon is not one of the 350.

     

    reply to this | link to this | view in thread ]


Add Your Comment

Have a Techdirt Account? Sign in now. Want one? Register here
Get Techdirt’s Daily Email
Save me a cookie
  • Note: A CRLF will be replaced by a break tag (<br>), all other allowable HTML will remain intact
  • Allowed HTML Tags: <b> <i> <a> <em> <br> <strong> <blockquote> <hr> <tt>
Follow Techdirt
A word from our sponsors...
Essential Reading
Techdirt Reading List
Techdirt Insider Chat
A word from our sponsors...
Recent Stories
A word from our sponsors...

Close

Email This