False Positives Are A Fact Of Life In Spam Filtering

from the type-I-and-type-II-errors... dept

Spam filtering companies are now saying that the "collateral damage" of falsely tagging legitimate email as spam is "inevitable", and it's just something we need to deal with. It's a simple trade-off. The fewer false positives you end up with, the more spam is going to get through as well. Still, it appears that some of the filtering systems are getting pretty good. My own combination of filters is at the point where, out of about 2500 spam emails per week, I'm finding maybe 2 to 3 that are false positives (though, there's a chance that some are just getting deleted), and about 5 to 10 actually slip through the filters and make it to my in-box. Those are pretty good percentages. Still, not everyone is setting up filters, and as someone in the article points out, the real solution needs to be a combination of many factors, from technology, education and government.
Hide this

Thank you for reading this Techdirt post. With so many things competing for everyone’s attention these days, we really appreciate you giving us your time. We work hard every day to put quality content out there for our community.

Techdirt is one of the few remaining truly independent media outlets. We do not have a giant corporation behind us, and we rely heavily on our community to support us, in an age when advertisers are increasingly uninterested in sponsoring small, independent sites — especially a site like ours that is unwilling to pull punches in its reporting and analysis.

While other websites have resorted to paywalls, registration requirements, and increasingly annoying/intrusive advertising, we have always kept Techdirt open and available to anyone. But in order to continue doing so, we need your support. We offer a variety of ways for our readers to support us, from direct donations to special subscriptions and cool merchandise — and every little bit helps. Thank you.

–The Techdirt Team


Reader Comments

Subscribe: RSS

View by: Time | Thread


  • identicon
    Richard, 20 Feb 2004 @ 1:01pm

    Spambayes - no false positives

    I've been using spambayes.sf.net for 6 months now, and not a single false-positive. It doesn't take a "black or white" approach, but rather if a message falls inside an "unsure" range, then it's flagged as such. That way those messages, about one or two a week, may be filtered into a different folder - usually to be subsequently tagged as spam.

    reply to this | link to this | view in chronology ]

  • identicon
    Anonymous Coward, 20 Feb 2004 @ 2:03pm

    No Subject Given

    Sound like pretty bad percentages to me. Scale that up to an enterprise getting a couple hundred thousands spams a week, and that's a helluva lot more false positiives, each of which has to be dealt with by someone. Loss of productivity would be enormous.

    reply to this | link to this | view in chronology ]


Add Your Comment

Have a Techdirt Account? Sign in now. Want one? Register here



Subscribe to the Techdirt Daily newsletter




Comment Options:

  • Use markdown. Use plain text.
  • Make this the First Word or Last Word. No thanks. (get credits or sign in to see balance)    
  • Remember name/email/url (set a cookie)

Close

Add A Reply

Have a Techdirt Account? Sign in now. Want one? Register here



Subscribe to the Techdirt Daily newsletter




Comment Options:

  • Use markdown. Use plain text.
  • Make this the First Word or Last Word. No thanks. (get credits or sign in to see balance)    
  • Remember name/email/url (set a cookie)

Follow Techdirt
Sponsored Promotion
Public Money, Public Code - Sign The Open Letter at publiccode.eu
Essential Reading
Techdirt Deals
Report this ad  |  Hide Techdirt ads
Techdirt Insider Chat
Recent Stories

This site, like most other sites on the web, uses cookies. For more information, see our privacy policy. Got it
Close

Email This

This feature is only available to registered users. Register or sign in to use it.