Beyond The Privacy Outcry, AOL Search Data Actually Is Interesting Info

from the oh,-right,-the-research... dept

Beck writes “There has been much hoopla over the privacy concerns regarding AOL’s release of search data. Lost in the excitement is the fact that AOL had good intentions. They wanted to give researchers a window into how people use online search. If you step back for a moment and take a look, the findings are interesting.

Lee Gomes of the Wall Street Journal published the results of his research. He did not approach the story from the privacy angle, but rather from the view of a researcher who wants to know how people use the Internet.

He found, for example, that the most common search term is the word “free”. Also interesting is that 47% of searches resulted in no click by the user. 28% of searches were refinements of previous searches, and 42% of the time the user clicks on the first item in the search results.

The article includes additional data, and a look at the quality of the search results.”


Rate this comment as insightful
Rate this comment as funny
You have rated this comment as insightful
You have rated this comment as funny
Flag this comment as abusive/trolling/spam
You have flagged this comment
The first word has already been claimed
The last word has already been claimed
Insightful Lightbulb icon Funny Laughing icon Abusive/trolling/spam Flag icon Insightful badge Lightbulb icon Funny badge Laughing icon Comments icon

Comments on “Beyond The Privacy Outcry, AOL Search Data Actually Is Interesting Info”

Subscribe: RSS Leave a comment
19 Comments
Matt says:

Good intentions?

If I recall correctly, isn’t the road to hell supposed to be paved with good intentions? What if I don’t *want* to give researchers a “window into how [I] use the Internet?” Isn’t that what all of these cookies does?

I want to be able to use the Internet ANONYMOUSLY, without having to wonder if any personally identifying information is being used for purposes that I don’t explicitly agree to. Figure THAT into your data!

joshua nolan (user link) says:

great tool for looking at the data..

We threw up our site to search the data (www.dontdelete.com) and were sooooo surprised but the results. Not just the freaky stuff (which is entertaining).. but also, after looking at the data for so long, query after query, you realize how technically inept AOL users. There must be something confusing about the AOL interface too.. users constantly search for http://www.website.com. Just dumb.

Scott says:

Re: great tool for looking at the data..

Not just AOL users.. but the majority of internet users search for http://www.website.com to find the website they want to go to.

Most people do not know how to use an address bar.. they think you use the search box to get where you want to go and the address bar shows you where you are.

I have a dozen websites and the majority of my traffic comes from people searching for the domain name.

Anonymous Coward says:

Re: Ya, well...

your comparison is quite a stretch. we know that it wasn’t a cool thing for AOL to do. it’s done and over with. no one can take it back. how about instead of complaining repeatedly about it, we learn from the information that was garnished from it.

jeez. this article isn’t condoning what AOL did.

and also if someone drops millions of stolen cash over the city, i know a hell of a lot of you would have a go at trying to take some.

Dan says:

Re: Ya, well...

Well, though the comparison is obviously not valid in terms of the injustice, your comparison to the Nazi torture is interesting.

If a wrong has been done, but you can learn from the results, is it ok to make use of the data?

Nuremburg (I think it was Nuremburg) said no, but I personally think that looking at the data is interesting and should be done. And obviously most of the people on this board agree, even though they’re pissed off about it — because they’ve looked at the data.

It really is too bad AOL botched this so bad, because properly sanitized search data would be an interesting thing to release, every once in a while.

Dom says:

Funny.

There are some really funny searches I’ve found that people have made. For instance:

“don’t buy pepsi in the new can. pepsi has a new patriotic cancoming out with pictures of the empire state building and thepledge of allegiance on them.however pepsi left out two little words on the pledge under god. pepsi said they didn’t want to of”

I can’t see why any person would search for that. It doesn’t make sense.

Then there’s just the funny questions:

“how do you now if you lost your virginity”

Some people are just so technologically inept.

Anonymous Coward says:

Re: Funny.

>> I can’t see why any person would search for that. It doesn’t make sense.

I make similar seaches all of the time. They were obviously searching for the original source of a post or email they saw. This is the same method a lot of teachers use when they suspect a student of plagiarism.

The virginity question was very odd, and probably submitted by a curious adolescent. Though the question itself is humorous, this type of search query isn’t as useless or “noob-ish” as it might appear. Often times, a search with a query such as “how do you make grilled-cheese sandwiches” will return results from a forum of someone else asking the exact same question, along with the answer.

Paragraph searcher says:

Re: Funny.

I do searches like that all the time (I like to think on better topics though) – well, not all the time, but rather when someone sends me an email about something which they believe that turns out to be a hoax, an example would be that mars email that keeps floating around where mars is going to be closet to earth than ever before on such and such a date. If you search on a paragraph or so of the text you can usually find it listed on a hoax site, or ripped apart by a blogger somewhere. I’m guessing that thing about pepsi was a forwarded junk mail that someone was trying to verify the validity of the info it contained.

E says:

will the research improve user interfaces to searc

It would be nice if some of that research spurred search companies to help you refine your search better.

Having worked for a company whose bread and butter was based on natural langauge search, it’s remarkable how the queries did not resemble natural language.

Also, significant numbers of searches were:

a) repeats (you would think that with a wide user-base,

that there would be low incidence of repeats… we had over 20%

b) urls or domain names

let DNS find them for you

c) whole cut-n-paste paragraphs

these were so nasty we had to limit the length of queries to keep them from killing the search engine(s).

but the area of most impact would have been to create interfaces that help the user refine their query faster…

ie: dont look so hard when they say:

“I want to do a book report on a manatee”

but assist them enough so that their final query is NOT simply:

“manatee”

-E

Mike (profile) says:

Re: Re:

and beck is whom? and you’re ripping off what he said why? seriously… next time why not put out an article that’s 100% quoted, leave the “Beck said” part out… in fact, fuck the quotes… just a link..

Apparently you’re not familiar with how things work around here. Beck is someone who submitted that story and wrote things up. Sometimes we write up our own stories, sometimes we post submissions. We didn’t rip it off, he submitted it to us to post.

Add Your Comment

Your email address will not be published. Required fields are marked *

Have a Techdirt Account? Sign in now. Want one? Register here

Comment Options:

Make this the or (get credits or sign in to see balance) what's this?

What's this?

Techdirt community members with Techdirt Credits can spotlight a comment as either the "First Word" or "Last Word" on a particular comment thread. Credits can be purchased at the Techdirt Insider Shop »

Follow Techdirt

Techdirt Daily Newsletter

Ctrl-Alt-Speech

A weekly news podcast from
Mike Masnick & Ben Whitelaw

Subscribe now to Ctrl-Alt-Speech »
Techdirt Deals
Techdirt Insider Discord
The latest chatter on the Techdirt Insider Discord channel...
Loading...