(Mis)Uses of Technology

by Mike Masnick

Opening The Backdoor To The Google Platform

from the worth-the-effort? dept

In a move that looks much more designed to be about getting publicity than actually being useful, someone has released, as open source, code needed to scrape Google, and present a Google clone -- sans ads. There's a bunch of blather from the guy who did this about how he's trying to take back the internet from commercial interests or something and he fully expects Google to sue him, but it does raise some interesting legal questions. Part of his claim is that Google is making money by scraping other sites without permission and putting ads on it. So, considering that it was legal for them to scrape other sites, his belief is that it's perfectly legal to scrape Google's site and take the ads away. Of course, Google does let those who request it be removed from their index. Either way, this does highlight the legal question of whether or not compiling a database of publicly available info is copyrightable itself. It's probably in Google's best interest to simply let this one lie. The guy is obviously looking for a fight, and honestly, the number of people likely to use such a thing is going to be tiny compared to how many will continue to just use Google. The argument that it's a "loss of advertising revenue" isn't going to hold much weight -- as anyone who goes through the trouble of using this instead of Google directly is unlikely to click on the ads anyway. Also, Google could let this thing run its course to see how many people use it as a backdoor into using Google as a platform to design more compelling applications. If people do, that could give Google some direction in how to push forward with their own open API plans.

Reader Comments (rss)

(Flattened / Threaded)

  1. identicon
    Brandon, Jan 11th, 2005 @ 5:13pm

    Oh, those kooks?

    Ah, Orlowski and Daniel Brandt, hadn't heard from them in a while.

    reply to this | link to this | view in thread ]

  2. identicon
    sfb, Jan 12th, 2005 @ 3:56pm


    Google's robots.txt pretty clearly forbids this, so there isn't any comparison to google crawling other web sites, since google DOES obey robots.txt.


    reply to this | link to this | view in thread ]

  3. identicon
    Tim, Jan 13th, 2005 @ 12:09am

    No Subject Given

    The site looks at lot like Google as seen by Firefox with adblocking turned on. Why bother?

    reply to this | link to this | view in thread ]

  4. identicon
    Scrape Google, Nov 21st, 2009 @ 6:35am

    Scraping Google for Fun and Profit

    A very detailed article including very advanced PHP source code about Google scraping can be found here: http://google-scraper.squabbel.com

    I've used it to scrape 300,000 results about a niche in Internet Marketing I was researching about.

    Very powerful and a good read!

    reply to this | link to this | view in thread ]

Add Your Comment

Have a Techdirt Account? Sign in now. Want one? Register here
Get Techdirt’s Daily Email
Use markdown for basic formatting. HTML is no longer supported.
  Save me a cookie
Follow Techdirt
Insider Shop - Show Your Support!

Report this ad  |  Hide Techdirt ads
Essential Reading
Techdirt Deals
Report this ad  |  Hide Techdirt ads
Techdirt Insider Chat
Report this ad  |  Hide Techdirt ads
Recent Stories
Report this ad  |  Hide Techdirt ads


Email This

This feature is only available to registered users. Register or sign in to use it.