How To Lie With Statistics: France Pretends HADOPI Law Is Working

from the doing-the-math dept

The French government was one of the first to push for a three strikes policy to kick people off the internet based on accusations (not convictions) of copyright infringement. So, I guess it should be no surprise that they feel like lying with statistics to make the program sound better. The government and various agencies are running around touting the claim that, according to their survey the HADOPI law has convinced more than 50% of users to stop file sharing. Problem is, that's not what the data really says. The real data shows that of people surveyed only 7% said either they "or someone close" had received a warning letter. Now, of those 7%, 50% claimed that they would stop infringing.

Now, if you're playing along with the home game, you should have quickly realized that the actual percentage of people surveyed is more like 3.5% -- and I could argue that it's even lower for a few key reasons:
  • The key question asked wasn't whether the individual would stop file sharing, but whether or not they or someone close to them had. Suddenly you have a big statistical problem, because -- to take an extreme example -- let's say that everyone in a town knows the one big file sharer who shares content online, but no one else in the town does. And, that guy knows and makes it clear that if he gets an injunction, he'll stop. Now, since everyone knows this guy, the reports from that town would be that 100% of people receive letters and 100% of those recipients would stop using P2P, even if that wasn't true at all. Including the "or someone close to you" makes the effective data pretty close to useless, because there's no way to separate out the overlap.
  • The whole thing is based on a survey, which is notoriously unreliable in getting accurate data. People quite frequently answer what they think others want them to say, rather than what they're really thinking. And, when asking them if they'll stop engaging in illegal activity, many are simply going to say yes, even if they have no intention to follow through.
So, if you add that all up, suddenly we're talking about a very tiny fraction of users claiming that they'll actually change their behavior based on a notice, but with a little fun and games, people can pretend that the numbers are much higher than they really are.


Reader Comments (rss)

(Flattened / Threaded)

  •  
    identicon
    Anonymous Coward, May 16th, 2011 @ 4:54am

    43% of all statistics are meaningless

    It is said that 43% of all statistics are meaningless. It looks like Frances's HADOPI supporters draw exclusively from that pool of purely meaningless numbers.

    What do we expect from a law pronounced Ha Dopey.

     

    reply to this | link to this | view in chronology ]

  •  
    icon
    A.R.M. (profile), May 16th, 2011 @ 5:04am

    But it *is* working!

    I haven't downloaded anything from France since this law was introduced.
    >:)

    @Seriousness:
    Why not just let this law stew in its own stupidity? If the article says the survey data is wrong on logic, does it mean anyone in France will actually believe it?

    In two years, there will be news another law is needed because HADOPI isn't working.

    Hey, this sounds familiar. :|

     

    reply to this | link to this | view in chronology ]

  •  
    icon
    Jay (profile), May 16th, 2011 @ 5:51am

    Wait a minute...

    Speaking of Hadopi, they just got hacked.

    Link

    They'll be out of commission for a while.

     

    reply to this | link to this | view in chronology ]

  •  
    icon
    fogbugzd (profile), May 16th, 2011 @ 5:58am

    The only meaningful statistic is one that shows whether music and movie sales have dramatically increased due to Hadopi.

     

    reply to this | link to this | view in chronology ]

  •  
    identicon
    FuzzyDuck, May 16th, 2011 @ 6:05am

    And the real question should be...

    Are you now buying more or less music/movies?

     

    reply to this | link to this | view in chronology ]

  •  
    identicon
    Anonymous Coward, May 16th, 2011 @ 6:07am

    "Are you now buying more or less music/movies?"

    Yes, but none of it French.

     

    reply to this | link to this | view in chronology ]

  •  
    icon
    Josef Anvil (profile), May 16th, 2011 @ 6:37am

    Ah surveys.... Ask the TSA

    Im pretty sure 99.9999% of people boarding a plane will say 'no' when asked if they or someone they know is carrying a bomb or intends to highjack the plane.

    So why the need for scanners or pat downs?

     

    reply to this | link to this | view in chronology ]

  •  
    identicon
    Liz, May 16th, 2011 @ 6:48am

    There are three kinds of lies. Lies, damned lies, and statistics.
    - a quote popularized in the U.S. by Mark Twain

    -- from another source.

     

    reply to this | link to this | view in chronology ]

  •  
    identicon
    Anonymous Coward, May 16th, 2011 @ 7:06am

    1500 people surveyed. Presumably a random sampling, and not just "sharers".

    7% had received, or knew someone who had received, letter.

    50% who talk about letter say or imply they or the someone they knew would stop.

    Yes, 3.5% of 1500, but 100% of the 7%, the 7% being the "target" group.

    Of course, a survey is only as good as the sample selected, and depends upon the accuracy of answers.

    If sample was random, and if answers relatively accurate, 50% would be correct.

    Intuitively, start cutting people off from intenet access and one would expect some curtailment of "sharing" since untoward consequenses can come to fruition.

    Numbers can always be massaged, and this cuts both ways...government data and data secured by those regularly cited here as irrefuteable evidence presented by in research papers.

    Sounds to me as if the program is starting to make some headway. Will it stop people with a Tenebaum mindset? Maybe. Maybe not. But at least now they are on notice that there are consequences to what they have been doing to date with relative freedom.

     

    reply to this | link to this | view in chronology ]

    •  
      icon
      Richard (profile), May 16th, 2011 @ 7:29am

      Re:

      Oh come on - the statistics are completely meaningless because of the phrase "or knew someone".

      I know someone who has had a No 1 hit. I knew someone who won the Nobel prize.

      Anyone who posts like you did is either stupid or a liar. Which is it?

       

      reply to this | link to this | view in chronology ]

    •  
      identicon
      Anonymous Coward, May 16th, 2011 @ 7:40am

      Re:

      Because jobs! The economy. America! And freedom.

       

      reply to this | link to this | view in chronology ]

  •  
    identicon
    Khstapp, May 16th, 2011 @ 7:08am

    Encryption

    A better measure would be how many torrents for French IPs were active before and after the notification campagn. I am also curious if there is an increase in the use of anonymous proxies, SSH tunneling, and encrption to/from French IPs. And finally, and most importantly, is there a measurable increase in music and video sales through legitimate channels?

     

    reply to this | link to this | view in chronology ]

    •  
      identicon
      Anonymous Coward, May 16th, 2011 @ 7:29am

      Re: Encryption

      Encryption certainly a possibility for diehard "sharers", and probably less so for a casual user.

      BTW, even with an encrypted file one still has to identify an unencrypted title somewhere. Moreover, how many "sharers" really download and upload multi-GB files, not at all unusual for moview and new generation software. Even music in the MB range are far larger than an ordinary business document, academic paper, lengthy court opinion, etc., most of which are in the order of modest KBs.

       

      reply to this | link to this | view in chronology ]

      •  
        identicon
        Anonymous Coward, May 16th, 2011 @ 8:37am

        Re: Re: Encryption

        actually pretty wrong on the size points... IF you knew anything about the internet and where not trying to put up a strawman i would point out how through normal usage and using 100% legit usages i can push 10-20 gig per day (and i normally push even more during my busy times)....

        so whats the next strawman to burn? Its kinda fun :)

         

        reply to this | link to this | view in chronology ]

  •  
    icon
    The Groove Tiger (profile), May 16th, 2011 @ 7:34am

    To paraphrase Stephen Colbert, they're not lying, they just rounded to the nearest 50%.

     

    reply to this | link to this | view in chronology ]

  •  
    icon
    Richard (profile), May 16th, 2011 @ 7:39am

    Encryption certainly a possibility for diehard "sharers", and probably less so for a casual user.
    True at the moment - because most can get away with it without encryption - but if that situation changes then the ease of use, speed and availability of encrypted sharing systems will increase dramatically and then it will become a mass activity. The security services know this - which is why they lobbied against the DEA/B in the UK. They don't want to have to search for their needles in a bigger haystack!


    BTW, even with an encrypted file one still has to identify an unencrypted title somewhere.

    Read up about how (for example) Freenet works - and you will realise that you miss the point. It isn't just the file (and the title) that is encrypted - it is also your identity. Someone somewhere does see an unencrypted title - they are the person at the other end o=f the link - and even they don't know who they are sending the file to - (or receiving it from).

     

    reply to this | link to this | view in chronology ]

  •  
    identicon
    Anonymous Coward, May 16th, 2011 @ 7:41am

    "Knew someone" could be a perfectly valid and accurate response, though these is no way or knowing the absolute numbers within this category. Of course, it could mean "I read my kid the riot act", "My roomate has stopped because I threatened to beat him to a bloody pulp if he caused our interet service to be cut off", etc.

    Thus, I would not be inclined to dismiss it.

     

    reply to this | link to this | view in chronology ]

    •  
      icon
      The eejit (profile), May 16th, 2011 @ 8:14am

      Re:

      I would, but that's mostly because 'knew' someone can suffer from Six Degrees of Separation.

       

      reply to this | link to this | view in chronology ]

    •  
      icon
      Richard (profile), May 16th, 2011 @ 9:47am

      Re:

      "Knew someone" could be a perfectly valid and accurate response,
      Yes but
      though these is no way or knowing the absolute numbers within this category.


      It removes the possibility of drawing conclusions.

      Typically file sharer's are students. Students typically exist in multiple overlapping peer groups (accommodation, course, clubs and societies at college - plus their old peer group from home.

      Thus one person receiving a letter would probably get to around 100-300 people who could say that they "knew someone".

      Plus it could easily be that the 50% who "said they or the person would stop" are responsible for less than 5% of file sharing - once again we don't know.

       

      reply to this | link to this | view in chronology ]

  •  
    icon
    sumquy (profile), May 16th, 2011 @ 10:45am

    ironically, imho, this is everything that is great about the internet. 10 years ago (maybe even just 5) this assertion from hadopi would have gone unchallenged. today, it is hard to find a story on this, even from (relatively) mainstream media sources, that isn't pointing out that the french government is in fact lying through their teeth! when every interested internet user in the world is a fact checker, it gets harder and harder to lie to the sheeple. TRUTH for the win!

     

    reply to this | link to this | view in chronology ]

  •  
    icon
    scarr (profile), May 16th, 2011 @ 3:55pm

    Additional big file sharer problem

    An additional problem with the "everyone knows the one guy" example is that *everyone in the town* could be file sharing. If just the one well known guy says he'll stop, then the results are still 100% "effective", despite 99% of the population continuing to share.

     

    reply to this | link to this | view in chronology ]


Add Your Comment

Have a Techdirt Account? Sign in now. Want one? Register here
Get Techdirt’s Daily Email
Save me a cookie
  • Note: A CRLF will be replaced by a break tag (<br>), all other allowable HTML will remain intact
  • Allowed HTML Tags: <b> <i> <a> <em> <br> <strong> <blockquote> <hr> <tt>
Follow Techdirt
A word from our sponsors...
Essential Reading
Techdirt Reading List
Techdirt Insider Chat
A word from our sponsors...
Recent Stories
A word from our sponsors...

Close

Email This