Crowdfunded OpenSCHUFA Project Wants To Reverse-Engineer Germany's Main Credit-Scoring Algorithm
from the opening-the-black-boxes dept
We’ve just written about calls for a key legal communications system to be open-sourced as a way of re-building confidence in a project that has been plagued by problems. In many ways, it’s surprising that these moves aren’t more common. Without transparency, there can be little trust that a system is working as claimed. In the past this was just about software, but today there’s another aspect to the problem. As well as the code itself, there are the increasingly-complex algorithms, which the software implements. There is a growing realization that algorithms are ruling important parts of our lives without any public knowledge of how they work or make decisions about us. In Germany, for example, one of the most important algorithms determines a person’s SCHUFA credit rating: the name comes from an abbreviation of its German “Schutzorganisation für Allgemeine Kreditsicherung”, which means “Protection Agency for General Credit Security”. As a site called Algorithm Watch explains:
SCHUFA holds data on round about 70 million people in Germany. That’s nearly everyone in the country aged 18 or older. According to SCHUFA, nearly one in ten of these people living in Germany (some 7 million people) have negative entries in their record. That’s a lot!
SCHUFA gets its data from some 9,000 partners, such as banks and telecommunication companies. Incredibly, SCHUFA doesn’t believe it has a responsibility to check the accuracy of data it receives from its partners.
In addition, the algorithm used by SCHUFA to calculate credit scores is protected as a trade secret so no one knows how the algorithm works and whether there are errors or injustices built into the model or the software.
So basically, if you are an adult living in Germany, it’s a good chance your financial life is affected by a credit score produced by a multimillion euro private company using an automatic process that they do not have to explain and an algorithm based on data that nobody checks for inaccuracies.
A new crowd-sourced project called OpenSCHUFA aims to change that. It’s being run by Algorithm Watch and Open Knowledge Foundation Germany (full disclosure: I am an unpaid member of the Open Knowledge International Advisory Council). As well as asking people for monetary support, OpenSCHUFA wants German citizens to request a copy of their credit record, which they can obtain free of charge from SCHUFA. People can then send the main results — not the full record, and with identifiers removed — to OpenSCHUFA. The project will use the data to try to understand what real-life variables produce good and bad credit scores when fed into the SCHUFA system. Ultimately, the hope is that it will be possible to model, perhaps even reverse-engineer, the underlying algorithm.
This is an important attempt to pry open one of the major black boxes that are starting to rule our lives. Whether or not it manages to understand the SCHUFA algorithm, the exercise will provide useful experience for other projects to build on in the future. And if you are wondering whether it’s worth expending all this money and effort, look no further than SCHUFA’s response to the initiative, reported here by netzpolitik.org (original in German):
SCHUFA considers the project as clearly directed against the overarching interests of the economy, society and the world of business in Germany.
The fact that SCHUFA apparently doesn’t want people to know how its algorithm works is a pretty good reason for trying to find out.