'Noisy' Data Can Worsen Credit Inequality

invincible_bulldog/istockphoto.com

“We’re working with data that’s flawed for all sorts of historical reasons,” a researcher said.

“Noisy” data can trip up artificial intelligence tools that calculate credit risk, leading to disadvantages for low-income and minority borrowers, research finds.

For aspiring home buyers, getting a mortgage often comes down to one talismanic number: the credit score.

Banks and other lenders are turning to artificial intelligence to develop increasingly sophisticated models for scoring credit risk. But even though credit-scoring companies are legally prohibited from considering factors like race or ethnicity, critics have long worried that the models contain hidden biases against disadvantaged communities, limiting their access to credit.

Now a preprint study in which researchers used artificial intelligence to test alternative credit-scoring models finds that there is indeed a problem for lower-income families and minority borrowers: The predictive tools are between 5 and 10% less accurate for these groups than for higher-income and non-minority groups.

It’s not that the credit score algorithms themselves are biased against disadvantaged borrowers. Rather, it’s that the underlying data is less accurate in predicting creditworthiness for those groups, often because those borrowers have limited credit histories.

A “thin” credit history will in itself lower a person’s score, because lenders prefer more data than less. But it also means that one or two small dings, such as a delinquent payment many years in the past, can cause outsized damage to a person’s score.

“We’re working with data that’s flawed for all sorts of historical reasons,” says Laura Blattner, an assistant professor of finance at the Stanford University Graduate School of Business, who is coauthor of the new study with Scott Nelson of the University of Chicago Booth School of Business.

“If you have only one credit card and never had a mortgage, there’s much less information to predict whether you’re going to default. If you defaulted one time several years ago, that may not tell much about the future.”

Less Accuracy for Low-Income, Minority Borrowers

In analyzing the issue, the researchers used artificial intelligence and huge volumes of consumer data to test different credit-scoring models.

The first step was to figure out if the standard credit-score approaches were equally accurate across different demographic groups. They used AI to crunch anonymized consumer credit data on 50 million people that was provided by one of the major credit-score companies. They also worked with a huge marketing dataset that makes it possible to identify borrowers by income, race, and ethnicity.

Part of the challenge was figuring out whether people who were rejected for home loans would have been likely to default on mortgages if they had been approved. To do that, the AI models looked at how rejected mortgage applicants had kept up with other kinds of loans, such as car loans, which correlate very closely with how likely a person is to default on a mortgage.

Sure enough, the credit scores turned out to be less accurate for low-income and minority borrowers than others.

Overall, Blattner and Nelson estimate that there is substantially more “noise” or misleading data in the credit scores of people in minority and low-income households. They found that scores for minorities are about 5% less accurate in predicting default risk than the scores of non-minority borrowers. Likewise, the scores for people in the bottom fifth of income are about 10% less predictive than those for higher-income borrowers.

But why? Were the algorithms biased because they couldn’t pick up on the distinctive patterns of particular demographic groups?

To find out, Blattner and Nelson tested alternative scoring models that had been fine-tuned to minority and low-income borrowers. The results didn’t change much: The scores were still less accurate for them.

The real problem was in the data. People with very limited credit files, who had taken out few loans and held few if any credit cards, were harder to assess for creditworthiness. That was especially the case for people who had one or two blemishes on their records. Because minority borrowers and low-income earners were more likely to have thin or spotty credit records, their credit scores were less accurate.

By making the existing credit report data more informative, such as by compiling thicker and more diverse files for minorities, Blattner and Nelson estimate that it’s possible to eliminate half the disparity in accuracy.

Mortgages and Misallocation of Credit

The findings have a number of important implications. The study suggests that people from disadvantaged communities are being turned down for mortgages more often than they probably should be, though some of those borrowers may also get approved when they probably shouldn’t be. That creates a misallocation of credit. It can also perpetuate the inequalities because people who can’t get mortgages have less opportunity to build up solid records. They also then lose out on a crucial avenue for building wealth.

Some experts have argued that the algorithms run into trouble because financial institutions are legally prohibited from incorporating factors like ethnicity, gender, or race into their models. Those prohibitions are intended to prevent discrimination, but they can also block lenders from recognizing differences between groups that might actually elevate some borrowers’ credit scores.

The study finds that is not a problem. Even when Blattner and Nelson created scoring models that were fine-tuned to minority and low-income borrowers, the scores were still less accurate for those groups.

There is no simple solution, Blattner says. But one possible strategy would be for financial companies to run experiments in which they approve loans to people with relatively low credit scores.

“If you’re a bank, you could give loans to people and see who pays,” says Blattner. “That’s exactly what some fin-tech companies are doing: giving loans and then learning.”

This article was originally published in Futurity. It has been republished under the Attribution 4.0 International license.

X
This website uses cookies to enhance user experience and to analyze performance and traffic on our website. We also share information about your use of our site with our social media, advertising and analytics partners. Learn More / Do Not Sell My Personal Information
Accept Cookies
X
Cookie Preferences Cookie List

Do Not Sell My Personal Information

When you visit our website, we store cookies on your browser to collect information. The information collected might relate to you, your preferences or your device, and is mostly used to make the site work as you expect it to and to provide a more personalized web experience. However, you can choose not to allow certain types of cookies, which may impact your experience of the site and the services we are able to offer. Click on the different category headings to find out more and change our default settings according to your preference. You cannot opt-out of our First Party Strictly Necessary Cookies as they are deployed in order to ensure the proper functioning of our website (such as prompting the cookie banner and remembering your settings, to log into your account, to redirect you when you log out, etc.). For more information about the First and Third Party Cookies used please follow this link.

Allow All Cookies

Manage Consent Preferences

Strictly Necessary Cookies - Always Active

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Sale of Personal Data, Targeting & Social Media Cookies

Under the California Consumer Privacy Act, you have the right to opt-out of the sale of your personal information to third parties. These cookies collect information for analytics and to personalize your experience with targeted ads. You may exercise your right to opt out of the sale of personal information by using this toggle switch. If you opt out we will not be able to offer you personalised ads and will not hand over your personal information to any third parties. Additionally, you may contact our legal department for further clarification about your rights as a California consumer by using this Exercise My Rights link

If you have enabled privacy controls on your browser (such as a plugin), we have to take that as a valid request to opt-out. Therefore we would not be able to track your activity through the web. This may affect our ability to personalize ads according to your preferences.

Targeting cookies may be set through our site by our advertising partners. They may be used by those companies to build a profile of your interests and show you relevant adverts on other sites. They do not store directly personal information, but are based on uniquely identifying your browser and internet device. If you do not allow these cookies, you will experience less targeted advertising.

Social media cookies are set by a range of social media services that we have added to the site to enable you to share our content with your friends and networks. They are capable of tracking your browser across other sites and building up a profile of your interests. This may impact the content and messages you see on other websites you visit. If you do not allow these cookies you may not be able to use or see these sharing tools.

If you want to opt out of all of our lead reports and lists, please submit a privacy request at our Do Not Sell page.

Save Settings
Cookie Preferences Cookie List

Cookie List

A cookie is a small piece of data (text file) that a website – when visited by a user – asks your browser to store on your device in order to remember information about you, such as your language preference or login information. Those cookies are set by us and called first-party cookies. We also use third-party cookies – which are cookies from a domain different than the domain of the website you are visiting – for our advertising and marketing efforts. More specifically, we use cookies and other tracking technologies for the following purposes:

Strictly Necessary Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Functional Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Performance Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Sale of Personal Data

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.

Social Media Cookies

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.

Targeting Cookies

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.