Pilots, Bias Important Considerations Ahead of Deploying AI

Willyam Bradberry/Shutterstock

Cloud technology makes piloting artificial intelligence efforts easier than ever, but hard decisions around bias need to be confronted.

Pilots can serve as a critical resource for agency insiders as they begin to deploy artificial intelligence, and considerations around built-in bias should be addressed from the earliest of efforts, federal officials with firsthand experience leveraging the technology said in Washington Tuesday. 

“One beauty of the cloud is you can do a pilot, and if it fails just turn it off—it’s not like buying millions in servers and then find that you are going to go in a different direction,” Small Business Administration Deputy Chief Information Officer Guy Cavallo said at Nextgov’s Tech Talks.  

“We have actually done three 90-day sprint pilots that have revolutionized the way we work.”

Cavallo explained how SBA effectively implemented artificial intelligence and the cloud to enhance their cybersecurity capabilities and supplement what human employees are able to do. Elaborating on the success he’s seen through various piloting projects related to that work, Cavallo said the agency participated in one with General Services Administration and Homeland Security Department for the Trusted Internet Connections initiative. 

He said the pilot ultimately led DHS to issue an exception for specific use cases, as SBA proved their cloud cyber tools approach were a viable alternative solution to TIC. 

Now the agency is in the process of writing a final report on a more recent pilot through which they sought to prove that their approach may be used to meet the same intent as the Continuous Diagnostics and Mitigation program. Cavallo expects that work to bring benefits to all agencies.

“I want you to realize that you do not need an army of people to do this,” Cavallo said. “You get a handful of people that believe in it and they can move forward with it.” 

“I would agree with that,” Veterans Affairs Department’s inaugural Director of Artificial Intelligence Gil Alterovitz said. “I think some of the best pilots don’t have as many people, but they have the right people—that is the key.”

Through his role in academia, Alterovitz led teams in exercises that were run much like pilot projects. In the beginning, he found that the participating doctors would want to work on teams with other doctors, engineers latched on to other engineers, and the same would happen with others across different professions, which ultimately led to a variety of great ideas that didn’t really work in execution. 

“So in future years we forced people to have one of each person in the group, and then we started seeing things,” Alterovitz said. 

By diversifying the backgrounds of people in each group, the teams were able to think up new designs and projects that could actually be used in real-world environments. 

“And that is the kind of approach we are thinking of now in research and development [at VA],” Alterovitz said. “To have people—not an isolated researcher—but to combine them with others in a veteran-centric design approach.” 

The federal executives also discussed how their agencies are approaching the issue of bias in AI algorithms and datasets. From congressional hearings, legislation and warnings from lawmakers, it’s an issue that’s moving to the forefront as more and more people consider the impacts it can have at the individual level. 

Cavallo and Alterovitz said it’s something their agencies are facing head on. 

“Any data set will have some biases, so you need to take that into account, it’s just in different ways,” Alterovitz explained. 

He said, just like in academia, bringing a variety of people with many different backgrounds to the table ahead of deploying the tech can itself potentially ruin bias at the forefront. The agency also recognizes that VA data itself is different than data on the general population. So Alterovitz and his team are looking at processes like transfer learning to essentially apply learnings from other studies being done in the general population and transfer some of that knowledge onto their datasets. 

SBA offers loans to homeowners and small businesses when disaster strikes and Cavallo said the agency is now considering ways to leverage their AI practices to combat loan fraud, which he noted opens the potential for algorithmic or data bias to unintentionally be backed in. 

“Unfortunately we don’t have any data scientists or any AI experts on staff at SBA, so it is something we are going to have to work through, most likely through contractors with government leadership,” he said. “But it's definitely something we consider as we move forward.” 

Alterovitz added that others from multiple agencies have reached out to him for recommendations around their own needs for technical experts and how to go about creating new tech-driven positions. The two agreed to have a broader discussion about it in the near future.

Editor's note: This story's headline was updated to better reflect comments by officials. 

X
This website uses cookies to enhance user experience and to analyze performance and traffic on our website. We also share information about your use of our site with our social media, advertising and analytics partners. Learn More / Do Not Sell My Personal Information
Accept Cookies
X
Cookie Preferences Cookie List

Do Not Sell My Personal Information

When you visit our website, we store cookies on your browser to collect information. The information collected might relate to you, your preferences or your device, and is mostly used to make the site work as you expect it to and to provide a more personalized web experience. However, you can choose not to allow certain types of cookies, which may impact your experience of the site and the services we are able to offer. Click on the different category headings to find out more and change our default settings according to your preference. You cannot opt-out of our First Party Strictly Necessary Cookies as they are deployed in order to ensure the proper functioning of our website (such as prompting the cookie banner and remembering your settings, to log into your account, to redirect you when you log out, etc.). For more information about the First and Third Party Cookies used please follow this link.

Allow All Cookies

Manage Consent Preferences

Strictly Necessary Cookies - Always Active

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Sale of Personal Data, Targeting & Social Media Cookies

Under the California Consumer Privacy Act, you have the right to opt-out of the sale of your personal information to third parties. These cookies collect information for analytics and to personalize your experience with targeted ads. You may exercise your right to opt out of the sale of personal information by using this toggle switch. If you opt out we will not be able to offer you personalised ads and will not hand over your personal information to any third parties. Additionally, you may contact our legal department for further clarification about your rights as a California consumer by using this Exercise My Rights link

If you have enabled privacy controls on your browser (such as a plugin), we have to take that as a valid request to opt-out. Therefore we would not be able to track your activity through the web. This may affect our ability to personalize ads according to your preferences.

Targeting cookies may be set through our site by our advertising partners. They may be used by those companies to build a profile of your interests and show you relevant adverts on other sites. They do not store directly personal information, but are based on uniquely identifying your browser and internet device. If you do not allow these cookies, you will experience less targeted advertising.

Social media cookies are set by a range of social media services that we have added to the site to enable you to share our content with your friends and networks. They are capable of tracking your browser across other sites and building up a profile of your interests. This may impact the content and messages you see on other websites you visit. If you do not allow these cookies you may not be able to use or see these sharing tools.

If you want to opt out of all of our lead reports and lists, please submit a privacy request at our Do Not Sell page.

Save Settings
Cookie Preferences Cookie List

Cookie List

A cookie is a small piece of data (text file) that a website – when visited by a user – asks your browser to store on your device in order to remember information about you, such as your language preference or login information. Those cookies are set by us and called first-party cookies. We also use third-party cookies – which are cookies from a domain different than the domain of the website you are visiting – for our advertising and marketing efforts. More specifically, we use cookies and other tracking technologies for the following purposes:

Strictly Necessary Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Functional Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Performance Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Sale of Personal Data

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.

Social Media Cookies

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.

Targeting Cookies

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.