Proceed with caution: Industry advises a careful approach to generative AI

Mabry Campbell/Getty Images

Government and industry tech executives are focused on the risks as well as the opportunities presented by the generative AI revolution.

ChatGPT did not write this article.

But the artificial intelligence app might soon be writing tech magazine stories, and — considering the rapid increase in AI capabilities — more complex functions are likely to follow. Generative AI holds promise for federal government use cases from cybersecurity to public health and medicine to citizen services. But these opportunities come with risks and policy challenges.

“In my mind, its potential is virtually unlimited,” said Rob Carey, president of Cloudera Government Solutions. “The only limiting factor may be the data you give it access to.”

Carey, who served as principal deputy chief information officer for the Defense Department, thinks that in five years, generative AI will be in widespread use across the government. But a lot has to happen before then. 

“We’ve got to be careful not to commoditize AI before we understand it,” Carey told Nextgov/FCW. “AI is hard to do right, but we’ve got to do it right.”

Doing it right will require agencies to address data privacy, bias and ethical concerns, and the responsible use of the technology — all pillars of the Biden administration’s AI Bill of Rights and other recent policy documents. The comments of the industry and federal executives interviewed for this article could be edited to fit on a street sign reading “proceed with caution.”

“We need to be cautious about how we are acquiring and using large language models and AI platforms that may have very unintended consequences for our data,” Eric Hysen, CIO at the Department of Homeland Security and co-chair of the agency’s AI Taskforce, recently told Nextgov/FCW.

“We’ll be working with industry to make sure that we can very clearly understand, as we continue to adopt more AI services and platforms, what that means for our data protection efforts and how we know where our data is going and what it is being used for. It’s something that is going to take some work from both government and industry,” Hysen said.

Gary Washington, CIO of the Agriculture Department, also stressed caution regarding advanced AI tools, even as some agencies under his purview experiment with them. 

“AI is sexy to people now. We have some agencies that have been proactive about dipping their toes into that area, but I just felt like we need to put some guardrails around it, because that could potentially be dangerous,” Washington told Nextgov/FCW.

Steps to responsible AI use

Kathleen Featheringham, vice president of artificial intelligence and machine learning at Maximus, said that because industry is primarily responsible for developing generative AI technologies, it’s also well-positioned to “lean forward” in partnering with government customers on how to use AI intelligently and securely.   

Featheringham recommends that agencies develop and implement AI guidance principles and align those with desired outputs and outcomes for AI. Transparency is also key, she said, as decision makers should be able to understand what data may go into something like an AI training model, how it is used and whether it is appropriate for a desired use case.

Finally, she stressed the importance of testing and validation for AI tools. This is important especially for agencies that engage with the public on a broad basis. 

“To me, it always starts with thinking about the outcomes and outputs you’re trying to get, and then working backwards to understand who is involved and what is the impact," Featheringham said. “Does it do what it says it is supposed to do? How does it work?”

We’ve got to be careful not to commoditize AI before we understand it.
— Rob Carey, Cloudera Government Solutions

Jim Carlini, chief technology officer at Leidos Inc., said that because trust between human operators and advanced AI tools is so important, it’s critical for industry to build what he calls “explainability” into solutions. In short, that means designing software that tells humans why it does what it does whenever questions arise.

“If you build in explainability, then I know why it is saying what it is saying,” Carlini said.

He recommends that agencies begin experimenting with the technology or risk being left behind. For many agencies, he said, that means setting up secure environments “where they can figure out what the return on investment is for a particular application.” Whether through existing IT contracts and vehicles or through new mechanisms, it’s important for agencies to get a toehold in AI if they haven’t already.

“You need a secure environment where you’re willing to put your data into it, then you need to be able to experiment with what people call ‘prompt engineering’ — how you interface with the model to get what you want out of it,” Carlini said. “Whatever is the most expeditious way, I think the most important thing is to just get started and do some experimentation in a secure way.”

Battle for talent

Just as cloud computing ushered a swath of new skill sets into the government and contracting workforces, AI’s advancement is likely to have profound impacts for government employees and contractors. Carlini believes the advent of AI, along with machine learning and other related technologies, is exacerbating an already competitive battle for tech talent among industry and the public sector.

“It’s going to be a journey for both sides, government and industry, to get the workforce, and it’s a challenge that is just going to get worse in these different areas because there’s just so much pressure for this kind of talent,” Carlini said.

X
This website uses cookies to enhance user experience and to analyze performance and traffic on our website. We also share information about your use of our site with our social media, advertising and analytics partners. Learn More / Do Not Sell My Personal Information
Accept Cookies
X
Cookie Preferences Cookie List

Do Not Sell My Personal Information

When you visit our website, we store cookies on your browser to collect information. The information collected might relate to you, your preferences or your device, and is mostly used to make the site work as you expect it to and to provide a more personalized web experience. However, you can choose not to allow certain types of cookies, which may impact your experience of the site and the services we are able to offer. Click on the different category headings to find out more and change our default settings according to your preference. You cannot opt-out of our First Party Strictly Necessary Cookies as they are deployed in order to ensure the proper functioning of our website (such as prompting the cookie banner and remembering your settings, to log into your account, to redirect you when you log out, etc.). For more information about the First and Third Party Cookies used please follow this link.

Allow All Cookies

Manage Consent Preferences

Strictly Necessary Cookies - Always Active

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Sale of Personal Data, Targeting & Social Media Cookies

Under the California Consumer Privacy Act, you have the right to opt-out of the sale of your personal information to third parties. These cookies collect information for analytics and to personalize your experience with targeted ads. You may exercise your right to opt out of the sale of personal information by using this toggle switch. If you opt out we will not be able to offer you personalised ads and will not hand over your personal information to any third parties. Additionally, you may contact our legal department for further clarification about your rights as a California consumer by using this Exercise My Rights link

If you have enabled privacy controls on your browser (such as a plugin), we have to take that as a valid request to opt-out. Therefore we would not be able to track your activity through the web. This may affect our ability to personalize ads according to your preferences.

Targeting cookies may be set through our site by our advertising partners. They may be used by those companies to build a profile of your interests and show you relevant adverts on other sites. They do not store directly personal information, but are based on uniquely identifying your browser and internet device. If you do not allow these cookies, you will experience less targeted advertising.

Social media cookies are set by a range of social media services that we have added to the site to enable you to share our content with your friends and networks. They are capable of tracking your browser across other sites and building up a profile of your interests. This may impact the content and messages you see on other websites you visit. If you do not allow these cookies you may not be able to use or see these sharing tools.

If you want to opt out of all of our lead reports and lists, please submit a privacy request at our Do Not Sell page.

Save Settings
Cookie Preferences Cookie List

Cookie List

A cookie is a small piece of data (text file) that a website – when visited by a user – asks your browser to store on your device in order to remember information about you, such as your language preference or login information. Those cookies are set by us and called first-party cookies. We also use third-party cookies – which are cookies from a domain different than the domain of the website you are visiting – for our advertising and marketing efforts. More specifically, we use cookies and other tracking technologies for the following purposes:

Strictly Necessary Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Functional Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Performance Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Sale of Personal Data

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.

Social Media Cookies

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.

Targeting Cookies

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.