NIST Prioritizes External Input in Development of AI Risk Management Framework

metamorworks/istockphoto

The agency is engaging stakeholders in the process through multiple venues.

National Institute of Standards and Technology officials are gleaning insights from a range of players as they work to draft Congressionally-directed guidance promoting the responsible use of artificial intelligence technologies.

That in-the-making document—the Artificial Intelligence Risk Management Framework, or AI RMF—is aimed at building the public’s trust in the increasingly adopted technology, according to a recent request for information

Responses to the RFI are due Aug. 19 and will inform the framework’s early days of production.

“We want to make certain that the AI RMF reflects the diverse experiences and expertise of those who design, develop, use, and evaluate AI,” Elham Tabassi, NIST’s Information Technology Laboratory chief of staff, told Nextgov in an email Monday.  

Tabassi is a scientist who also serves as federal AI standards coordinator and as a member of the National AI Research Resource Task Force, which was formed under the Biden-Harris administration earlier this summer. She shed light on some of what will go into this new framework’s development.

AI capabilities are transforming how humans operate in meaningful ways, but also present new technical and societal challenges—and confronting those can get sticky. NIST officials note in the RFI that “there is no objective standard for ethical values, as they are grounded in the norms and legal expectations of specific societies or cultures.” Still, they note that it is generally agreed that AI must be made, assessed and used in a manner that fosters public confidence. 

“Trust,” the RFI reads, “is established by ensuring that AI systems are cognizant of and are built to align with core values in society, and in ways which minimize harms to individuals, groups, communities, and societies at large.” 

Tabassi pointed to some of NIST’s existing AI-aligned efforts that hone in on “cultivating trust in the design, development, use and governance of AI.” They include developing data and establishing benchmarks to evaluate the technology, participating in the making of technical AI standards, and more. On top of those efforts, Congress also directed the agency to engage public and private sectors in the creation of a new voluntary guide to improve how people manage risks across the AI lifecycle. The RMF was proposed via the National AI Initiative Act of 2020 and aligns with other government recommendations and policies.

“The framework is intended to provide a common language that can be used by AI designers, developers, users, and evaluators as well as across and up and down organizations,” Tabassi explained. “Getting agreement on key characteristics related to AI trustworthiness—while also providing flexibility for users to customize those terms—is critical to the ultimate success of the AI RMF.”

Officials lay out various aims and elements of the guide via the RFI. Those involved intend for it to “provide a prioritized, flexible, risk-based, outcome-focused, and cost-effective approach that is useful to the community of AI designers, developers, users, evaluators, and other decision-makers and is likely to be widely adopted,” they note. Further, the guidance will exist in the form of a “living document” that’s updated as the technology and approaches to implementing it evolve. 

Broadly, NIST requests feedback on its approach to crafting the RMF, and its planned inclusions. Officials ask for responders to weigh in on hurdles to improving their management of AI-related risks, how they define characteristics and metrics to AI trustworthiness, standards and models the agency should consider in this process, and concepts for structuring the framework—among other topics. 

“The first draft of the RMF and future iterations will be based on stakeholder input,” Tabassi said. 

Although the guidance will be voluntary in its nature, she noted that such engagement could help lead to wider adoption once the guide is completed. Tabassi also confirmed that NIST is set to hold a 2-day workshop, “likely in September,” to gain more input from those interested. 

“We will announce the dates soon,” she said. “Based on those responses and the workshop discussions, NIST will develop a timeline for developing the framework, which likely will include multiple drafts to allow for robust public input. Version 1.0 could be published by the end of 2022.”

X
This website uses cookies to enhance user experience and to analyze performance and traffic on our website. We also share information about your use of our site with our social media, advertising and analytics partners. Learn More / Do Not Sell My Personal Information
Accept Cookies
X
Cookie Preferences Cookie List

Do Not Sell My Personal Information

When you visit our website, we store cookies on your browser to collect information. The information collected might relate to you, your preferences or your device, and is mostly used to make the site work as you expect it to and to provide a more personalized web experience. However, you can choose not to allow certain types of cookies, which may impact your experience of the site and the services we are able to offer. Click on the different category headings to find out more and change our default settings according to your preference. You cannot opt-out of our First Party Strictly Necessary Cookies as they are deployed in order to ensure the proper functioning of our website (such as prompting the cookie banner and remembering your settings, to log into your account, to redirect you when you log out, etc.). For more information about the First and Third Party Cookies used please follow this link.

Allow All Cookies

Manage Consent Preferences

Strictly Necessary Cookies - Always Active

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Sale of Personal Data, Targeting & Social Media Cookies

Under the California Consumer Privacy Act, you have the right to opt-out of the sale of your personal information to third parties. These cookies collect information for analytics and to personalize your experience with targeted ads. You may exercise your right to opt out of the sale of personal information by using this toggle switch. If you opt out we will not be able to offer you personalised ads and will not hand over your personal information to any third parties. Additionally, you may contact our legal department for further clarification about your rights as a California consumer by using this Exercise My Rights link

If you have enabled privacy controls on your browser (such as a plugin), we have to take that as a valid request to opt-out. Therefore we would not be able to track your activity through the web. This may affect our ability to personalize ads according to your preferences.

Targeting cookies may be set through our site by our advertising partners. They may be used by those companies to build a profile of your interests and show you relevant adverts on other sites. They do not store directly personal information, but are based on uniquely identifying your browser and internet device. If you do not allow these cookies, you will experience less targeted advertising.

Social media cookies are set by a range of social media services that we have added to the site to enable you to share our content with your friends and networks. They are capable of tracking your browser across other sites and building up a profile of your interests. This may impact the content and messages you see on other websites you visit. If you do not allow these cookies you may not be able to use or see these sharing tools.

If you want to opt out of all of our lead reports and lists, please submit a privacy request at our Do Not Sell page.

Save Settings
Cookie Preferences Cookie List

Cookie List

A cookie is a small piece of data (text file) that a website – when visited by a user – asks your browser to store on your device in order to remember information about you, such as your language preference or login information. Those cookies are set by us and called first-party cookies. We also use third-party cookies – which are cookies from a domain different than the domain of the website you are visiting – for our advertising and marketing efforts. More specifically, we use cookies and other tracking technologies for the following purposes:

Strictly Necessary Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Functional Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Performance Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Sale of Personal Data

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.

Social Media Cookies

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.

Targeting Cookies

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.