NIST Launches Innovation Contests in IoT, Augmented Reality to Boost Emergency Response

Zapp2Photo/Shutterstock

The National Institute of Standards and Technology will soon kick off two national innovation contests that aim to strategically leverage augmented reality and internet of things technologies to transform public safety officials’ abilities to respond to emergencies. 

While the IoT contest focuses on the production of smart city data streams to simulate disaster scenarios, its AR counterpart seeks to create AR interfaces for first responders. Each contest envelops research and development phases leading up to a final fourth phase of competition—NIST’s CHARIoT Challenge—which will ultimately integrate the IoT data streams into AR headsets to demonstrate how the wearable and sensor technologies can ultimately help public safety officials to make quicker, more informed decisions.

“We're trying to get people to think innovatively and out of box,” NIST’s Public Safety Communications Research Division Chief Dereck Orr recently told Nextgov about the effort.

In detailing the inspiration behind the new challenge, which offers up more than $1 million in cash prizes, Orr explained that the devices first responders can access to support their work are not far off from the commercial devices people use daily. This means that interactions with those devices require a great deal of hands-on swiping, tapping and pinching.

“And that is not the way we envision public safety interacting with the network in the future,” Orr explained. “You don't give a firefighter or a cellphone that has maps of the building and expect them to walk into a building with their cellphone in their hand—they can't see it in front of their face and they can't touch it with a glove. A SWAT team member can be interacting with their cellphone either. They have their hands preoccupied with a rifle.” 

With that in mind, one of the key areas of research at play is to how to pull all the data and information that first responders have available to them and capture and present it to them in a way that's actionable, and boosts their ability to respond. Researchers on the AR path will explore how holographic and AR information will be used and presented in public safety in the future, both to personnel on the ground and those behind the scenes directing them. This could mean anything from seeing smoke through walls or other critical information not at their fingertips, but right before their eyes. 

IoT comes in because a great deal of that information will likely be streamed through sensor networks, so researchers must ensure that the information is streamlined and doesn’t result in a sort of cognitive overload for the users leveraging them. To help visualize the potential final products, Orr likened them to next-generation heads-up displays, similar to the way, in recent movies, Iron Man’s suit displays much-needed information during the crises he faces. So contestants will ultimately consider questions around what sensors would be most useful to provide relevant information first responders need, as well as the best ways to present that information so that it all enhances operations. 

“And we're not assuming that there is any one way to do that,” Orr noted. “Therefore what we get out of prize challenges like this is that we might see dozens of prototype applications that we can look at and see the benefits, pros and cons for each.”

Deadlines to participate in either contest are May 6. Right now, the program team is working to recruit contestants, which could include technologists, AR developers, gamers, UI/UX specialists, students, smart city and IoT data experts, and beyond. Sarah Hughes, a NIST prize challenge specialist within Orr’s division also shared a glimpse into how the contests and challenges will play out. After submitting their proposals in phase 1, contestants early on will gather feedback on their ideas from the experts involved and initiate the designs and prototyping of either their data streams or their augmented reality interfaces.

“We have great challenge partners that are kind of experts currently in the field, for both augmented reality and IoT visualization and training for public safety parameters and so they'll be available to really help guide, inform and collaborate with the contestants,” Hughes explained. The CHARIoT Challenge partners presently include Magic Leap, which will provide training, as well as actual AR headsets and assets to relevant participants. First Responder Network Authority and FirstNet built with AT&T along with others such as personal protective equipment developer MSA Safety will also provide expertise and insights along the way to help bring the concepts to a rational reality, which Orr noted is like “gold” for contestants. 

“These partners are really vital to our success,” he said.

Following the feedback phase, Hughes said contestants will be expected to demonstrate their proofs as more refined prototypes. The judges will evaluate the creations to move on to the full and final prize challenge competition. The culminating CHARIoT event will bring together actual first responders and others to dawn the newly developed prototypes and assess how they work in real-life simulations. The interfaces created by AR contestants with heads up displays and holograms will take advantage of the data streams provided by the IoT contestants. The judges will use both integrated together to try to complete first responder tasks in emergency scenarios. 

“It should be a great opportunity to bring together public safety innovators, communication technology experts, and really kind of test and advance the state of both the IoT data streams and augmented reality—all at that live event,” Hughes said.

Last year, NIST led a similar prize challenge on haptic interfaces for public safety officials. Just as first responders will test the final prototypes in this year’s contests, Orr noted that in last year’s competition the four final teams were able to test their technologies out with officials at a local fire training center. Judges last year included one retired and several active firefighters, who tried out the developed virtual reality tech. Orr said that often, officials have a bit of skepticism trying out new tools, which is understandable as they frequently work in conditions where their lives could be on the line.

But after the test last year, “they all walked out with an excitement about how this type of technology is not going to take the place of their current procedures, but it can augment their procedures and allow them to do their jobs better. Everyone was surprised and excited about where this could go,” Orr said. In that light, he added that one of the team’s goals this year is “to get public safety excited about this—to show them how this might apply to their future capabilities, so that they want to see this type of thing be developed for them.”

Beyond that, Orr and his team also hope to recruit new innovators into the field and help them realize that their IoT or AR expertise applies to these emergency-driven use cases. They also want the contests to help pave the way for a handful of prototypes that could be used to spur ongoing research and potential product development—“so that in the near future, you could potentially envision seeing some of these technologies put in place,” Orr said.

X
This website uses cookies to enhance user experience and to analyze performance and traffic on our website. We also share information about your use of our site with our social media, advertising and analytics partners. Learn More / Do Not Sell My Personal Information
Accept Cookies
X
Cookie Preferences Cookie List

Do Not Sell My Personal Information

When you visit our website, we store cookies on your browser to collect information. The information collected might relate to you, your preferences or your device, and is mostly used to make the site work as you expect it to and to provide a more personalized web experience. However, you can choose not to allow certain types of cookies, which may impact your experience of the site and the services we are able to offer. Click on the different category headings to find out more and change our default settings according to your preference. You cannot opt-out of our First Party Strictly Necessary Cookies as they are deployed in order to ensure the proper functioning of our website (such as prompting the cookie banner and remembering your settings, to log into your account, to redirect you when you log out, etc.). For more information about the First and Third Party Cookies used please follow this link.

Allow All Cookies

Manage Consent Preferences

Strictly Necessary Cookies - Always Active

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Sale of Personal Data, Targeting & Social Media Cookies

Under the California Consumer Privacy Act, you have the right to opt-out of the sale of your personal information to third parties. These cookies collect information for analytics and to personalize your experience with targeted ads. You may exercise your right to opt out of the sale of personal information by using this toggle switch. If you opt out we will not be able to offer you personalised ads and will not hand over your personal information to any third parties. Additionally, you may contact our legal department for further clarification about your rights as a California consumer by using this Exercise My Rights link

If you have enabled privacy controls on your browser (such as a plugin), we have to take that as a valid request to opt-out. Therefore we would not be able to track your activity through the web. This may affect our ability to personalize ads according to your preferences.

Targeting cookies may be set through our site by our advertising partners. They may be used by those companies to build a profile of your interests and show you relevant adverts on other sites. They do not store directly personal information, but are based on uniquely identifying your browser and internet device. If you do not allow these cookies, you will experience less targeted advertising.

Social media cookies are set by a range of social media services that we have added to the site to enable you to share our content with your friends and networks. They are capable of tracking your browser across other sites and building up a profile of your interests. This may impact the content and messages you see on other websites you visit. If you do not allow these cookies you may not be able to use or see these sharing tools.

If you want to opt out of all of our lead reports and lists, please submit a privacy request at our Do Not Sell page.

Save Settings
Cookie Preferences Cookie List

Cookie List

A cookie is a small piece of data (text file) that a website – when visited by a user – asks your browser to store on your device in order to remember information about you, such as your language preference or login information. Those cookies are set by us and called first-party cookies. We also use third-party cookies – which are cookies from a domain different than the domain of the website you are visiting – for our advertising and marketing efforts. More specifically, we use cookies and other tracking technologies for the following purposes:

Strictly Necessary Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Functional Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Performance Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Sale of Personal Data

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.

Social Media Cookies

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.

Targeting Cookies

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.