recommended reading

FBI Seeks Video Recognition Technology to Automatically ID Suspects


The FBI is weighing the use of video recognition technology to quickly identify suspects, even if all the camera has captured is a perpetrator’s limp or fraying blue baseball cap.

Think of it as automated police lineups for the YouTube generation.

While investigators manually scoured video to identify the suspected Boston Marathon bombers, smart-video surveillance would scan crime scene footage against tapes of known people, places and objects to derive names and possible whereabouts.

According to procurement papers, the FBI hopes to view demonstrations of motion picture pattern-matching in December. The bureau has invited contractors to submit written project proposals by Nov. 13. Up to 30 vendors with promising systems then will be invited to present at FBI Headquarters on Dec. 11. 

"The FBI is currently undertaking a major issue study of video and digital image processing and video/digital image analytic capabilities to identify current capabilities, assess gaps, and develop a roadmap for the FBI's future video analytics architecture," stated an Oct. 30 contracting notice

The desired connect-the-dots abilities include computing the degree of similarity among pedestrians, graffiti designs, buildings in the background of photos, and other recurring images in videos and stills. 

Increasingly, law enforcement is relying on sophisticated video capture at special events, as a consequence of the Boston bombings.

At Sunday's New York City marathon, authorities deployed a camera network that could see nearly the entire route, in real-time, the New York Times reported. About 1,400 private-sector cameras also were at the ready, if necessary. 

In April, the FBI surveyed vendors about available technologies that could archive video ingested from various government-owned and privately operated cameras.

And millions of static biometric markers of criminals -- mugshots and irises, for example -- are being collected for the same purpose, under a new $1 billion retrofit of the bureau's old fingerprint-matching database.

It is very likely this “study was a result of the need to figure out how to analyze the ton of video that was submitted in the investigation of the Boston marathon bombing, where it took an army of analysts to sift through the video data to find the guys who looked suspicious or carried a backpack,” said Paul Wormeli, executive director emeritus of the Integrated Justice Information Systems Institute, a government-funded organization.

FBI officials said they are interested in technology that would automatically "cluster" or group the images -- for example, programming a computer to cluster all media with the same t-shirt logo.  

A function called "tracking and re-identification," would follow a specified individual across multiple videos to eventually help find the person’s name.

Another feature would follow certain behaviors. The "automated recognition of individuals based on behavior" would use algorithms to analyze similarities in "gait, expression, voice," and other mannerisms, according to terminology for the video analysis project.

Like data warehousing slated for the National Security Agency’s new supercomputer compound in Utah, video mining has its detractors.

Jay Stanley, an analyst at the American Civil Liberties Union's speech, privacy and technology project, speculated on the organization’s blog in July that eventually ubiquitous data collection “could also be applied to video—images taken by drones, by street cameras, by cameras worn by police officers, or by Google Glass (which is uploaded to the company). Why not get copies of all that video, store it in Utah, and swim through that data too (aided, of course, by face recognition technology to instantly pull up every video in which you’ve ever appeared).”

The market probably has done its homework on what the government is looking for, Wormeli said.

“Many companies have focused their creative juices on the issue of video analytics just because of Boston, as they saw in countless stories in the press how helpful video could be if only we had the ability to search it easily and quickly without an army of investigators pouring over every video inch,” he said.

One hundred hours of video are uploaded to YouTube every single minute, according to the media-sharing service.

“The FBI would be judged to be incompetent if it did not explore the potential for video analytics and learn what is available as they determine what should be employed to help them analyze this mountain of data,” Wormeli said.

(Image via Kuzma/

Threatwatch Alert

Thousands of cyber attacks occur each day

See the latest threats


Close [ x ] More from Nextgov

Thank you for subscribing to newsletters from
We think these reports might interest you:

  • Modernizing IT for Mission Success

    Surveying Federal and Defense Leaders on Priorities and Challenges at the Tactical Edge

  • Communicating Innovation in Federal Government

    Federal Government spending on ‘obsolete technology’ continues to increase. Supporting the twin pillars of improved digital service delivery for citizens on the one hand, and the increasingly optimized and flexible working practices for federal employees on the other, are neither easy nor inexpensive tasks. This whitepaper explores how federal agencies can leverage the value of existing agency technology assets while offering IT leaders the ability to implement the kind of employee productivity, citizen service improvements and security demanded by federal oversight.

  • Effective Ransomware Response

    This whitepaper provides an overview and understanding of ransomware and how to successfully combat it.

  • Forecasting Cloud's Future

    Conversations with Federal, State, and Local Technology Leaders on Cloud-Driven Digital Transformation

  • IT Transformation Trends: Flash Storage as a Strategic IT Asset

    MIT Technology Review: Flash Storage As a Strategic IT Asset For the first time in decades, IT leaders now consider all-flash storage as a strategic IT asset. IT has become a new operating model that enables self-service with high performance, density and resiliency. It also offers the self-service agility of the public cloud combined with the security, performance, and cost-effectiveness of a private cloud. Download this MIT Technology Review paper to learn more about how all-flash storage is transforming the data center.


When you download a report, your information may be shared with the underwriters of that document.