recommended reading

FBI Awards Dataminr Contract for Twitter 'Firehose'

zamzawawi isa/

The FBI will soon be able to search a vast repository of public tweets in real time for hints about potential terrorist attacks and other public-safety crises.

The bureau awarded a sole-source contract to Dataminr, a company that allows customers to churn through Twitter's "firehose," which includes more than 500 million 140-character messages posted daily. Twitter's public API only gives users access to about 1 percent of tweets, according to a FedBizOpps posting

» Get the best federal technology news and ideas delivered right to your inbox. Sign up here.

"Twitter is a platform where news first breaks on terrorist attacks, military actions, epidemiological events and natural disasters, among other topics," the award notice said. Social media platforms used "by terrorist groups, intelligence services and criminal organizations to further their illegal activity creates a demonstrated need for tools to properly identify the activity and react appropriately," according to a request for quotes.

The bureau, which plans to buy approximately 200 licenses for Dataminr's Advanced Alerting Tool, is just the latest of a handful of government groups to contract with Dataminr; the Transportation Safety Administration and the Pentagon have both made sole-source awards to the company. But earlier this year, Twitter blocked intelligence agencies from accessing the Dataminr service.

While other companies offer Twitter-based data analytics, they only have access to "pre-filtered sub-portions of the 'firehose,'" the FBO posting said. Dataminr would allow the FBI to customize its filters, "based on changing circumstances."

The contract is for a base year, though the FBI's Information Technology Acquisition Unit.

Threatwatch Alert

Thousands of cyber attacks occur each day

See the latest threats


Close [ x ] More from Nextgov

Thank you for subscribing to newsletters from
We think these reports might interest you:

  • Modernizing IT for Mission Success

    Surveying Federal and Defense Leaders on Priorities and Challenges at the Tactical Edge

  • Communicating Innovation in Federal Government

    Federal Government spending on ‘obsolete technology’ continues to increase. Supporting the twin pillars of improved digital service delivery for citizens on the one hand, and the increasingly optimized and flexible working practices for federal employees on the other, are neither easy nor inexpensive tasks. This whitepaper explores how federal agencies can leverage the value of existing agency technology assets while offering IT leaders the ability to implement the kind of employee productivity, citizen service improvements and security demanded by federal oversight.

  • Effective Ransomware Response

    This whitepaper provides an overview and understanding of ransomware and how to successfully combat it.

  • Forecasting Cloud's Future

    Conversations with Federal, State, and Local Technology Leaders on Cloud-Driven Digital Transformation

  • IT Transformation Trends: Flash Storage as a Strategic IT Asset

    MIT Technology Review: Flash Storage As a Strategic IT Asset For the first time in decades, IT leaders now consider all-flash storage as a strategic IT asset. IT has become a new operating model that enables self-service with high performance, density and resiliency. It also offers the self-service agility of the public cloud combined with the security, performance, and cost-effectiveness of a private cloud. Download this MIT Technology Review paper to learn more about how all-flash storage is transforming the data center.


When you download a report, your information may be shared with the underwriters of that document.