recommended reading

Can you predict the future by reading Twitter? The Pentagon thinks maybe.

Flickr user eldh

The Defense Department wants new computer tools to analyze mounds of unstructured text, blogs and tweets as part of a coordinated push to help military analysts predict the future and make decisions faster.

The search is part of the Office of Naval Research’s “Data to Decisions” program, a series of three-to-10-year initiatives that will address the volume of information that threatens to overwhelm planners in the digital age, contract databases indicate. The goal is to build an open source system that can unite various tools that collect, manage and draw relationships between data sets.

In a program announcement, ONR is calling for computer algorithms to predict events, fuse different forms of information and offer context on unfolding events. The office expects to spend $500,000 each year in funding. “The Department of Defense recognizes the potential for text analytics to play a vital role in future capabilities that inform timely and accurate situational awareness in time-constrained, uncertain, and complex environments,” the tender reads.

Defense is seeking ways to predict the future by monitoring Twitter, blogs and news, and determining the “frequency of contacts between nodes or clusters.” As networks grow larger and more complex, researchers have found it harder to monitor group behavior. ONR also wants researchers to discover networks that could be hidden within networks, and how information and money flows through a community.

Officials also want tools that fuse and assimilate multiple, incomplete data sets on agriculture, weather, terrain, demographics and economic indicators to find patterns. ONR is especially interested in ways to comb text-based information to provide more nuanced views of how groups, such as terrorists, operate by extrapolating the “stated values and beliefs that motivated behaviors of interest,” “community structure and clusters of social networks” and the level of “emotional support expressed towards topics or persons.”

The office also seeks better technologies for machine translation and processing -- translating physical characters or sounds -- into one machine-readable language.

Proposals are due Jan. 15 and funding decisions will be made by Feb. 15, contract documents indicate. Carey Schwartz, an ONR program officer and researcher affiliated with the Applied Research Laboratory at Pennsylvania State University, spearheads the program. So far, Clifton Park, N.Y.-based Kitware, which develops algorithms to analyze battlefield imagery, has been slated for funding, in partnership with software developer SOARTech, data-focused firm Signal Innovations Group, sensor processing company Systems Technology Research, defense giant Lockheed Martin Corps. and University of Southern California.  

Government agencies have been pushing technologists to refine techniques to sift through open source intelligence or publicly available data sets. The CIA, responding to mounting calls that such information needed to be systematically collected and better analyzed, created the National Open Source Center in suburban Northern Virginia around 2005 to acquire and analyze the information to support intelligence agencies. The Defense Advanced Research Projects Agency, the Pentagon’s research arm, in 2012 sought out research ideas on computer programs that predict “cyber terrorism events” by detecting how criminal groups and hackers interact on the Internet.

Threatwatch Alert

Thousands of cyber attacks occur each day

See the latest threats


Close [ x ] More from Nextgov

Thank you for subscribing to newsletters from
We think these reports might interest you:

  • It’s Time for the Federal Government to Embrace Wireless and Mobility

    The United States has turned a corner on the adoption of mobile phones, tablets and other smart devices, outpacing traditional desktop and laptop sales by a wide margin. This issue brief discusses the state of wireless and mobility in federal government and outlines why now is the time to embrace these technologies in government.

  • Featured Content from RSA Conference: Dissed by NIST

    Learn more about the latest draft of the U.S. National Institute of Standards and Technology guidance document on authentication and lifecycle management.

  • A New Security Architecture for Federal Networks

    Federal government networks are under constant attack, and the number of those attacks is increasing. This issue brief discusses today's threats and a new model for the future.

  • Going Agile:Revolutionizing Federal Digital Services Delivery

    Here’s one indication that times have changed: Harriet Tubman is going to be the next face of the twenty dollar bill. Another sign of change? The way in which the federal government arrived at that decision.

  • Software-Defined Networking

    So many demands are being placed on federal information technology networks, which must handle vast amounts of data, accommodate voice and video, and cope with a multitude of highly connected devices while keeping government information secure from cyber threats. This issue brief discusses the state of SDN in the federal government and the path forward.

  • The New IP: Moving Government Agencies Toward the Network of The Future

    Federal IT managers are looking to modernize legacy network infrastructures that are taxed by growing demands from mobile devices, video, vast amounts of data, and more. This issue brief discusses the federal government network landscape, as well as market, financial force drivers for network modernization.


When you download a report, your information may be shared with the underwriters of that document.