recommended reading

White House launches governmentwide investment in big data

Pablo Martinez Monsivais/AP

Officials from science agencies across the government on Thursday announced $200 million in new research and development investments related to the mining, processing, storage and use of big data.

The National Science Foundation, for instance, announced a $10 million grant to University of California Berkeley researchers to build new algorithms and tools to sort through petabytes, terabytes, exabytes and zettabytes of data.

The National Institutes of Health announced a plan to put a data set of the human genome project in Amazon's EC2 computer cloud with tools to make the information easily accessible to researchers. The 200 terabytes of data the project currently stores would fill about 16 million file cabinets or 30,000 DVDs, making it difficult to share, NIH Director Francis Collins said at an event announcing the big data projects.

Assistant Defense Secretary for Research and Engineering Zachary Lemnios announced plans during the event to develop predictive and learning tools that can use big data to make "truly autonomous" defense systems that "can learn from experience with very little training and learn the limits of their own knowledge."

The initiative was sparked by a June 2011 report from the President's Council of Advisors on Science and Technology, which found a gap in the private sector's investment in basic research and development for big data.

Other agencies involved in the initiative include the U.S. Geological Survey, Defense Advanced Research Projects Agency and Energy Department.

The term big data is used most frequently by online advertising and marketing algorithms that sort through data from social media and elsewhere to micro-target demographics. Similar tactics also have been used by astronomers, oceanographers and geneticists to find patterns in even larger troves of data.

Advances in computing such as nimble computer clouds and programs that can make multiple computers act as one have made it possible to crunch through some data sets that previously were too large for even machine comprehension and to analyze other data sets more quickly and cheaply.

The cost of sequencing a human genome, for example, has dropped from many millions of dollars when it was first completed in 2003 to just $8,000 today, Collins said.

Astronomers who once observed only the sky now can plow through measurement data to model how some astronomical phenomena occur and how others may have evolved in the past, Johns Hopkins University physics and astronomy professor Alex Szalay said during a panel discussion following the government announcements.

For example, Szalay said, astronomers have used big data to model resonance frequencies the universe emits, similar to a drum when its beat, to examine what the big bang might have looked like.

Threatwatch Alert

Thousands of cyber attacks occur each day

See the latest threats


Close [ x ] More from Nextgov

Thank you for subscribing to newsletters from
We think these reports might interest you:

  • It’s Time for the Federal Government to Embrace Wireless and Mobility

    The United States has turned a corner on the adoption of mobile phones, tablets and other smart devices, outpacing traditional desktop and laptop sales by a wide margin. This issue brief discusses the state of wireless and mobility in federal government and outlines why now is the time to embrace these technologies in government.

  • Featured Content from RSA Conference: Dissed by NIST

    Learn more about the latest draft of the U.S. National Institute of Standards and Technology guidance document on authentication and lifecycle management.

  • A New Security Architecture for Federal Networks

    Federal government networks are under constant attack, and the number of those attacks is increasing. This issue brief discusses today's threats and a new model for the future.

  • Going Agile:Revolutionizing Federal Digital Services Delivery

    Here’s one indication that times have changed: Harriet Tubman is going to be the next face of the twenty dollar bill. Another sign of change? The way in which the federal government arrived at that decision.

  • Software-Defined Networking

    So many demands are being placed on federal information technology networks, which must handle vast amounts of data, accommodate voice and video, and cope with a multitude of highly connected devices while keeping government information secure from cyber threats. This issue brief discusses the state of SDN in the federal government and the path forward.

  • The New IP: Moving Government Agencies Toward the Network of The Future

    Federal IT managers are looking to modernize legacy network infrastructures that are taxed by growing demands from mobile devices, video, vast amounts of data, and more. This issue brief discusses the federal government network landscape, as well as market, financial force drivers for network modernization.


When you download a report, your information may be shared with the underwriters of that document.