recommended reading

White House launches governmentwide investment in big data

Pablo Martinez Monsivais/AP

Officials from science agencies across the government on Thursday announced $200 million in new research and development investments related to the mining, processing, storage and use of big data.

The National Science Foundation, for instance, announced a $10 million grant to University of California Berkeley researchers to build new algorithms and tools to sort through petabytes, terabytes, exabytes and zettabytes of data.

The National Institutes of Health announced a plan to put a data set of the human genome project in Amazon's EC2 computer cloud with tools to make the information easily accessible to researchers. The 200 terabytes of data the project currently stores would fill about 16 million file cabinets or 30,000 DVDs, making it difficult to share, NIH Director Francis Collins said at an event announcing the big data projects.

Assistant Defense Secretary for Research and Engineering Zachary Lemnios announced plans during the event to develop predictive and learning tools that can use big data to make "truly autonomous" defense systems that "can learn from experience with very little training and learn the limits of their own knowledge."

The initiative was sparked by a June 2011 report from the President's Council of Advisors on Science and Technology, which found a gap in the private sector's investment in basic research and development for big data.

Other agencies involved in the initiative include the U.S. Geological Survey, Defense Advanced Research Projects Agency and Energy Department.

The term big data is used most frequently by online advertising and marketing algorithms that sort through data from social media and elsewhere to micro-target demographics. Similar tactics also have been used by astronomers, oceanographers and geneticists to find patterns in even larger troves of data.

Advances in computing such as nimble computer clouds and programs that can make multiple computers act as one have made it possible to crunch through some data sets that previously were too large for even machine comprehension and to analyze other data sets more quickly and cheaply.

The cost of sequencing a human genome, for example, has dropped from many millions of dollars when it was first completed in 2003 to just $8,000 today, Collins said.

Astronomers who once observed only the sky now can plow through measurement data to model how some astronomical phenomena occur and how others may have evolved in the past, Johns Hopkins University physics and astronomy professor Alex Szalay said during a panel discussion following the government announcements.

For example, Szalay said, astronomers have used big data to model resonance frequencies the universe emits, similar to a drum when its beat, to examine what the big bang might have looked like.

Threatwatch Alert

Network intrusion / Spear-phishing

Researchers: Bank-Targeting Malware Sales Rise in Dark Web Markets

See threatwatch report


Close [ x ] More from Nextgov

Thank you for subscribing to newsletters from
We think these reports might interest you:

  • Data-Centric Security vs. Database-Level Security

    Database-level encryption had its origins in the 1990s and early 2000s in response to very basic risks which largely revolved around the theft of servers, backup tapes and other physical-layer assets. As noted in Verizon’s 2014, Data Breach Investigations Report (DBIR)1, threats today are far more advanced and dangerous.

  • Featured Content from RSA Conference: Dissed by NIST

    Learn more about the latest draft of the U.S. National Institute of Standards and Technology guidance document on authentication and lifecycle management.

  • PIV- I And Multifactor Authentication: The Best Defense for Federal Government Contractors

    This white paper explores NIST SP 800-171 and why compliance is critical to federal government contractors, especially those that work with the Department of Defense, as well as how leveraging PIV-I credentialing with multifactor authentication can be used as a defense against cyberattacks

  • Toward A More Innovative Government

    This research study aims to understand how state and local leaders regard their agency’s innovation efforts and what they are doing to overcome the challenges they face in successfully implementing these efforts.

  • From Volume to Value: UK’s NHS Digital Provides U.S. Healthcare Agencies A Roadmap For Value-Based Payment Models

    The U.S. healthcare industry is rapidly moving away from traditional fee-for-service models and towards value-based purchasing that reimburses physicians for quality of care in place of frequency of care.

  • GBC Flash Poll: Is Your Agency Safe?

    Federal leaders weigh in on the state of information security


When you download a report, your information may be shared with the underwriters of that document.