recommended reading

Hey, YouTube, We Want to Sync Multiple Videos from the Same Event

Flickr user Kamilla Oliveira

When everyone has a camera with them at all times, people end up recording a lot of the same things simultaneously. 

And once in a while these many recorders capture remarkable moments from different angles. Yet only rarely are these separate-but-similar shots woven together from disjointed devices into one narrative. 

This is a missed opportunity, and it's the idea behind the Rashomon Project, which set out to create an open-source toolkit for assembling videos from multiple perspective in late 2011. 

Now, after six months of working to turn their idea into a real-life demo, the project creators say they need a company like Vimeo or YouTube to pick up where they left off. 

The Rashomon Project began after a high-profile incident at the University of California, Davis, that involved police officers pepper-spraying students as they sat on a sidewalk to protest tuition hikes at the school. 

You remember this guy, right? 

Videos of the incident—which show the officer pictured above spraying orange mist directly at students' faces—quickly went viral, and elicited outrage. Those individual videos were enough to prompt an international response. 

But there's something doubly chilling about the Rashomon Project treatment, which includes eight separate videos and their accompanying audio. Hit play, and you watch the incident play out from eight angles at once, stereo-like audio playing together in a single track. 

At the moment the police officer begins spraying, the crowd wails. People can be heard shouting, "no," and "what are you doing," repeatedly. Rashomon conveys a more pronounced sense of chaos and depth than any single video, and more closely approximates what it must have felt like to be there in person. Actually, it's what it must have felt like for eight different people who were there. 

There's enormous potential value in capturing a controversial moment from many perspectives, not just because it gives people a more complete sense of what really happened but because it can change the way people think about filming, especially in chaotic environments.

Metadata like timestamps are a syncing tool but can also help verify standalone footage that can be otherwise edited in misleading ways. Goldberg says Amnesty International has indicated interest in multi-perspective video narratives for this reason. 

"There's evidentiary value," said Ken Goldberg, a UC Berkeley professor who helps run the Rashomon Project. "It's much harder to fake. If someone selectively cut out a little section, that would show up because you'd see a gap."

Goldberg is hopeful that people will begin to think more strategically about multi-perspective narratives when they find themselves filming an event where others may be filming. "It's this sort of this SWAT-team-like coordination you have to do," he said.

With backing from the Knight Foundation's Prototype Fund, Rashomon hoped to turn its idea into a working tool and begin building a larger database of footage. Goldberg's team imagined reconstructing entire three-dimensional environments using a mesh of video clips, Google Street View, and satellite images, etc.

Rashomon is focused on empowering activists, especially in protest environments, but multi-perspective video syncing could come in handy in all kinds of scenarios. 

"We're also thinking about natural disasters," Goldberg told me. "A major earthquake, when hundreds of thousands of videos are shot right around the time. What if we organized all of those temporally so you could how the earthquake is progressing at different areas?"

Imagine the narrative you might get if you collected and combined snippets of video captured in different places as people captured the same tornado tearing through a town. 

Goldberg's team, which is still manually synching videos, quickly realized they didn't have the resources to automate syncing or host the kind of multi-perspective video operation they believe is needed. He said it's impossible to compete with organizations like YouTube, Facebook, and Vimeo, but he's hopeful those companies might see the value in Rashomon's work and decide to build something similar. 

"We're still really excited about this," he said.

Threatwatch Alert

Thousands of cyber attacks occur each day

See the latest threats

JOIN THE DISCUSSION

Close [ x ] More from Nextgov
 
 

Thank you for subscribing to newsletters from Nextgov.com.
We think these reports might interest you:

  • Data-Centric Security vs. Database-Level Security

    Database-level encryption had its origins in the 1990s and early 2000s in response to very basic risks which largely revolved around the theft of servers, backup tapes and other physical-layer assets. As noted in Verizon’s 2014, Data Breach Investigations Report (DBIR)1, threats today are far more advanced and dangerous.

    Download
  • Featured Content from RSA Conference: Dissed by NIST

    Learn more about the latest draft of the U.S. National Institute of Standards and Technology guidance document on authentication and lifecycle management.

    Download
  • PIV- I And Multifactor Authentication: The Best Defense for Federal Government Contractors

    This white paper explores NIST SP 800-171 and why compliance is critical to federal government contractors, especially those that work with the Department of Defense, as well as how leveraging PIV-I credentialing with multifactor authentication can be used as a defense against cyberattacks

    Download
  • Toward A More Innovative Government

    This research study aims to understand how state and local leaders regard their agency’s innovation efforts and what they are doing to overcome the challenges they face in successfully implementing these efforts.

    Download
  • From Volume to Value: UK’s NHS Digital Provides U.S. Healthcare Agencies A Roadmap For Value-Based Payment Models

    The U.S. healthcare industry is rapidly moving away from traditional fee-for-service models and towards value-based purchasing that reimburses physicians for quality of care in place of frequency of care.

    Download
  • GBC Flash Poll: Is Your Agency Safe?

    Federal leaders weigh in on the state of information security

    Download

When you download a report, your information may be shared with the underwriters of that document.