The challenges awaiting journalists heading toward virtual reality

While virtual reality has just recently emerged as a storytelling tool for journalists — The Columbia Journalism Review even calls it “journalism's next frontier.” — filmmakers and gaming enthusiasts have been experimenting with the technology for much longer. To get a sense of where the technology might be headed and the challenges journalists are likely to face as they adopt the technology, I talked with two people who have been working with VR for quite some time: a game developer, and documentary filmmaker.

VR immersion is a double-edge sword

I talked with Kel O’Neill, one of the creators of Empire, an interactive documentary about the legacy of colonialism and migration in different parts of the world. Last year, he and his wife and partner Eline Jongsma launched a project called The Ark, aimed at using virtual reality to save the northern white rhinos, the most endangered species on earth.

Virtual reality is both an empathy machine, and an isolation machine.

The project is set in Kenya and the San Diego Zoo, the rhinos’ last habitats. With virtual reality, he believes viewers will get the opportunity to compare the distinct and disparate environments right next to each other. Here’s a short trailer, released in early September.

“There’s something incredible about VR as a method of reflection,” he says. “We want to figure out a way to use supernatural parts of the medium. It can transport people from an environment one side of the world to an environment on the other side of the world without the time difference.”

But O’Neill recognizes virtual reality as a self-contradicting medium. He sees it as both an empathy machine, but also an isolation machine. By the nature of the VR experience, he says,
viewers are isolated from other people. Although they are lost and immersed in a particular moment, they will eventually be jerked out of this virtual experience back into reality.

For O’Neill, VR is all about a promise of immersion, but not fulfilling those promises. In The Ark, for example, the viewer can “be” in the presence of these animals virtually, but it will always be a substitute for actually being in the presence of the animals. O’Neill thinks this experience cannot possibly measure up.

“It’s so immersive that you can’t help but recognize the ways that it’s not immersive,” he says. “It always falls short.”

Need for data analytics and optimization of VR platforms

Tony Mariani is the Head of Publisher Relations at Vrideo, an independent platform for immersive video founded in 2014. Coming from an entertainment, film, and gaming background, Mariani says that virtual reality’s biggest draw for him was its ability to combine these worlds into one medium.

Vrideo is exploring options to better track user data specific to virtual reality. For example, Mariani says content producers must take into account users’ comfort levels in strapping a VR device onto their faces. If someone puts on the device and takes it off immediately because the video is too shaky, that is valuable feedback.

VR content creators must also give up some control of users’ experience to the users themselves. Because of this, Mariani questions, “Is the person even watching what’s happening in the video or watching the sunset in the background?” This is especially important when VR is used to cover sensitive or uncomfortable content like domestic abuse. Aggregating information on where viewers are looking, he says, will become an important norm for analytics.

Another setback is that VR video is a very demanding format. “We’re at the mercy of people’s internet connections,” Mariani says. To get a traditional high-definition experience, the video needs to be in 4k resolution, stretched across a sphere. Anything less becomes a lower quality experience, and that is something the Vrideo team must constantly cater to.

A solution that Mariani mentions is segmentation: think of it like lazy loading but for VR. To maximize efficiency of someone’s internet connection, only the portion of the screen the person is looking at would be streamed in high resolution, everything else at a lower resolution. The problem with that, he says, is that if people start looking around too rapidly, they may catch the low resolution video before the higher quality can load. In spite of that, Mariani thinks that this technology will be the future of VR streaming.

More interesting articles about virtual reality:
The Verge on the rise and fall and rise of virtual reality
The Atlantic on where virtual reality could eventually take us

About the author

Ashley Wu

Undergraduate Fellow

Designing, developing and studying journalism at Northwestern. Also constantly scouting the campus for free food.

Latest Posts

  • With the 25th CAR Conference upon us, let’s recall the first oneWhen the Web was young, data journalism pioneers gathered in Raleigh

    For a few days in October 1993, if you were interested in journalism and technology, Raleigh, North Carolina was the place you had to be. The first Computer-Assisted Reporting Conference offered by Investigative Reporters & Editors brought more than 400 journalists to Raleigh for 3½ days of panels, demos and hands-on lessons in how to use computers to find stories in data. That seminal event will be commemorated this week at the 25th CAR Conference, which...

    Continue Reading

  • Prototyping Augmented Reality

    Something that really frustrates me is that, while I’m excited about the potential AR has for storytelling, I don’t feel like I have really great AR experiences that I can point people to. We know that AR is great for taking a selfie with a Pikachu and it’s pretty good at measuring spaces (as long as your room is really well lit and your phone is fully charged) but beyond that, we’re really still figuring...

    Continue Reading

  • Capturing the Soundfield: Recording Ambisonics for VR

    When building experiences in virtual reality we’re confronted with the challenge of mimicking how sounds hit us in the real world from all directions. One useful tool for us to attempt this mimicry is called a soundfield microphone. We tested one of these microphones to explore how audio plays into building immersive experiences for virtual reality. Approaching ambisonics with the soundfield microphone has become popular in development for VR particularly for 360 videos. With it,...

    Continue Reading

  • Prototyping Spatial Audio for Movement Art

    One of Oscillations’ technical goals for this quarter’s Knight Lab Studio class was an exploration of spatial audio. Spatial audio is sound that exists in three dimensions. It is a perfect complement to 360 video, because sound sources can be localized to certain parts of the video. Oscillations is especially interested in using spatial audio to enhance the neuroscientific principles of audiovisual synchrony that they aim to emphasize in their productions. Existing work in spatial......

    Continue Reading

  • Oscillations Audience Engagement Research Findings

    During the Winter 2018 quarter, the Oscillations Knight Lab team was tasked in exploring the question: what constitutes an engaging live movement arts performance for audiences? Oscillations’ Chief Technology Officer, Ilya Fomin, told the team at quarter’s start that the startup aims to create performing arts experiences that are “better than reality.” In response, our team spent the quarter seeking to understand what is reality with qualitative research. Three members of the team interviewed more......

    Continue Reading

  • How to translate live-spoken human words into computer “truth”

    Our Knight Lab team spent three months in Winter 2018 exploring how to combine various technologies to capture, interpret, and fact check live broadcasts from television news stations, using Amazon’s Alexa personal assistant device as a low-friction way to initiate the process. The ultimate goal was to build an Alexa skill that could be its own form of live, automated fact-checking: cross-referencing a statement from a politician or otherwise newsworthy figure against previously fact-checked statements......

    Continue Reading

Storytelling Tools

We build easy-to-use tools that can help you tell better stories.

View More