Welcome to Being There, a column on the emerging world of immersive entertainment from virtual reality and theme parks, to haunted houses and interactive theater. Written by The Verge senior reporter Bryan Bishop.
When Birdman director Alejandro Gonzlez Irritu premiered his new virtual reality installation piece Carne y Arena at the Cannes Film Festival this year, it was celebrated as a new high-water mark for the medium. Created in collaboration with Industrial Light & Magic xLab, the project drops participants inside a harrowing run across the US-Mexico border highlighting both the horrifying steps those seeking a better life for their families are willing to take, as well as the terror and inhumane treatment that can follow if theyre caught.
Its a mesmerizing, heartbreaking piece, and while the experience of Carne y Arena undeniably delivers on VRs endlessly-discussed potential as an empathy machine, its actually the physical, real-world bookends that set-up and conclude the piece that lend it context and emotional depth. Its triumph isnt one of virtual reality, expertly executed though it is that but rather of the tremendous power that different types of immersive experiences can have when theyre woven together, creating bracing new ways to make audiences think and feel.
I recently had the opportunity to experience Carne y Arena at the Los Angeles County Museum of Art, where it recently opened (its also currently showing at Fondazione Prada in Milan). Visitors go in alone, and after reading some text from Irritu about why he created the piece in the first place his intention was to allow the visitor to go through a direct experience walking in the immigrants feet, under their skin, and into their hearts my first stop was a holding room nicknamed a freezer.
A physical experience as much as a virtual one
It was a cold, sterile space, with a series of uncomfortable metal benches lined up against the walls. Scattered across the floor were battered shoes and a dusty backpack. As some text on the wall explained, the pieces of clothing had been recovered from the desert near the border between Mexico and Arizona; left behind by people that had tried to make their way to US soil, only to be snatched up by the US Border Patrol, or disappeared by the very individuals theyd paid to help them cross in the first place.
As instructed, I sat down to remove my socks and shoes, and placed them in a nearby locker. And then I waited. The room was unnervingly cold, even with the sweatshirt I was wearing, and that was precisely the point. Freezers are where Border Patrol tosses those rounded up in sweeps, leaving refugees and immigrants to shiver in the holding rooms for days at a time. As the minutes stretched on, I realized I had no idea how long I was going to be in the room, or even when the overall experience would end. I was just stuck there, cold and isolated the first time I realized Irritu had creating a physical experience as much as he had a virtual one.
Abruptly, an alarm bell sounded, red lights flashing: my cue to leave the room. And like the piece of cattle Id been made to feel like, I headed dutifully through the next door. Beyond it was a massive room, dimly lit by a glowing orange light that ran horizontally along one wall. As my eyes adjusted, I made out two people silhouetted in the darkness. I stepped towards them my feet crunching in the sand that was suddenly underfoot.
The two attendants helped me slip on a backpack and Oculus Rift headset, but it was perhaps the least technology-focused VR experience Ive ever taken part in. There were no controllers to fiddle with or visible sensors in the room, and no one asked me if Id tried other headsets before. It was simply a matter of slipping the Rift on, and being informed that Id be gently guided by a human hand if I started getting too close to a wall. Then, without fanfare, I was simply in the middle of the desert.
While the characters in Carne y Arena are computer-generated, the landscape itself was captured traditionally, and its clear almost immediately that both a world-class filmmaker and cinematographer (Irritus long-time collaborator Emmanuel Lubezki) are at work. The desert at dawn is breathtaking, even with the gritty resolution of a modern headset, and the feel of sand beneath my feet grounded me almost instantly. I watched as a group of immigrants approached, exhausted from their travels. I walked around to each of them, noting that they varied in age ranging from a young man to a grandmother. Getting too close to their faces revealed the plastic, uncanny valley issues that still afflict most CG characters in this kind of environment, but their body movements were nuanced and subtle, a step up from what Id come to expect.
My instinct was to run but Border Patrol agents had already blocked my escape
Behind me, I detected the distant beat of helicopter blades. I craned my neck and spotted the vehicle approaching in the slowly brightening sky. Before I knew it, the helicopter was upon us, wind blasting down on me (an incredibly effective bit of sensory tie-in). My instinct was to run, so I turned back around only to see a Border Patrol vehicle and officers swoop in to block my escape, guns drawn.
As a VR experience unto itself, Carne y Arena can be considered a cousin to the kind of journalistic work pioneered by Nonny de la Pea. Irritu talked to many immigrants that had made the journey across the border, and its both their individual stories and their motion-captured avatars that populate the piece. But hes clearly not just interested in a literal representation of their experiences. Over its nearly seven minute running time, Carne y Arena also delves into the dreamlike at one point, a wooden table appears in the middle of the fray, with children on either side watching a tiny boat filled with refugees overturn and sink into its surface and the abstract. Abrupt cuts and context shifts, traditionally problematic in VR, are used to great effect, putting the viewer in the same mindset of disorientation and fear that the immigrants themselves are facing as theyre zip-tied in the desert sand. And then, just as the chaos of the round-up seems to be reaching its peak, everyone is just suddenly gone.
Thats when I found myself walking alone in the desert once more. And as I crossed the terrain, I saw them: discarded shoes and a backpack, left behind by the people Id just seen swept away. Perhaps the same shoes and backpack Id encountered in the freezer minutes before.
The final part of Carne y Arenas triptych is a video installation, and it brought the entire experience home. Facing an unbroken stretch of border fence was a black wall with nine windows set at eye level. Within each a video clip was playing: a single close-up of one of the people portrayed in the VR experience, with text explaining their struggles and travails in their own words. A woman who had worked relentlessly so she could afford to bring her family over one by one, a Border Patrol officer with no respect for those who cant find empathy for people eager to start a better life; their faces simply stared at me as I read their stories. In virtual reality, Id observed their ordeals, unable to intervene. But here, their direct gaze became an emotional call to action: these were real people, and simply observing them wasnt an acceptable option.
Its tempting to discuss Carne y Arena just as a virtual reality experience. A filmmaker on the level of Alejandro Irritu getting involved in the medium is what many hope will elevate it to the point where mainstream adoption is truly within reach. But the greatest takeaway from the piece is that VR alone isnt enough not to deliver the kind of rich emotional experience Irritu was interested in delivering, at least. Carne y Arenas physical bookends arent bells and whistles; theyre part of the core conceit of the piece itself. The reveal of the discarded shoes in the VR short directly pays off the time audiences spend in the freezer; the last segment with the wall of videos takes the terror of the virtual segment, and makes it heartbreakingly personal. None of the three sections fully work without the other two, resulting in a multi-tiered experience that does more than just toy with the idea of replicating someone elses life experiences. It actually tries to convey the emotional horror of them, using a mix of physicality and artistic interpretation.
Irritu is focused on delivering the best emotional experience, not simply the best virtual one
Obviously, augmenting virtual reality with real-world, physical elements isnt new. Full-blown hybrid arcades like The Void mix the two extraordinarily well, and even smaller solutions like Nomadics modular system are incredible in the way they enhance the sense of presence while in VR. While Carne y Arenas use of sand and wind machines do give its headset portion a wonderful sense of tactile immediacy, its a very different kind of impact than actually sitting in a physical recreation of a freezer, not knowing how long youll be there, or what will happen next.
Ultimately, Irritu has built something focused on delivering the best emotional experience, not simply the best virtual one, and thats where Carne y Arenas power lies. In the rush to experiment in a burgeoning medium, VR is being used to try to replicate every environment possible, and that kind of experimentation is vital. But all too often, little thought is given to presentation, or whether a particular experience is even well-suited to VR in the first place. The entirety of Carne y Arena could have been delivered through a headset things similar to the freezer portion already exist in projects like 6x9 but that wouldnt have been the most impactful way to deliver this experience, or the most engaging one.
Recognizing that immersive entertainment can be more than just VR that it can include physical locations, art installations, and mixed reality elements is going to be vital, particularly as the industry focuses on location-based entertainment. For creators, that may very well be the meta-lesson from Irritus evocative and heartbreaking piece: expand your toolbox when possible, and use the best medium for the story you want to tell. The filmmaker himself seemed to understand that by deciding to move away from traditional cinema for this project in the first place. Given how incredibly effective Carne y Arenas mix of physical and virtual is, perhaps other creators will too.
Read the original here:
- How Virtual Reality Works | HowStuffWorks [Last Updated On: June 16th, 2016] [Originally Added On: June 16th, 2016]
- NYT VR: Virtual Reality by The New York Times [Last Updated On: June 19th, 2016] [Originally Added On: June 19th, 2016]
- Virtual Reality - Virtual Reality [Last Updated On: June 21st, 2016] [Originally Added On: June 21st, 2016]
- Virtual Reality Toronto - VRTO - Virtual Reality, Toronto [Last Updated On: June 22nd, 2016] [Originally Added On: June 22nd, 2016]
- Virtual Reality Immersion - How Virtual Reality Works ... [Last Updated On: June 22nd, 2016] [Originally Added On: June 22nd, 2016]
- Virtual Reality (VR) Leading Technology Company | VIRTALIS [Last Updated On: June 22nd, 2016] [Originally Added On: June 22nd, 2016]
- What is virtual reality? Webopedia Definition [Last Updated On: June 27th, 2016] [Originally Added On: June 27th, 2016]
- What is virtual reality? - A simple introduction [Last Updated On: July 5th, 2016] [Originally Added On: July 5th, 2016]
- Immersion (virtual reality) - Wikipedia, the free encyclopedia [Last Updated On: July 25th, 2016] [Originally Added On: July 25th, 2016]
- VRAC | Virtual Reality Applications Center [Last Updated On: July 25th, 2016] [Originally Added On: July 25th, 2016]
- What is Virtual Reality? - Virtual Reality - vrs.org.uk [Last Updated On: July 27th, 2016] [Originally Added On: July 27th, 2016]
- Virtual Reality | Technology | GeForce [Last Updated On: August 29th, 2016] [Originally Added On: August 29th, 2016]
- Virtual Reality - SI.com [Last Updated On: August 29th, 2016] [Originally Added On: August 29th, 2016]
- President Obama Makes Virtual-Reality Debut in Tour of ... [Last Updated On: August 29th, 2016] [Originally Added On: August 29th, 2016]
- 3 Beaten-Up Virtual-Reality Stocks: Are They Bargains? -- The ... [Last Updated On: August 29th, 2016] [Originally Added On: August 29th, 2016]
- VR, Virtual Reality | Virtalis [Last Updated On: August 29th, 2016] [Originally Added On: August 29th, 2016]
- VRTO Virtual & Augmented Reality World Conference + Expo [Last Updated On: September 8th, 2016] [Originally Added On: September 8th, 2016]
- LiquidVR | Immersive Virtual Reality Technology | AMD [Last Updated On: September 8th, 2016] [Originally Added On: September 8th, 2016]
- Virtual reality opens world of possibilities for seniors [Last Updated On: September 8th, 2016] [Originally Added On: September 8th, 2016]
- Virtual Reality Takes On the Videoconference - WSJ [Last Updated On: September 20th, 2016] [Originally Added On: September 20th, 2016]
- Virtual reality headset - Wikipedia [Last Updated On: November 8th, 2016] [Originally Added On: November 8th, 2016]
- Virtual Reality - Setting the Record Straight One Post at ... [Last Updated On: December 2nd, 2016] [Originally Added On: December 2nd, 2016]
- Virtual reality - Simple English Wikipedia, the free encyclopedia [Last Updated On: December 16th, 2016] [Originally Added On: December 16th, 2016]
- Virtual reality, one year out: What went right, what didn ... [Last Updated On: December 27th, 2016] [Originally Added On: December 27th, 2016]
- NBA broadcasts games in virtual reality with NextVR ... [Last Updated On: December 27th, 2016] [Originally Added On: December 27th, 2016]
- What is virtual reality? - Definition from WhatIs.com [Last Updated On: January 10th, 2017] [Originally Added On: January 10th, 2017]
- Tribemix Virtual Reality for Dementia Care - YouTube [Last Updated On: January 27th, 2017] [Originally Added On: January 27th, 2017]
- Virtual Reality Gets Real - theatlantic.com [Last Updated On: January 28th, 2017] [Originally Added On: January 28th, 2017]
- If you're hoping to watch all of the Super Bowl in VR, sorry - CNET [Last Updated On: February 6th, 2017] [Originally Added On: February 6th, 2017]
- Fifty Shades fans have a ball with virtual reality experience - The Drum [Last Updated On: February 6th, 2017] [Originally Added On: February 6th, 2017]
- Architect Zaha Hadid's Paintings Transformed Into Virtual Reality Art - PSFK (subscription) [Last Updated On: February 6th, 2017] [Originally Added On: February 6th, 2017]
- Adobe's Path To Entering The Virtual Reality Story - Forbes [Last Updated On: February 6th, 2017] [Originally Added On: February 6th, 2017]
- How Will Virtual Reality Change The Healthcare Industry? - Forbes [Last Updated On: February 6th, 2017] [Originally Added On: February 6th, 2017]
- Virtual Reality Has Arrived in the Art World. Now What? - New York Times [Last Updated On: February 6th, 2017] [Originally Added On: February 6th, 2017]
- How Virtual Reality Can Enhance Customer Engagement - Rocks Digital (blog) [Last Updated On: February 6th, 2017] [Originally Added On: February 6th, 2017]
- Virtual Reality Experience College Swim Meet - SwimSwam [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Explore The Amazon With This Stunning 360 Virtual Reality Video - IFLScience [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Global Virtual Reality Market (Hardware and Software) and Forecast to 2020 - PR Newswire (press release) [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Europe's virtual reality sector has grown to nearly 300 companies - VentureBeat [Last Updated On: February 7th, 2017] [Originally Added On: February 7th, 2017]
- Only 8% of Brands Intend to Use Virtual Reality for Advertising - AdAge.com [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- Eric Church Offers Virtual Reality Concert Experience to Fans - The Boot [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- TrueHoop Presents: The Washington Wizards and virtual reality - ESPN [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- Virtual reality: prepare for the revolution - AndroidPIT [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- In the burgeoning world of virtual reality, storytelling is both cutting ... - Los Angeles Times [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- 8 Real Success Tips From Women Building The Future With Virtual Reality - Forbes [Last Updated On: February 9th, 2017] [Originally Added On: February 9th, 2017]
- WATCH: YouTube Stars Create Amazing La La Land-Inspired Virtual-Reality Music Video - PEOPLE.com [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- Virtual reality is the future of soccer broadcasting and it's already here - Yahoo Sports [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- Virtual reality is boring compared to Beyonc's actual reality - A.V. Club (blog) [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- Virtual Reality addiction threat prompts cautious approach as VR nears 'smartphone-like' take-off - ABC Online [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- Google wants to use Chrome to suck you into virtual reality - CNET [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- Ringling showcase offers glimpse of virtual reality in Sarasota - Sarasota Herald-Tribune [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- The Future Of Virtual Reality: Mobile VR Platforms In A Battle - Forbes [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- Sarah Shahi to Star in NBC Virtual Reality Thriller 'Reverie' - Variety [Last Updated On: February 11th, 2017] [Originally Added On: February 11th, 2017]
- Valve is working on three new virtual reality games, 'not just experiments' - GeekWire [Last Updated On: February 11th, 2017] [Originally Added On: February 11th, 2017]
- Virtual Reality Could Be Your Next Prescription - DesignNews [Last Updated On: February 11th, 2017] [Originally Added On: February 11th, 2017]
- Top 6 Virtual Reality Apps for Your Smartphone - The Merkle [Last Updated On: February 11th, 2017] [Originally Added On: February 11th, 2017]
- DACC & Virgin Galactic team up to explore virtual reality - Las Cruces Sun-News [Last Updated On: February 11th, 2017] [Originally Added On: February 11th, 2017]
- Wichita-created virtual reality can re-create crime scenes - Wichita Eagle [Last Updated On: February 11th, 2017] [Originally Added On: February 11th, 2017]
- Boulder International Film Festival diving into virtual reality with 2017 slate - Boulder Daily Camera [Last Updated On: February 11th, 2017] [Originally Added On: February 11th, 2017]
- Why this analyst is warning investors to steer clear of virtual reality in 2017 - L.A. Biz [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]
- 'JAEPO 2017' Shows That Japanese Arcade Gaming Is Beginning To Incorporate Virtual Reality - Forbes [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]
- UNC-School of The Arts: 'Pioneers in Virtual Reality' - WFMYNews2.com [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- Google Chrome Now Allows Users To Experience Virtual Reality Via WebVR - EconoTimes [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- Virtual Reality's New Horizons: Enterprise Apps and Gloves for Typing - NewsFactor Network [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- Chick-fil-A cows will dive into virtual reality in new ads - Atlanta Business Chronicle [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- See This Famous Masterpiece Recreated in Virtual Reality - UploadVR [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- Classy classes: 'The Idea of Virtual Reality' - The Stanford Daily [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- Tim Cook says AR has more potential than virtual reality - The INQUIRER [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- Virtual reality has a growing impact on college football - FOXSports.com [Last Updated On: February 14th, 2017] [Originally Added On: February 14th, 2017]
- This company is opening a virtual reality multiplex this fall - Mashable [Last Updated On: February 14th, 2017] [Originally Added On: February 14th, 2017]
- Virtual reality weather add-ons let you feel the sun and wind - New Scientist [Last Updated On: February 14th, 2017] [Originally Added On: February 14th, 2017]
- Stanford researchers personalize virtual reality displays to match a user's eyesight - Stanford University News [Last Updated On: February 14th, 2017] [Originally Added On: February 14th, 2017]
- Miyamoto Still Has Doubts About Virtual Reality - GameSpot [Last Updated On: February 14th, 2017] [Originally Added On: February 14th, 2017]
- Virtual reality is still too isolating to be 'the next big thing' in tech - CBC.ca [Last Updated On: February 14th, 2017] [Originally Added On: February 14th, 2017]
- Samsung Goes for a New Look in Virtual Reality at New York Fashion Week - Fortune [Last Updated On: February 14th, 2017] [Originally Added On: February 14th, 2017]
- Pricey Virtual-Reality Headsets Slow to Catch On - Wall Street Journal [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- IMAX Unveils Flagship Virtual Reality Center in Los Angeles - Variety [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- Coach, IMG and Simon Malls Partner on Virtual Reality Experience - WWD [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- Using Virtual Reality To Get Inside An Ailing Person's World - Forbes [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- Nintendo's Shigeru Miyamoto Is Still Not Entirely Sure About Virtual Reality - Forbes [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]