Deep Dive is an ongoing Gamasutra series with the goal of shedding light on specific design, art, or technical features within a video game, in order to show how seemingly simple, fundamental design decisions aren't really that simple at all.

Check out earlier installments, including creating believable crowds in Planet Coaster, achieving seamless branching in Watch Dogs 2’s Invasion of Privacy missions, and creating the intricate level design of Dishonored 2's Clockwork Mansion.

Who: Alex Riviere, Audio Director at CCP Shanghai

I’m Alex Riviere, Audio Director at CCP Shanghai. I joined CCP about a year ago to build, develop and lead the Audio Department of the Shanghai studio.

I graduated from an electronics and computer sciences university and then earned my master’s degree in sound design. I have worked in multiple audio industries in the past 10 years, starting my career as a Music Producer and Composer for Sony ATV Music Publishing France. After taking the reins of a post-production sound studio in China and founding my own game audio outsourcing company, I joined the CCP team as Audio Director.

I’ve been involved in many projects from record albums, commercials, documentaries and video games. Incredible franchises that I’ve had the good fortune to be involved in include Call of Duty, Final Fantasy, Transformers and Borderlands to name a few. Each project involved different aspects of audio such as design, direction, localization, voice production, and mixing.

Having collaborated with CCP as a contractor to handle the audio for Gunjack (Playstation VR, Oculus Rift, Samsung Gear VR and HTC Vive headsets), I was asked to join the team and lead the audio department for Gunjack 2: End of Shift (Google’s Daydream platform) and all other projects coming out of the Shanghai Studio.

What: The Cockpit Experience of Gunjack 2: End of Shift

Gunjack 2: End of Shift is the sequel to the best-selling VR game Gunjack. Players take on the role of a turret operator (or Gunjack as they are called in-game), on the Kubera, the largest deep space mining rig of its kind. Gunjacks are tasked with defending the vessel from pirates, bandits, and anyone else looking to blow up the rig or steal the precious cargo.

Because Gunjack 2: End of Shift is a VR game, it is vital to create a true sense of immersion in the gameplay experience. Intimate interaction is one of the most important things in VR, and your intimate zone would be 0 to 5 meters from the player character (first person sounds in our case).

That’s why our main audio feature is what we call the “Cockpit Experience”, the goal of which was to make the players feel physically present in their turret. Gunjacks are the last line of defense, so we really wanted the player to experience this overwhelming and ominous feeling. 

We leveraged everything we learned from the first Gunjack game to further refine and enhance the Cockpit Experience and make it even better.

A great deal of realistic audio is incorporated in the player’s cockpit; from various alarms providing different levels of stress to the players based on the threat, to extremely detailed and diverse weapon sounds, dialogues, cockpit physical audio representation, and enemy fire impacts on the turret. All the sound passes through an acoustic rendering of the cockpit, so that the player really has the sense of being a turret operator inside this specific physical space.

One of the challenges we’ve faced is that we’ve been primarily creating sounds that do not exist in the real world, however our brains do already have a sense of what feels real. We therefore needed to create our assets from audio sources that exist in the real world.

Working with mechanical sounds usually gives a sense of credibility, it instantly feels “right” when we hear it for the first time. We needed to incorporate these sounds to match the world we've built, to seamlessly sell the experience. 

As a shooter game, one of the most obviously important aspects of gameplay is going to be the weapon’s sound design.

We want to keep players connected with their weapons and tools, so we’ve incorporated many different layers of control with game parameters to continually provide all the subtle feedback and variations to make that possible.

A perfect example would be the players’ main weapon, the autocannon. Since this is the weapon you spend the most time using, we’ve built literally all the audio mechanical aspects of it—the spinning barrels, reloading, adjustable firing systems, and so on. One of our learnings from the original Gunjack was that players lacked natural audio feedback to indicate they were running low on ammo.

It was important for us to truly immerse the player in the action. Thus, we incorporated auditory feedback so that as the player runs low on ammunition, the drier and more metallic the weapon sounds. This provides natural and tactically important audio feedback to the player to reload soon, or risk running out during combat.

Besides the critical gameplay information that needed to be carried by the audio, we also wanted to help drive the narrative of the game. We integrated most of the dialogue through a diegetic approach, where the sound source (com-link in this case) is visible on the screen and integrated into the cockpit environment. This allows us to use radio communication chatter to serve multiple purposes, such as seamlessly integrating tutorial instructions, providing gameplay tips and driving forward the storyline of the game.