Motion sickness is one of the challenges holding back virtual reality from reaching larger audiences. And MonkeyMedia, a small tech firm in Austin, Texas, believes it has solved the problem with BodyNav, a way to navigate VR in a natural way.
BodyNav doesn’t rely on using a handheld game controller or hand controls for movement. MonkeyMedia Eric Bear said in an interview with GamesBeat that poor synchronization and interfaces between such controls and what your eyes see can make any person sick.
So Bear and his wife Janna Bear dreamed up a system where you can navigate using body movements, such as physically leaning your head forward to move forward, inside a 3D virtual landscape. You can use similar motions to move in different directions. This system allows your body to move in sync with the direction you are moving. And that reduces any problem related to motion sickness, Bear said.
It’s an interesting invention that comes from a small team that has been doing research and development for 25 years. Bear said the company has received seven patents on the invention, and it has a couple of more patent applications pending.
“We didn’t set out to solve this problem, but we found a new way of doing navigation,” Bear said.
Bear said that sensors which are already in VR headsets — accelerometers and gyroscopes — can detect the head movement. In fact, some games such as Oculus’ Dead & Buried, a Western gunslinger game, use those sensors to detect whether you are ducking behind cover in a VR gun battle. It also has applications in augmented reality and first-person video drone piloting.
By using your head to move around in VR, that means you can stopping using your fingers to do that work with game controllers. In a shooting game, that simplifies the “cognitive overload” of a game controller that mystifies all but the most dedicated hardcore gamers, Bear said.
“If you change your view and movement with your hands and still have to pull a trigger, that represents a lot of cognitive load,” Bear said. “We take the movement stuff out. Now you can sneak around corners and move fast by leaning. If it’s too complex for you to learn a controller, that’s not your failure. It’s a failure of the game designer for creating too heavy a cognitive load. It’s for us to figure out how we screwed up in designing user interfaces for people.”
If you no longer have to move your virtual body with a left thumb stick, then you only have to use your hands to worry about tasks such as aiming a gun (which can be pointed in a different direction from the one where you are moving) or pulling a trigger. That simplifies the control tasks, enables more people to learn how to navigate in VR, and reduces the motion sickness at the same time. (Of course, it will force the expert first-person shooter players to get used to a new form of navigation).
Bear said that BodyNav will be available for licensing to game developers, who can use an applications programming interface to integrate it into their VR games and other apps.
BodyNav is consistent with Bear’s belief that interfaces and virtual interactions should be “human centered,” rather than gadget centered.
Above: Richard Garriott de Cayeux tries out the BodyNav system for moving in VR.
Rob Bamforth, analyst at research firm Quocirca, said in a statement, “Making the physical experience align with human expectations, as I experienced with MonkeyMedia’s BodyNav technology, is critical not
only for an effective VR experience, but also for avoiding digitally induced motion sickness.”
Besides VR users, motion sickness has long bothered drone pilots and some players of 2D games as well. Traditional stereoscopic headset interfaces use multiple sensor axes (for instance, rotate left/right, pivot up/down, tip left/right) to establish viewer orientation, while requiring handheld controllers (joysticks, gamepads, keyboards, etc.) for locomotion.
Visually “moving” through space while in a sedentary posture creates sensory imbalances that can cause dizziness and nausea in the viewer, Bear said. BodyNav technology creates more intuitive virtual interactions by remapping control axes to accomplish both orientation and locomotion with natural body movement. This provides the organic equilibrium needed to circumvent sensory imbalances, he said.
Richard Garriott de Cayeux, the legendary video game pioneer (creator of the Ultima series) and private astronaut, tried out BodyNav.
“Fundamentally, MonkeyMedia has solved a really important problem within the VR community,” said Garriott de Cayeux, in a statement. He added, BodyNav “doesn’t require a joystick and you don’t get motion sickness. It has a very natural feel and seems to solve vestibular dysfunction. An outstanding solution.”
BodyNav doesn’t use custom hardware. It uses distinct sensor axes for independent functions to maintain equilibrium in the body’s proprioceptive system. Viewers simply lean, using either their head or torso, to move themselves through virtual spaces, or to move their drones through remote physical spaces. This allows the sensory receptors, which receive stimuli internally and relate to the body’s position and movement, to properly engage with virtual or remote content, synchronizing visual and vestibular (inner ear) senses and reducing motion sickness-inducing factors.
Above: How BodyNav works
“When you get motion sickness, the inner ear fluids are out of sync with your eyes,” Bear said. “You have movement in your visual field, but no expected movement in your body through your inner ear, and that tells you stomach that things are screwed up, and you get sick,” Bear said.
This idea of using body movements for navigation has been a long time coming, but it basically gets us much closer to moving more naturally, as we do in real life, in the virtual world. Bear worked on the first wave of VR in the early 1990s, and once again in a brief revival in the late 1990s.
He set it aside as VR failed, and made money inventing some other things (such as tech related to DVDs and Blu-ray discs) in the meantime that allowed him and his wife to continue their fundamental research. Overall, the Bears have more than 100 patents.
Bear said he was working with videographer Rachel Strickland on some museum-related visuals. In 2012, the Bears build an iPad app that allowed you to use the tablet as a window into a virtual world. That was done before. But they needed a navigation system where you could move through the world without using your hands (because your hands were busy holding the tablet).
“We didn’t want to muck up the user interface,” Bear said.
That led them to use the motion sensor in the tablet to detect your body movements and to translate those into motion. You can move sideways in a game world, or strafe, by leaning sideways physically.
That experiment led to the creative spark for using the navigation in other applications.
“It felt similar to riding a Segway, which is phenomenal,” Bear said. “As soon as I used the accelerometer and motion controls in VR to control the movement, the motion sickness was gone.”
The patents cover inventions known as BodyNav, Walk-in Theater, and Teleport. Walk-in Theater covers the use of your body to engage with videos, and Teleport is for piloting drones.
BodyNav, Walk-in Theater and Teleport are covered by the following U.S. patent numbers: 9,563,202; 9,579,586; 9,612,627; 9,656,168; 9,658,617; 9,782,684; 9,791,897; and 15/694,210. MonkeyMedia is self-funded.
The PC Gaming channel is presented by Intel®‘s Game Dev program.
