VR Level Up: Eye Tracking for Virtual Reality

Turk Fezzik 2017-05-17

The next wave in virtual reality is eye tracking. This technology enables more immersive experiences and reduces the load on your graphics card. Accessories for existing head mounted displays [HMDs] are launching now and the next generation of HMDs will have eye tracking built in. Let us look at how eye tracking works.

How Eye Tracking Works

eye tracking

The prevalent implementation of eye tracking in virtual reality systems uses infrared emitters and cameras. The tracker projects imperceptible infrared light into your eyes and the camera records the light that reflects off your retina. By measuring the vector between the center of your iris and the corneal reflection the tracker computes your point of regard. Modern systems measure the angle of your gaze with an accuracy of less than one degree.

Immersion is Everything

Virtual reality applications, and gaming in general, depend on immersion to draw users in and make them suspend disbelief. Software developers use your gaze direction to create more immersive environments. Imagine wildlife that scampers away when you make eye contact or non-player characters who engage you in conversation if you look at them. Your virtual waifu might even ask “Are you listening to me?” if you avert your gaze for too long.

Eye tracking also helps with user interface design. Point and click menus are not very useful when your input devices are hand-tracked controllers. Eye tracking gives designers an extra dimension of input that allows them to make contextual menus for the object you are looking at. Current virtual tourism applications like Realities and Destinations allow you to point at a landmark and read or hear more information about it. With eye tracking, you could let your gaze linger on an object to access that information instead.

Rendering on a Potato PC

Your eyes naturally focus at the center of your gaze and objects outside of that area are slightly out of focus. Virtual reality applications can use this phenomenon combined with eye tracking to reduce the rendering quality for the parts of the scene that are in your peripheral vision. This technique, called foveated rendering, trades off a small increase in CPU load for a large decrease in GPU load. By using eye tracking, designers reduce the minimum system requirements for their application.

Your eyes are the windows to your soul. This adage has uses in VR game design. In general, when you gaze towards an object or location, you are about to interact with that part of the scene. Designers may use this assumption to preload data from your hard drive or the network. When implemented properly this technique creates a smoother interaction with the virtual world.

Beware the Dark Side

There are marketing implications for eye tracking that have the potential for abuse. By observing how long your gaze lingers on an object companies begin to profile your likes and dislikes. Marketing companies can gather a wealth of information by placing a few props in the game world. Do we want our games analyzing whether we prefer breasts to thighs or Quafe to Quafe Zero?

I Need It Now


The Fove Kickstarter campaign launched in May of 2015. You can buy one now at GetFove.com for about $600. The Fove uses IR-based head tracking like the Oculus Rift and features one, 120 FPS, eye tracking camera per eye. An eye-tracking accessory for the HTC Vive, called the 7invensun aGlass, releases later this month for around $220. The aGlass unit snaps into your HTC Vive headset and gives a massive boost in performance to titles that support foveated rendering.

If you are willing to wait a little, the next generation of high-end head mounted displays will come with eye tracking built in. Foveated rendering reduces the system requirements for virtual reality, which opens the market to more users. That alone is reason enough for hardware manufacturers to rally behind eye tracking.

Let your voice be heard! Submit your own article to Imperium News here!

Would you like to join the Imperium News staff? Find out how!

Comments

  • Pew Pew

    Breasts and quafe zero and I don’t care who knows.

    How is VR doing in general? Has there been a lot of adoption of it? I feel like there was a lot of hype last year and now it’s not talked about so much. Are there killer games for it? How is Valkyrie doing?

    Anyone who has a VR headset how frequently do you use it? Are you still enjoying it or is it more of a gimmick?

    May 17, 2017 at 10:09 am
    • phuzz Pew Pew

      Bought an Oculus developer kit (DK2) a while back. It’s pretty cool, but it’s been back in it’s box for the last six months or so, because it feels gimmicky. A very cool gimmick (if you ever get the chance to have a go, do so), but a gimmick none the less.
      Maybe the newer headsets with their motion tracking hand controls are better, but they’re going to have to get a lot cheaper before I try again.

      May 17, 2017 at 11:40 am
    • Set Pew Pew

      I have a Samsung Gear. I like it but there aren’t many “killer games”. And, the best games require a controller which I haven’t picked up yet. As a result, I haven’t played it near enough. If I could sync it with my PC, I think I would use it a lot more.

      May 17, 2017 at 1:43 pm
    • Walextheone Pew Pew

      I use my Oculus Rift every day. It’s much less a gimmicky thing now days and more mature apps and games are coming out now when the game studio had time to properly develop. AAA games takes like three years to develop and so far the consumer VR headsets have only been out for a year.

      So in short. The VR industry it’s getting better by the month 🙂

      May 17, 2017 at 3:33 pm
      • I agree with this comment. The quality of the titles coming out lately are much better than what was there at launch. I can spend hours in Arizona Sunshine and Super Hot.

        May 18, 2017 at 3:09 am
    • SeaBassSA Pew Pew

      I have a Google Daydream which came with my phone. I played with it for a few days but now it is in a drawer somewhere.

      My biggest complaint with it was having to recenter the cursor every few minutes, making playing games a chore. The “controller” is awkward and not of much use beyond point and click.

      I did buy Gunjack 2 for it ($12.99!), but with the cursor issue it is almost unplayable. There weren’t too many games in the Daydream store at the time, but maybe that has changed. However, it works great for watching VR demos.

      If the price is right (free) give it a shot, but at this point I wouldn’t buy one.

      May 17, 2017 at 3:37 pm
  • Gartner predicts 80 million annual volume of HMDs alone by 2020. In the first year millions of HMDs were sold.

    I don’t use my Vive daily mostly because I don’t leave it hooked up all the time. I’d use it more if I had a dedicated space for it. I still enjoy using it and I enjoy taking it on the road more. Some of the best moments for me are when I let someone who’s never used VR try it for the first time.

    May 17, 2017 at 3:45 pm
  • Caleb Ayrania

    Staring into the eyes of my Waifu.. SOLD Turk, where do I sign up? 🙂

    May 18, 2017 at 8:38 pm