Eye Tracking Technology: The Key to the Future of VR?

2019-11-19

VR technology is still in its early stages of development and has a long way to go before it becomes mature. In order to help its rapid development, practitioners and researchers have come up with many technical solutions, among which eye tracking technology is highly regarded. In narrative VR, one of the rules of immersion is eye contact, and eye tracking can make this interaction more interactive and realistic. This can appear in several forms, including gaze-activated experiences and gaze-sensitive experiences. Eye tracking is a technology that uses sensors to capture and extract eye features, measure eye movement, and estimate the direction of gaze or the position of the eye's fixation point. It can obtain information about the movement of the human eye, thereby achieving a series of simulation and manipulation functions. This technology is widely used in various fields such as medicine, education, and psychology. In the field of VR, eye tracking technology has a wide range of applications. Firstly, eye tracking technology can reduce device power consumption and improve device performance by rendering the gaze point. In reality, the human eye only renders the real world image in high resolution in the gaze point area, while the rest of the image is just blurry contours, textures, and colors. Therefore, with the help of eye tracking technology, VR devices can render images in high resolution only in the gaze point area based on this principle, thereby significantly reducing device power consumption. Eye tracking technology company Tobii has stated that this technology can "reduce the GPU rendering load of VR headsets by 57%." Secondly, eye tracking technology brings a new way of interaction. Through eye tracking technology, users can perform many simple operations solely through eye contact. In the field of VR, this technology can provide users with a more realistic and immersive experience. In addition to the above two points, eye tracking technology can provide many other functions. For example, it can be used for identity recognition of VR headsets by using eye tracking as well as automatically adjusting IPD to provide users with a more comfortable experience, and creating more realistic virtual avatars. Overall, eye tracking technology provides a wide range of application functions. Microsoft, Sony, Apple, and HTC all have related patents for VR applications based on eye tracking technology. HTC has also launched the Vive Pro Eye, a VR headset that focuses on eye tracking. In reality, people mostly use eye movement to lock onto a target. However, in current VR, due to the lack of eye tracking technology, a gyroscope-based head movement perception method is used to lock onto a target, which requires head movement for operation. This method easily increases unnatural head movement and lengthens the target locking process, resulting in inefficiency. Controlling the field of view with head movement and locking the target with eye tracking is the ideal choice for VR UI interaction, as it is both human-friendly and more efficient than traditional operation methods. For example, when staring at an application or object on the interface, the interface starts to change, and the secondary interface of the application icon automatically opens, and the interface automatically scrolls up or down, and so on. Currently, the correction of distortion and chromatic aberration in VR devices is not perfect in terms of hardware. Most of them are compensated at the level of graphic algorithms, which only reduces distortion and chromatic aberration to a certain extent. Due to different interpupillary distances, different wearing methods, and different gaze points of individuals, the pupil can deviate from the pupil position, resulting in different distortion shapes during real-time viewing, which affects the user experience. Obtaining the gaze point of the human eye through eye tracking technology and performing real-time correction of the relative position between the human eye and the lens is undoubtedly an excellent choice to solve the above problems. High-definition image quality is the foundation of VR experience. The current rendering method has high hardware requirements and power consumption. By using eye tracking technology to determine the gaze point of the human eye, the rendering process can only render the gaze point position area (local rendering) during the image rendering process. This ensures that the displayed image is clear enough and greatly reduces the GPU load during the rendering process, thereby reducing the hardware requirements of VR devices. Furthermore, a major advantage is that gaze point rendering is in line with the focusing characteristics of the human eye (clear focus position and blurred surroundings), which can avoid eye fatigue caused by the eyes adapting to the image. In summary, eye tracking technology is a great enhancement and supplement for VR. Taking games as an example, it is entirely possible to use eye movements to call menus, control flashlights, and enhance the immersive horror atmosphere, and use eye control aiming to enhance the immersion of first-person shooter games. There is no perfect thing in the world, and there is no perfect technology. For example, it is not friendly to people with myopia, and there is currently no good eye tracking solution specifically for the myopia population. However, the global myopia population is not small, and they are a significant customer base. No company will easily give up, so the comprehensive application of this technology is just a concept. This is a problem that needs to be overcome. Combining eye tracking with VR allows for a fully controlled research environment and an accurate understanding of the visual attention information of the subjects at every moment. Any simulated environment can be created according to research needs, and research scenarios can be conveniently and quickly reused, which is economical and efficient. Through vision-based natural interaction, it brings new possibilities for creating more immersive research scenarios. Research topics that may cause pain or danger to subjects in a real environment can now be reproduced in a simulated environment. Therefore, it has become one of the key elements of fully immersive research. This is a direction that requires effort.

RECENT AI NEWS

RECENT AI TOOLS