Google's Motion Sense enables gesture control for Pixel 4

2019-10-22

Engineers demonstrated their so-called Project Soli, a novel gesture recognition technology for handheld devices, at the Google conference hosted by the Advanced Technology and Projects (ATAP) team. The promise of this technology is that you can interact with devices without physically touching them, creating new ways to perform tasks.


After more than four years of development, Soli finally brings gesture motion sensing to Google Pixel 4 series phones. Engineers said, "We've spent a week with Pixel 4 to get Motion Sense on track. While our overall impression is positive, it's clear that Soli still has a long way to go to fulfill its potential."



At a high level, Soli combines high-speed sensors and data analysis technologies such as Doppler to detect the size, position, and proximity of objects within its 180-degree field of view with sub-millimeter accuracy. Then, electromagnetic waves at a frequency of 60GHz reflect the information back to the antenna, and the data obtained from the reflected signal, such as time delay or frequency change, provides hardware information about the interaction for Soli.


The latest public information about Soli indicates that it consumes approximately 0.054 watts of power and can track up to 18,000 frames per second, a granularity sufficient to detect when someone rubs their thumb and forefinger together. In fact, the latest iteration of Soli theoretically can detect a person standing 23 feet away behind a wall.Soil, located in the Pixel 4 series devices, can only detect three types of motion:




  • Presence: When the Pixel 4 or Pixel 4 XL is placed flat on a table, Motion Sense detects objects between 0.6 inches and 1 foot. In a stationary state, it switches the phone's display to a power-saving ambient mode.

  • Reach: Motion Sense detects when a hand gestures towards it and quickly opens the phone's screen and facial recognition sensor to expedite the unlocking process. Additionally, if there are loud ringtones or alarms, they will be temporarily muted.

  • Gestures: A hand wave from about one and a half feet above the Soli sensor can dismiss incoming calls and pause alarms. Moreover, if a supported music app is running, it will skip to the next song in the playlist.




The Pixel 4 screen below the top bezel will emit a small glow to indicate when the Soli sensor detects motion in all three motion types.

Touch gestures performed exceptionally well in our tests, always waking up the Pixel 4 from sleep and initiating facial recognition to expedite the unlocking process. Soli's gesture recognition is a better showcase of its robustness. Swiping from right to left or left to right on the Soli sensor can enter the playlist and switch to the next or previous song, even if music apps like Google Play Music, Spotify, and Deezer are running in the background.


Like any new technology, Motion Sense still has a lot of work to do. Assuming Google fulfills its promises to develop Soli in the coming months and years, Motion Sense could become one of the most compelling reasons to purchase a Pixel 4 or Pixel 4 XL.

RECENT AI NEWS

RECENT AI TOOLS