Meta is Working on Making Quest Headsets Work in Moving Vehicles
Learn about Meta's efforts to solve the issue of positional drifting on Quest headsets in moving vehicles.
Why Does Positional Drifting Happen in Moving Vehicles?
Markerless inside-out tracking systems on headsets, glasses, and self-tracking controllers rely on both cameras and the inertial measurement unit (IMU). The IMU consists of a tiny accelerometer and gyroscope that provide updates around 1000Hz, allowing for lower latency.
However, the IMU can't directly detect absolute movement. It senses acceleration relative to gravity and calculates velocity and displacement based on that. This process is known as dead reckoning. The optical components like cameras or laser base stations are used to correct for cumulative errors caused by the IMU's noisiness.
In moving vehicles like airplanes, the accelerometer picks up the vehicle's acceleration, mistaking it for headset acceleration. This leads to sudden and rapid positional drifting, as seen in a video shared by Andrew Fox.
Meta's Efforts to Solve the Issue
Currently, it's possible to disable 6DoF positional tracking on Quest headsets, but this also disables passthrough. Meta may be considering allowing passthrough when positional tracking is disabled.
Alternatively, Meta might be working on a solution to make positional tracking work in moving vehicles. This could involve instructing the system to rely solely on camera visuals and ignore the IMU. A previous research project by Meta demonstrated a Quest Pro working in a moving BMW by interfacing with the car's onboard IMU.
On the other hand, Apple has a Travel Mode for use on airplanes with their Vision Pro headset, but the exact functionality of this mode is unknown. Apple has claimed it will 'stabilize visuals,' and further testing is needed to understand its capabilities.
The Future of Quest Headsets in Moving Vehicles
Meta's CTO, Andrew Bosworth, has acknowledged the issue and stated that Meta is 'working on it.' Whether they find a solution that allows positional tracking in moving vehicles or enable passthrough without positional tracking remains to be seen.
In the meantime, users can support Meta's work by disabling their ad blockers or becoming members of the platform, helping to fund ongoing research and development.
Similarly, Apple's Vision Pro and its Travel Mode may offer a viable solution for using headsets in airplanes, but more information is needed to fully understand its capabilities.
