Sensing solutions for XR headset and glasses

MEMS sensors bring 3D audio to life by tracking head movements in headsets and glasses and anchoring sounds to virtual sources in space so they stay fixed even as the listener moves. The result is the illusion of being inside the acoustic environment rather than simply listening to it—for example, when watching a movie, streaming music, or playing a game.

This is a form of spatial computing: devices sensing their orientation and movement to adapt digital content in real time. With advanced 6-axis and 9-axis head tracking, the experience remains precise and stable, even if the device shifts slightly. While audio is one powerful example, spatial computing also applies beyond sound. For instance, keeping digital objects, maps, or AR interfaces correctly aligned as you move — whether through image hovering, where visuals follow your gaze for smooth display, or image anchoring, where content remains fixed at a precise location in the room based on your head movements.

The following sensors enable head tracking for 3D audio and spatial computing in XR devices:

• BMI560
• BHI360
• BMM350

Following software enable the solution:

• Sensor fusion Software BSX (head tracking)
• Smart Connected Sensors (spatial computing & head tracking)

Smartglasses with MEMS sensors deliver reliable navigation even when GPS is weak or unavailable, such as indoors or in dense forests. Motion sensors like accelerometers and gyroscopes provide the raw data that software uses for step counting and dead-reckoning algorithms, ensuring continuous guidance by estimating movement when external signals drop.

Orientation tracking through gyroscope and accelerometer calibration keeps navigation arrows, projected into the user’s field of view, aligned with the real world and instantly responsive to head turns. The eCompass provides a stable heading for accurate directional cues, while barometric pressure sensors detect floor changes inside multilevel buildings.

Together, this combination of MEMS hardware and smart algorithms enables hands-free, glance-based navigation that is perfectly suited for XR glasses.

Sensor that enable navigation and head orientation tracking for head worn devices:

• BHI360
• BHI380
• BMI560
• BMM350
• BMP585

Integrated smart features enabling this use case:

• BSX sensor fusion (eCompass)

In XR glasses, MEMS sensors support camera functions with Optical Image Stabilization (OIS), keeping the photos and videos users capture sharp and steady — even while walking or biking.

In XR headsets, even slight delays or drift in head tracking can cause a sensory mismatch between what the user sees and what their body feels — a leading cause of motion sickness. Our MEMS sensors capture head motion with exceptional precision and ultra-low latency, keeping visuals perfectly aligned with natural movements. In VR headsets, camera data is fused with MEMS-based IMUs: if camera performance drops, for example due to dirt or low light conditions the IMU continues to track motion and keeps the image stable and correctly oriented.

Sensors that enable image stabilization and prevent motion sickness in XR devices:

• BHI360
• BMI560
• BMM350

Whether in a virtual meeting, a multiplayer VR game, or a busy city street, clear audio communication is essential. Bosch Sensortec’s MEMS sensors add motion, orientation, and context awareness to make this possible.

They enable advanced features such as speech reconstruction when a user whispers and directional audio that focuses on the speaker’s voice while filtering out background noise in loud environments. In addition, voice activity detection intelligently enables or disables microphones when not in use, helping to conserve power.

Sensor that enables voice enhancements in XR devices:

• BMA550

Integrated smart features enabling this use case:

• Voice activity detection

XR devices with Bosch Sensortec MEMS sensors deliver a seamless, personalized experience by adapting to the wearer’s activity and surroundings. They track height, detect air quality, motion and activity, count steps and know whether the device is being worn or not. Smart wake-up and no-motion detection save energy, extending battery life while ensuring the device is ready when needed.

These capabilities provide fitness insights, recognize daily activities, keep digital information aligned with the real world and ensure cues are delivered at the right time. In AR/VR, context awareness deepens immersion by instantly syncing virtual environments with real-world movements.

Sensors that enable user context aware features:

• BHI360
• BMI560
• BMM350
• BMP585
• BMV080

Integrated smart features enabling this use case:

• BSX sensor fusion
• Activity recognition
• Motion AI Studio Tool (AI/ML model deployment)

Bosch Sensortec’s MEMS sensor solutions make XR headsets and glasses easy to control, without external controllers or smartphones. Users can discreetly interact through multi-tap gestures on the frame or on-skin nearby the frame, answering calls or activating functions with simple taps. Head gesture recognition adds intuitive control, such as nodding to confirm, shaking to decline or tilting to scroll through options.

To complement this, voice activity detection (VAD) ensures voice commands are picked up instantly and reliably, reducing false triggers, saving battery life, and even enabling automatic mute when the user is silent.

Sensors that enable HMI:

• BMA550
• BMA580
• BMI560
• BHI360

Integrated smart features enabling this use case:

• Multi-tap detection
• Head tracking and gestures
• Voice activity detection
• Wrist gestures for glasses accessories