Susi Server

Using Headsets with FusionHub

This page contains tutorials for getting the most popular mixed and augmented reality headsets running with FusionHub.

Varjo XR-4

Requirements:

The photos below show the Varjo XR-4 with the ART marker target attached.

  1. In your workspace load the configuration for LPVR-CAD Varjo XR-4. This is our standard graph for Varjo setups: an optical tracking source (DTrack Optical in this example) and the Varjo HMD node feed the IMU-Optical Fusion filter, and the fused pose routes back into the Varjo HMD node through the fusedPoseResult connector, which delivers it to Varjo Base for rendering. The IMU-Optical Intercalibration node is used for the alignment calibration described below, and the 3D View sink visualizes the tracking data.

  1. Make sure your XR-4 is connected to your computer and shows as connected in Varjo Base.

  1. In FusionHub inspect the properties of the Varjo HMD node. It shows the option to install or re-install the LPVR tracking plugin for Varjo Base. Click Install to install the plugin, then click Start Varjo Base. Varjo Base scans for tracking plugins at startup, so if it was already running during the installation, stop and start it again from this panel.
  1. In Varjo Base go to Settings, open the System page and under Headset tracking select LPVR-FusionHub-Varjo. Varjo Base now takes the headset pose from FusionHub instead of its built-in inside-out tracking.

  1. Set up your optical tracking system in its own frontend. For ART systems (e.g. SmartTrack3) this is done in the DTrack UI: calibrate the marker target attached to the XR-4 as a body, start the measurement and configure the UDP data output to send to the FusionHub computer. Below you see the XR-4 marker target tracked in DTrack, and its body geometry in the Body Adjustment view.

In the properties of FusionHub’s optical source node, select the DTrack subtype and enter the body ID of the headset target and the UDP port DTrack sends to. Once the measurement is running, the optical node receives the headset pose.

  1. Calibrate the alignment between the headset IMU and the optical marker body as described in the Varjo XR-4 section of the Headset Calibration Tutorials. This is needed once per marker target. Once the calibration is applied, put on the headset and confirm the rendered scene is stable and globally referenced.

Apple Vision Pro

  1. On your Vision Pro, go to TestFlight and download the latest version of the LPVR-AIR client. Start the client.
  2. Load the LPVR-CAD Vision Pro (Inside-out fusion) configuration into FusionHub RS.

3. In the ALVR properties install the ALVR driver to SteamVR and start SteamVR.

4. Go to the ALVR Control page and click trust next to the ID of your client in the New Wireless Devices panel. The LPVR-AIR client on the Vision Pro should now connect to the streamer backend in FusionHub.

Once connection is established the performance tab will show the status of the data stream to the headset.

The settings window shows controls for adjusting various client parameters such as the video pass through and hand tracking passthrough.

5. Adjust the connection parameters in the optical node in the node graph to reference headset orientation with data from ART or Optitrack optical tracking.

Meta Quest or VIVE Focus Vision

  1. Install the provided LPVR-AIR client on your headset using the Sidequest advanced installer.
  2. The FusionHub side of the setup for Meta Quest and VIVE Focus Vision is identical to the Vision Pro installation described above. Instead of the Vision Pro HMD being shown as streaming data you’ll see the Meta Quest or Focus Vision in the list.

Xreal One Pro

Requirements:

  1. In your workspace load the configuration for LPVR-DUO Xreal One Pro.

Make sure your Xreal One Pro is connected to your computer. The Xreal One Pro must be connected to your computer via a Thunderbolt-compatible USB-C port (DisplayPort via USB-C). You can easily find out if your port supports Thunderbolt by connecting the Xreal headset and checking if it shows up as separate display in Windows display settings.

Adjust the menu settings on the Xreal One Pro:

To enter the on screen menu, double click button on bottom of hmd to go to menu.

In Spatial Screen settings:

Adjust Shortcut settings:

Now whenever you long-press the top button of the Xreal One Pro HMD, the HMD will switch to full side-by-side mode. A useful shortcut. Full side-by-side mode is required for our display driver to work.

The HMD should show up as an additional screen as shown below:

  1. Back in FusionHub check the properties in the LPVIZ output node. It’ll show the option to install or re-install the LPVIZ driver as SteamVR plugin. Click install to install the driver, then click Start SteamVR to start SteamVR. This will activate the LPVIZ driver and you should then see SteamVR home through your Xreal One Pro.

3. In order to connect your optical tracking system, inspect the properties of the optical node. See an example of a configuration with ART below. Consult with us if you have issues setting the correct parameters for your optical tracking setup. Note: The LPVIZ SteamVR driver is integrated with FusionHub RS. You don’t need to install any external driver apart from SteamVR itself.

Xreal Air 2 Ultra

The Xreal Air 2 Ultra setup is identical to the One Pro setup described above. The Xreal Air 2 Ultra doesn’t have an on-screen menu. Switch to side-by-side mode by pressing the volume-down button for 2s.

Loading documentation…