Absolute 3D tracking

Position and orientation tracking using laser interferometers

WorldSense positional tracking, an example of markerless camera-based tracking. (Image: UploadVR)

Razer hydra, a 3D input device that uses 3D tracking

3D tracking refers to systems that determine the position and orientation of objects in three-dimensional space, playing a crucial role in human-computer interaction (HCI).

3D tracking systems can be used to track headsets and handheld devices like controllers or phones. It can be for either 3DOF position, 3DOF rotation, or 6DOF input.

3D tracking can be categorized into the following types:

• 3DOF Position Tracking: Determines the location of an object along three spatial axes (X, Y, Z).
• 3DOF Rotation Tracking: Measures an object's rotation around three axes (pitch, yaw, roll).
• 6DOF Tracking: Combines both position and rotation tracking, providing a comprehensive representation of an object's pose in space.

One of the goals of 3D tracking is to specify a point in 3D space.

3D tracking is pivotal for various applications in human-computer interaction, including:

• Input Devices: Enhancing the usability of various input devices such as game controllers, 3D mice, and styluses.

It is useful for providing position and orientation data to a 3D engine like Unity or Unreal. It is used in devices like the Meta Quest 2. PnO tracking constitutes an absolute positioning system.

Methods of 3D tracking include electromagnetic 3D tracking, camera-based tracking, and acoustic 3D tracking.

There are a few different methods for 3D tracking, such as electromagnetic 3D tracking and camera-based tracking such as SLAM or marker-based tracking.

Methods of markerless camera-based tracking include methods using SLAM or VIO.

3D tracking can be done in using multilateration using pointed laser interferometers.

Methods

Multilateration

The first class of methods is those that use multilateration. This includes methods that use time-of-flight measurements of radio signals, such as visible light or ultra-wide band, or alternatively, ultrasonic acoustic signals.

• UWB tracking
• Ultrasonic tracking

Perspective n-point

The second class of methods is those that use perspective n-point calculations from a camera image.

• Marker-based tracking - Camera based tracking that uses markers in the environment, which is simpler to implement.
• Markerless inside-out tracking, which is camera-based tracking (SLAM/VIO)- This is used on headsets such as Meta Quest headsets and the Project North Star. An open source method is Basalt. Markerless inside-out tracking can use visible light or infrared light, which can be artificially emitted.
• Infra-red based pnp tracking

Electromagnetic

A third class of methods is those that use field strength of magnetic coils (electromagnetic tracking).

• Electromagnetic tracking. Electromagnetic tracking gets jittery when there is metal around, like a metal laptop computer.

Neural

A fourth class of methods is those that use neural networks for calculation of position using artificial structures.

Phase based

Phase-based ultrasonic tracking was used in Ivan Sutherland's original head-mounted display.

See also

• List of 3D tracking companies