Middleware  v2.3.0
Loading...
Searching...
No Matches
Finger Tracking

High Fedelty Finger Motion Tracking

The Tracking Algorithm uses internal sensors to track the 3D motions of every thimble on the space. Some other sensors (ToF-Time of Flight sensors) have been introduced to compensate for the drift from which IMU sensors suffer.

Through the Windows application WEART Middleware, you have the option to export the raw sensor data from your running session into a log file, even if using two TouchDivers simultaneously.

To simulate finger motions in ground truth tracking systems or to fine-tune external tracking algorithms, recorded data can be used to simulate the accuracy of the system.

Technical Specifications

  • Sensors
    • IMU (Inertial Measurement unit) sensors
    • ToF (Time of Flight) sensors
  • Finger Tracking Algorithm output rate: 100 Hz
  • Wireless communication
  • Orientation estimation accuracy: +/- 0.5 deg

WEART TouchDiver calibration

The TouchDiver's sensors need to be properly calibrated to provide optimal motion tracking. The offsets detected in all IMU type sensors are corrected during our product's manufacture stage. Since the offsets change over time due to the environment in which it is used or due to physical stress on the sensors, we introduced the possibility to perform the calibration whenever it would be necessary in our software.

We use IMU (Inertial Measurement Unit) sensors, thus calibration of these sensors is required to achieve higher accuracy in tracking finger movements.

Calibration procedures can be performed whenever necessary since sensor offsets change over time as a result of the environment in which they operate or physical stress on the sensors.

  • Calibration Time:
    • 30 seconds
  • Calibration Steps
    • Launch WEART Middleware app
    • Connect TouchDiver to Middleware
    • Open Calibration Panel
    • Calibrate sensors
  • When should I perform calibration procedure?
    Calibrated sensors is translated in a better tracking accuracy, so be sure to calibrate the device:
    • After device firmware update
    • If sensors experience physical stress over a long enough period of time
    • If there are significant temperature changes in the operating environment
    • Accuracy of finger tracking is noticeably worse

Calibration Routine

First of all, just connect one device at a time to Middleware; otherwise, it won't be able to calibrate many devices simultaneously.

While the device is connected, from Settings Icon in the Middleware UI, press Go to Panel button related to device calibration. The following panel will open.

You can click Start Calibration Process if your device has been placed, as in the image,on a flat surface. The procedure that automatically determines all of the device's sensor offsets will start after confirmation. A notification stating whether the calibration was successful or unsuccessful will be shown after 30 seconds.

The routine is successfully completed if the following information is displayed once the calibration procedure is ended.

Otherwise, a notification will appear if the procedure fails, briefly describing the cause of the failure.



Warning
Since it changes sensor offsets, be sure to not move you device during all calibration process! Even small flickers can cause calibration failure!

Using Finger Tracking in VR experiences

A photo that demonstrates how to properly wear the TouchDIVER is shown below.

Finger Tracking algorithm provides movement detection for VR experiences. To move individual fingers of the virtual hand, our tracking algorithm will be launched along with an experience that uses the Weart SDK.

There is a starting position that enables the algorithm to be initiated in the proper manner, which is shown in the following image.

  • When the Finger Tracking algorithm is initialized, the hand should be in the demonstrated position.
    • Control Unit (CU) aligned to the ground.
    • Index and middle finger aligned with the CU.
    • Thumb Finger positioned in its natural position when hand is opened.
  • Finger Tracking algorithm will automatically start detecting the initial orientation and correct it to find the right initial pose.
  • After 3 seconds of initial calibration, hand tracking is ready to go.

The left hand works exactly the same, all mirrored symmetrically.

Note
There are two ways for starting finger tracking algorithm:
  • Calibration of finger movements tracking needs a message from client to start: message: "StartCarlibration".
  • Otherwise, can be started pressing Start Calibration button from Middleware User Interface.
    • Be sure to keep the hand in the shown position when pressing Start Calibration button.

Controllers for wrist position detection

In a 3D environment, we need an external system to determine the position. Therefore to use hand movements tracking in a VR experience it is essential to use a VR controller that can accurately determine position in the environment thanks to its optical sensors.

  • To provide realistic hand movements in 3D space, various offsets for the controllers employed are pre-set in the Weart SDK.
  • The correct way to wear the external controllers is demonstrated in the image below so that you can accurately view the virtual hand in the expererience in order to correspond with the real hand.

The multiple controllers that the TouchDiver is compatible with are shown below.

Meta Quest 2

Controller Oculus Quest 2
Controller Oculus Quest 2



Meta Quest Pro

Controller Meta Quest Pro
Controller Meta Quest Pro



Meta Quest 3

Controller Meta Quest Pro
Controller Meta Quest Pro



HTC Vive XR Elite

Controller HTC Vive XR Elite
Controller HTC Vive XR Elite



HTC VIVE Virtual Reality System Trackers

HTC VIVE Tracker
HTC VIVE Tracker



HTC Ultimate tracker (inside-out)

HTC VIVE Tracker
HTC VIVE Tracker



Pico Neo 3

Controller Pico Neo 3
Controller Pico Neo 3



Pico 4 Enterprise

Controller Pico Neo 3
Controller Pico Neo 3



Windows Mixed Reality

Controller Windows Mixed Reality
Controller Windows Mixed Reality



In addition to its versatile compatibility with various controllers, it is worth noting that the TouchDiver extends its adaptability beyond boundaries. With seamless integration, it is fully compatible with a wide range of Virtual Reality (VR) and Augmented Reality (AR) systems, enabling users to delve into immersive experiences effortlessly. Moreover, the TouchDiver's exceptional capabilities extend further to include compatibility with all Motion Capture (MoCap) systems, empowering users to capture and translate their physical finger movements with precision and accuracy.

ART Tracking System

In the above image, we can see the TouchDIVER integrated with the ART tracking system for motion capture, demonstrating the versatility of the TouchDIVER.