Kemorig supports Webcam Tracking, which can track:

  • Head Rotation and Position
  • Eye Rotation (Limited)
  • Face Expression (Limited)
  • Chest Rotation (Limited, off by-default)

Enabling Webcam Tracking

In kemorig, navigate to System Options > Webcam.

To enable Webcam Tracking:

  • Check the box for "Enable Webcam Tracking".
  • Then, select your device name in the Webcam dropdown. You may have to click the refresh icon next to it to discover your webcam.

If your webcam is not recognized, double-check that no other application is currently using it. Generally, a webcam can only be used by one application at a time.

Strengths and Weaknesses of Webcam Tracking

Webcam Tracking has certain strengths and limitations when compared to ARKit Tracking with an iPhone. Unlike an iPhone, a webcam does not have a depth-sensing camera, which makes high-fidelity tracking more difficult.

Webcam Strengths

  • Tracks position in addition to rotation (ARKit Tracking in kemorig currently only tracks head rotation).
  • Good as maintaining head tracking even at extreme angles (ARKit tends to lose the head as it turns away more quickly).

Webcam Limitations

  • Eye Rotation is limited left-and-right rotation, not up-and-down.
  • Face Expression is limited to a sub-set of the morph targets that ARKit uses.
  • Chest Rotation is limited to roll, and is fairly innaccurate, and as-such is disabled by default.

For more information on the sub-set of morph targets Webcam Tracking uses, see this page:

Facial Morph Targets

How to set up facial morph targets for your avatar

Tips for Best Results

Center your Webcam

It’s very important to position your webcam directly in-front of your face. The idea position is on-top of your center monitor.

If your webcam is off to the side, the following can go wrong:

  • Eye and Face Expression tracking will suffer.
  • Head rotation will become innacurate (especially, it will have difficulty discerning pitch and roll rotation).

A centered webcam is extremely important. Tracking quality will suffer dramatically when tracking from the side.

Use a Well-Lit Room

Webcam tracking uses a video feed from your camera, and if the lighting in your room is poor, the video feed will be low quality.

Recenter Tracking in kemorig

Re-centering webcam tracking inside kemorig is important. Not only does it re-center your avatar’s body, it also measures distances between face landmarks to know what your “rest” position is.

Make sure you look straight-ahead with a neutral expression when re-centering tracking.