Why Hand & Finger Tracking Works Here
21 landmarks per hand
Wrist plus every finger’s full knuckle-to-tip chain — the same landmark topology used across most modern hand-tracking models — updated live from a webcam or video.
Optional two-hand mode
Track a single hand for precision, or switch on Two Hands to follow both simultaneously, each labeled and tracked independently.
Automatic Left/Right labeling
Each detected hand is identified as Left or Right at the wrist, so downstream logic (or an OSC/TouchDesigner patch) can react differently per hand.
Gesture-ready visual overlays
Skeleton connections, halo auras, glow outlines, and other visual styles render directly on the tracked hand — usable as a finished performance visual, not just a debug skeleton.
Stream landmark data live
Same OSC/WebSocket telemetry system as the rest of Vis Exo — broadcast per-landmark coordinates to TouchDesigner, Max/MSP, or any WebSocket-capable receiver.
Entirely client-side
Hand detection runs locally via WebAssembly — no camera frame is ever uploaded anywhere.
Frequently Asked Questions
How many points does hand tracking detect per hand?
21 — the wrist plus the full knuckle-to-fingertip chain of all five fingers, following the standard hand-landmark topology.
Can it track both hands at the same time?
Yes, via the Two Hands toggle — each hand is tracked and labeled (Left/Right) independently.
Does hand tracking recognize gestures like a fist or thumbs-up?
Yes. Turn on Gesture Labels and it names five hand poses as you make them: Peace, Pointing, Thumbs Up, Fist and Open Palm. For anything else, the raw landmark positions are available through CSV export and the OSC/WebSocket stream.
Can I export hand-tracking video or landmark data?
Yes — export the composited video (WebM/MP4), or export per-landmark coordinates frame-by-frame as CSV.
Can I add a hand tracking effect to an existing video?
Yes. Load a video instead of the webcam and the hands are tracked frame by frame; Record saves the clip with the effect burned in, as MP4 or WebM.
