Files

T

History

clement b8f5cc0b2e feat: thumb-finger pinch detection

PinchDetector (hysteresis + refractory, normalized by hand
size) emits /pose/pinch. Publisher picks iPhone Vision hands
when fresh (FINGER_SOURCE). 4 pinch tests.

2026-06-28 14:50:05 +02:00

scripts

feat(viz): iphone USB skeleton to OSC bridge

2026-06-27 13:57:17 +02:00

shaders

feat(viz): scene reacts to hand features

2026-06-26 10:24:48 +02:00

tests

feat: thumb-finger pinch detection

2026-06-28 14:50:05 +02:00

training

feat(data-only-viz): action-head v3 hands+lips

2026-05-13 23:26:14 +02:00

web

feat(pose): enrichir card dashboard

2026-05-13 20:29:26 +02:00

__init__.py

feat(viz): python+metal data-only visualizer

2026-05-13 09:34:01 +02:00

_av_capture.py

fix(camera): strict built-in filter both sides

2026-05-13 12:01:14 +02:00

_camera_select.py

fix(multihmr): cv2 brightness probe + heartbeat

2026-05-13 11:46:01 +02:00

_smplerx_shims.py

chore(data-only-viz): SMPLer-X T1 abandon

2026-05-13 19:27:55 +02:00

.gitignore

chore(viz): gitignore __pycache__ in data-only-viz

2026-05-13 09:34:13 +02:00

action_head_pub.py

feat: thumb-finger pinch detection

2026-06-28 14:50:05 +02:00

action_head.py

feat(data-only-viz): action-head v3 hands+lips

2026-05-13 23:26:14 +02:00

apple_vision_pose.py

perf(multi-hmr): autocast opt-in

2026-05-13 23:24:06 +02:00

arkit_joint_map.py

feat(viz): ARKit 91 -> MP 33 joint map

2026-05-14 12:03:55 +02:00

CLAUDE.md

Merge branch 'feat/action-head'

2026-06-23 23:01:07 +02:00

coreml_pose.py

feat(viz): python+metal data-only visualizer

2026-05-13 09:34:01 +02:00

detrpose.py

fix(viz): load DETRPose config from src.core

2026-06-26 16:44:35 +02:00

dino_reid.py

feat(av-live): openpos 3D + DINO reid + filter

2026-05-14 00:30:42 +02:00

euro_filter.py

feat(viz): python+metal data-only visualizer

2026-05-13 09:34:01 +02:00

fine_analysis.py

feat(viz): python+metal data-only visualizer

2026-05-13 09:34:01 +02:00

finger_strike.py

feat: thumb-finger pinch detection

2026-06-28 14:50:05 +02:00

hand_features.py

feat(viz): emit hand features each tick

2026-06-26 09:45:41 +02:00

holistic.py

feat(viz): python+metal data-only visualizer

2026-05-13 09:34:01 +02:00

icp_fusion_worker.py

feat(icp): wire fusion thread behind ICP_FUSION

2026-05-14 12:13:37 +02:00

icp_fusion.py

feat(icp): FusionWorker + State.lidar_points

2026-05-14 12:10:09 +02:00

iphone_osc_listener.py

feat(viz): iphone OSC listener :57128

2026-05-14 12:03:55 +02:00

iphone_usb_source.py

feat: prefer iphone vision hands for air-piano

2026-06-28 14:12:34 +02:00

lidar_calib.py

feat(icp): Kabsch + calibration CLI scaffold

2026-05-14 12:01:45 +02:00

lidar_receiver.py

feat(icp): LiDAR TCP socket reader with reconnect

2026-05-14 11:57:13 +02:00

main.py

feat: spacebar advances concert morceau

2026-06-27 21:14:03 +02:00

mesh_rigger.py

feat(av-live): openpos 3D + DINO reid + filter

2026-05-14 00:30:42 +02:00

mesh_topology.py

feat(viz): python+metal data-only visualizer

2026-05-13 09:34:01 +02:00

multi_hmr_scaffold.md

docs(multihmr): final README + scaffold status

2026-05-13 11:25:27 +02:00

multi_hmr_worker.py

Merge branch 'feat/action-head'

2026-06-23 23:01:07 +02:00

multi.py

feat: VIDEO_ROTATE to rotate source frame

2026-06-28 13:44:09 +02:00

multihmr_coreml.py

fix(data-only): CoreML Multi-HMR usage bugs

2026-05-18 17:46:33 +02:00

MULTIHMR_README.md

perf(data-only-viz): swap Multi-HMR to ViT-S 672

2026-05-13 14:27:16 +02:00

multihmr_remote.py

fix(viz): repair multihmr remote protocol tests

2026-06-26 15:53:44 +02:00

nlf_worker.py

fix(nlf): bail out after persistent inference failures

2026-05-13 11:49:59 +02:00

osc_listener.py

docs(osc): document dual /data/pose listeners

2026-05-13 13:42:58 +02:00

pose_bridge.py

feat: thumb-finger pinch detection

2026-06-28 14:50:05 +02:00

pose_filter.py

feat(viz): arkit_fuse stage overrides 14 slots

2026-05-14 12:03:55 +02:00

pose.py

feat(viz): python+metal data-only visualizer

2026-05-13 09:34:01 +02:00

pyproject.toml

fix(viz): harden iphone-usb source

2026-06-27 15:27:06 +02:00

README.md

feat(data-only): ingest /pose/hands into handFeat

2026-06-26 09:59:34 +02:00

renderer.py

feat(viz): pack hand features into uniforms

2026-06-26 10:19:10 +02:00

smpler_x_scaffold.md

feat(viz): python+metal data-only visualizer

2026-05-13 09:34:01 +02:00

smplx_decoder.py

fix(smplx): cpu fallback when mps unavailable

2026-05-13 13:02:48 +02:00

smplx_osc_sender.py

feat(av-live): distributed Multi-HMR + fused mesh

2026-05-14 02:02:33 +02:00

state.py

feat: prefer iphone vision hands for air-piano

2026-06-28 14:12:34 +02:00

tracker.py

perf(data-only-viz): better tracking + dedup

2026-05-13 18:53:29 +02:00

uv.lock

fix(viz): harden iphone-usb source

2026-06-27 15:27:06 +02:00

wham_tram_scaffold.md

feat(viz): python+metal data-only visualizer

2026-05-13 09:34:01 +02:00

README.md

data_only_viz

Python + Metal visualiser for the AV-Live data-only patch.

Hand features OSC

/pose/hands [pid=0, lx, ly, lopen, lspeed, rx, ry, ropen, rspeed, dist]

Emitted once per pipeline tick by pose_bridge.send_hands to sclang :57121.
L = leftmost hand on screen, R = rightmost; absent hand -> its 4 floats are 0.
Ranges: positions/openness/dist in [0,1]; speed >= 0 (normalized units/frame).
Consumed by SuperCollider ~handFeat (data_only) and the Metal renderer uniforms.
Multi-person is not yet carried (pid is always 0).