Files

T

L'électron rare 088b233a48 feat(data-only): ingest /pose/hands into handFeat

Add OSCdef(\poseHands) to data_feeds.scd storing lx/ly/lopen/lspeed,
rx/ry/ropen/rspeed/dist into ~handFeat Dictionary (9 floats, pid=0).
Initialize ~handFeat alongside existing ~poseState/~poseKin.

Load scene_pose_action.scd in boot.scd after scenes.scd so ~mapPoseToFx
is defined at runtime (was silently dead before).

Document /pose/hands contract in data_only_viz/README.md.

2026-06-26 09:59:34 +02:00

scripts

Merge branch 'feat/action-head'

2026-06-23 23:01:07 +02:00

shaders

feat(data-only): mode openpos #9 (skeleton)

2026-05-13 20:19:47 +02:00

tests

fix(viz): numpy-safe hand filter + tests

2026-06-26 09:52:20 +02:00

training

feat(data-only-viz): action-head v3 hands+lips

2026-05-13 23:26:14 +02:00

web

feat(pose): enrichir card dashboard

2026-05-13 20:29:26 +02:00

__init__.py

feat(viz): python+metal data-only visualizer

2026-05-13 09:34:01 +02:00

_av_capture.py

fix(camera): strict built-in filter both sides

2026-05-13 12:01:14 +02:00

_camera_select.py

fix(multihmr): cv2 brightness probe + heartbeat

2026-05-13 11:46:01 +02:00

_smplerx_shims.py

chore(data-only-viz): SMPLer-X T1 abandon

2026-05-13 19:27:55 +02:00

.gitignore

chore(viz): gitignore __pycache__ in data-only-viz

2026-05-13 09:34:13 +02:00

action_head_pub.py

fix(viz): numpy-safe hand filter + tests

2026-06-26 09:52:20 +02:00

action_head.py

feat(data-only-viz): action-head v3 hands+lips

2026-05-13 23:26:14 +02:00

apple_vision_pose.py

perf(multi-hmr): autocast opt-in

2026-05-13 23:24:06 +02:00

arkit_joint_map.py

feat(viz): ARKit 91 -> MP 33 joint map

2026-05-14 12:03:55 +02:00

CLAUDE.md

Merge branch 'feat/action-head'

2026-06-23 23:01:07 +02:00

coreml_pose.py

feat(viz): python+metal data-only visualizer

2026-05-13 09:34:01 +02:00

detrpose.py

feat(detrpose): expose model size as CLI flag

2026-05-13 12:31:11 +02:00

dino_reid.py

feat(av-live): openpos 3D + DINO reid + filter

2026-05-14 00:30:42 +02:00

euro_filter.py

feat(viz): python+metal data-only visualizer

2026-05-13 09:34:01 +02:00

fine_analysis.py

feat(viz): python+metal data-only visualizer

2026-05-13 09:34:01 +02:00

hand_features.py

feat(viz): emit hand features each tick

2026-06-26 09:45:41 +02:00

holistic.py

feat(viz): python+metal data-only visualizer

2026-05-13 09:34:01 +02:00

icp_fusion_worker.py

feat(icp): wire fusion thread behind ICP_FUSION

2026-05-14 12:13:37 +02:00

icp_fusion.py

feat(icp): FusionWorker + State.lidar_points

2026-05-14 12:10:09 +02:00

iphone_osc_listener.py

feat(viz): iphone OSC listener :57128

2026-05-14 12:03:55 +02:00

lidar_calib.py

feat(icp): Kabsch + calibration CLI scaffold

2026-05-14 12:01:45 +02:00

lidar_receiver.py

feat(icp): LiDAR TCP socket reader with reconnect

2026-05-14 11:57:13 +02:00

main.py

Merge branch 'feat/action-head'

2026-06-23 23:01:07 +02:00

mesh_rigger.py

feat(av-live): openpos 3D + DINO reid + filter

2026-05-14 00:30:42 +02:00

mesh_topology.py

feat(viz): python+metal data-only visualizer

2026-05-13 09:34:01 +02:00

multi_hmr_scaffold.md

docs(multihmr): final README + scaffold status

2026-05-13 11:25:27 +02:00

multi_hmr_worker.py

Merge branch 'feat/action-head'

2026-06-23 23:01:07 +02:00

multi.py

perf(av-live): pyobjc + GPU MediaPipe + queues

2026-05-14 02:17:29 +02:00

multihmr_coreml.py

fix(data-only): CoreML Multi-HMR usage bugs

2026-05-18 17:46:33 +02:00

MULTIHMR_README.md

perf(data-only-viz): swap Multi-HMR to ViT-S 672

2026-05-13 14:27:16 +02:00

multihmr_remote.py

perf(av-live): pyobjc + GPU MediaPipe + queues

2026-05-14 02:17:29 +02:00

nlf_worker.py

fix(nlf): bail out after persistent inference failures

2026-05-13 11:49:59 +02:00

osc_listener.py

docs(osc): document dual /data/pose listeners

2026-05-13 13:42:58 +02:00

pose_bridge.py

feat(viz): /pose/hands OSC sender

2026-06-26 09:37:13 +02:00

pose_filter.py

feat(viz): arkit_fuse stage overrides 14 slots

2026-05-14 12:03:55 +02:00

pose.py

feat(viz): python+metal data-only visualizer

2026-05-13 09:34:01 +02:00

pyproject.toml

deps(icp): add open3d optional extra + smoke test

2026-05-14 11:51:12 +02:00

README.md

feat(data-only): ingest /pose/hands into handFeat

2026-06-26 09:59:34 +02:00

renderer.py

chore(viz): address final review nits

2026-05-13 12:43:27 +02:00

smpler_x_scaffold.md

feat(viz): python+metal data-only visualizer

2026-05-13 09:34:01 +02:00

smplx_decoder.py

fix(smplx): cpu fallback when mps unavailable

2026-05-13 13:02:48 +02:00

smplx_osc_sender.py

feat(av-live): distributed Multi-HMR + fused mesh

2026-05-14 02:02:33 +02:00

state.py

feat(icp): FusionWorker + State.lidar_points

2026-05-14 12:10:09 +02:00

tracker.py

perf(data-only-viz): better tracking + dedup

2026-05-13 18:53:29 +02:00

uv.lock

deps(icp): add open3d optional extra + smoke test

2026-05-14 11:51:12 +02:00

wham_tram_scaffold.md

feat(viz): python+metal data-only visualizer

2026-05-13 09:34:01 +02:00

README.md

data_only_viz

Python + Metal visualiser for the AV-Live data-only patch.

Hand features OSC

/pose/hands [pid=0, lx, ly, lopen, lspeed, rx, ry, ropen, rspeed, dist]

Emitted once per pipeline tick by pose_bridge.send_hands to sclang :57121.
L = leftmost hand on screen, R = rightmost; absent hand -> its 4 floats are 0.
Ranges: positions/openness/dist in [0,1]; speed >= 0 (normalized units/frame).
Consumed by SuperCollider ~handFeat (data_only) and the Metal renderer uniforms.
Multi-person is not yet carried (pid is always 0).