electron-rare/AV-Live

Fork 0

Files

T

History

L'électron rare 5d425b1fbd

CI build oscope-of / build-check (push) Has been cancelled

Details

fix(pose): plumb swap into hand features slots

Review C1 (Critical): /pose/hands per-voice L/R mods routed without
the HAND_SWAP_LR swap while pinch/strike used it — the two paths
contradicted each other on an inverted-chirality source. step() now
takes swap, the publisher passes its env-read value, two tests pin
the contract. Also hoists the route_hands imports (M5) and fixes the
stale slot comment (M1).

2026-07-02 11:09:06 +02:00

scripts

feat(pose): decode iphone 2D skeleton

2026-06-30 19:19:54 +02:00

shaders

feat(viz): scene reacts to hand features

2026-06-26 10:24:48 +02:00

tests

fix(pose): plumb swap into hand features slots

2026-07-02 11:09:06 +02:00

training

feat(data-only-viz): action-head v3 hands+lips

2026-05-13 23:26:14 +02:00

web

feat(pose): enrichir card dashboard

2026-05-13 20:29:26 +02:00

__init__.py

feat(viz): python+metal data-only visualizer

2026-05-13 09:34:01 +02:00

_av_capture.py

fix(camera): strict built-in filter both sides

2026-05-13 12:01:14 +02:00

_camera_select.py

fix(multihmr): cv2 brightness probe + heartbeat

2026-05-13 11:46:01 +02:00

_smplerx_shims.py

chore(data-only-viz): SMPLer-X T1 abandon

2026-05-13 19:27:55 +02:00

.gitignore

chore(viz): gitignore __pycache__ in data-only-viz

2026-05-13 09:34:13 +02:00

action_head_pub.py

fix(pose): plumb swap into hand features slots

2026-07-02 11:09:06 +02:00

action_head.py

feat(data-only-viz): action-head v3 hands+lips

2026-05-13 23:26:14 +02:00

apple_vision_pose.py

perf(multi-hmr): autocast opt-in

2026-05-13 23:24:06 +02:00

arkit_joint_map.py

feat(pose): arkit body, skip mediapipe pose+face

2026-06-30 19:29:20 +02:00

arkit_skeleton.py

test(viz): pin arkit max-len behavior change

2026-07-02 10:37:02 +02:00

arkit_topology.py

fix(iphone): topology decode return type + test

2026-06-30 22:02:35 +02:00

CLAUDE.md

docs(data-only-viz): arkit body source mode

2026-06-30 20:14:17 +02:00

coreml_pose.py

feat(viz): python+metal data-only visualizer

2026-05-13 09:34:01 +02:00

detrpose.py

fix(viz): load DETRPose config from src.core

2026-06-26 16:44:35 +02:00

dino_reid.py

feat(av-live): openpos 3D + DINO reid + filter

2026-05-14 00:30:42 +02:00

euro_filter.py

feat(viz): python+metal data-only visualizer

2026-05-13 09:34:01 +02:00

fine_analysis.py

feat(viz): python+metal data-only visualizer

2026-05-13 09:34:01 +02:00

finger_strike.py

refactor(pose): detectors consume routed slots

2026-07-02 10:55:32 +02:00

hand_display.py

fix(pose): swap chirality only, default on

2026-07-02 11:00:25 +02:00

hand_features.py

fix(pose): plumb swap into hand features slots

2026-07-02 11:09:06 +02:00

hand_slots.py

fix(pose): swap chirality only, default on

2026-07-02 11:00:25 +02:00

holistic.py

feat(viz): python+metal data-only visualizer

2026-05-13 09:34:01 +02:00

icp_fusion_worker.py

feat(icp): wire fusion thread behind ICP_FUSION

2026-05-14 12:13:37 +02:00

icp_fusion.py

feat(icp): FusionWorker + State.lidar_points

2026-05-14 12:10:09 +02:00

iphone_osc_listener.py

feat(viz): iphone OSC listener :57128

2026-05-14 12:03:55 +02:00

iphone_usb_source.py

fix(pose): fresh arkit joint arrays per frame

2026-07-02 10:41:41 +02:00

lidar_calib.py

feat(icp): Kabsch + calibration CLI scaffold

2026-05-14 12:01:45 +02:00

lidar_receiver.py

feat(icp): LiDAR TCP socket reader with reconnect

2026-05-14 11:57:13 +02:00

main.py

fix(viz): install key monitors at app launch

2026-07-02 10:15:19 +02:00

mesh_rigger.py

feat(av-live): openpos 3D + DINO reid + filter

2026-05-14 00:30:42 +02:00

mesh_topology.py

feat(viz): python+metal data-only visualizer

2026-05-13 09:34:01 +02:00

multi_hmr_scaffold.md

docs(multihmr): final README + scaffold status

2026-05-13 11:25:27 +02:00

multi_hmr_worker.py

Merge branch 'feat/action-head'

2026-06-23 23:01:07 +02:00

multi.py

feat(pose): arkit body, skip mediapipe pose+face

2026-06-30 19:29:20 +02:00

multihmr_coreml.py

fix(data-only): CoreML Multi-HMR usage bugs

2026-05-18 17:46:33 +02:00

MULTIHMR_README.md

perf(data-only-viz): swap Multi-HMR to ViT-S 672

2026-05-13 14:27:16 +02:00

multihmr_remote.py

fix(viz): repair multihmr remote protocol tests

2026-06-26 15:53:44 +02:00

nlf_worker.py

fix(nlf): bail out after persistent inference failures

2026-05-13 11:49:59 +02:00

osc_listener.py

docs(osc): document dual /data/pose listeners

2026-05-13 13:42:58 +02:00

pose_bridge.py

feat(pose): pinch engage/release edges + launcher

2026-06-30 15:46:13 +02:00

pose_filter.py

feat(viz): arkit_fuse stage overrides 14 slots

2026-05-14 12:03:55 +02:00

pose.py

feat(viz): python+metal data-only visualizer

2026-05-13 09:34:01 +02:00

pyproject.toml

fix(viz): harden iphone-usb source

2026-06-27 15:27:06 +02:00

README.md

feat(data-only): ingest /pose/hands into handFeat

2026-06-26 09:59:34 +02:00

renderer.py

fix(pose): swap chirality only, default on

2026-07-02 11:00:25 +02:00

smpler_x_scaffold.md

feat(viz): python+metal data-only visualizer

2026-05-13 09:34:01 +02:00

smplx_decoder.py

fix(smplx): cpu fallback when mps unavailable

2026-05-13 13:02:48 +02:00

smplx_osc_sender.py

feat(av-live): distributed Multi-HMR + fused mesh

2026-05-14 02:02:33 +02:00

state.py

feat(viz): hand persistence gate + conf knobs

2026-07-02 10:27:58 +02:00

tracker.py

perf(data-only-viz): better tracking + dedup

2026-05-13 18:53:29 +02:00

uv.lock

fix(viz): harden iphone-usb source

2026-06-27 15:27:06 +02:00

wham_tram_scaffold.md

feat(viz): python+metal data-only visualizer

2026-05-13 09:34:01 +02:00

README.md

data_only_viz

Python + Metal visualiser for the AV-Live data-only patch.

Hand features OSC

/pose/hands [pid=0, lx, ly, lopen, lspeed, rx, ry, ropen, rspeed, dist]

Emitted once per pipeline tick by pose_bridge.send_hands to sclang :57121.
L = leftmost hand on screen, R = rightmost; absent hand -> its 4 floats are 0.
Ranges: positions/openness/dist in [0,1]; speed >= 0 (normalized units/frame).
Consumed by SuperCollider ~handFeat (data_only) and the Metal renderer uniforms.
Multi-person is not yet carried (pid is always 0).