electron-rare/AV-Live

Fork 0

Files

T

History

L'électron rare c878056733

CI build oscope-of / build-check (push) Has been cancelled

Details

fix(viz): separate hands rotation from skeleton

Live report: skeleton straight but hands off the wrists. The app runs
Vision with a hardcoded .right orientation (ARBodySession.swift:261),
so hand coords live in an uprighted frame while ARKit skeleton2D lives
in the raw sensor frame. Hands get their own IPHONE_HANDS_ROTATE knob
(default none); VIDEO_ROTATE now only rotates the skeleton2D points.

2026-07-02 14:47:05 +02:00

scripts

feat(pose): decode iphone 2D skeleton

2026-06-30 19:19:54 +02:00

shaders

feat(viz): scene reacts to hand features

2026-06-26 10:24:48 +02:00

tests

fix(viz): mirror-conjugate point rotation

2026-07-02 14:41:57 +02:00

training

feat(data-only-viz): action-head v3 hands+lips

2026-05-13 23:26:14 +02:00

web

feat(pose): enrichir card dashboard

2026-05-13 20:29:26 +02:00

__init__.py

feat(viz): python+metal data-only visualizer

2026-05-13 09:34:01 +02:00

_av_capture.py

fix(camera): strict built-in filter both sides

2026-05-13 12:01:14 +02:00

_camera_select.py

fix(multihmr): cv2 brightness probe + heartbeat

2026-05-13 11:46:01 +02:00

_smplerx_shims.py

chore(data-only-viz): SMPLer-X T1 abandon

2026-05-13 19:27:55 +02:00

.gitignore

chore(viz): gitignore __pycache__ in data-only-viz

2026-05-13 09:34:13 +02:00

action_head_pub.py

feat(pose): validate hands before analysis

2026-07-02 14:35:03 +02:00

action_head.py

feat(data-only-viz): action-head v3 hands+lips

2026-05-13 23:26:14 +02:00

apple_vision_pose.py

perf(multi-hmr): autocast opt-in

2026-05-13 23:24:06 +02:00

arkit_joint_map.py

feat(pose): arkit body, skip mediapipe pose+face

2026-06-30 19:29:20 +02:00

arkit_skeleton.py

feat(viz): rotate iphone 2d points, hide fingers

2026-07-02 14:36:57 +02:00

arkit_topology.py

fix(iphone): topology decode return type + test

2026-06-30 22:02:35 +02:00

CLAUDE.md

docs(data-only-viz): arkit body source mode

2026-06-30 20:14:17 +02:00

config.py

docs(viz): fix config docstrings + env tables

2026-07-02 14:24:01 +02:00

coreml_pose.py

feat(viz): python+metal data-only visualizer

2026-05-13 09:34:01 +02:00

detrpose.py

fix(viz): load DETRPose config from src.core

2026-06-26 16:44:35 +02:00

dino_reid.py

feat(av-live): openpos 3D + DINO reid + filter

2026-05-14 00:30:42 +02:00

euro_filter.py

feat(viz): python+metal data-only visualizer

2026-05-13 09:34:01 +02:00

fine_analysis.py

feat(viz): python+metal data-only visualizer

2026-05-13 09:34:01 +02:00

finger_strike.py

fix(pose): mirror-coherent gesture fallback

2026-07-02 14:13:36 +02:00

hand_display.py

test(viz): pin stabilizer defaults, fix seams

2026-07-02 12:00:28 +02:00

hand_features.py

feat(pose): fist kill-switch, default off

2026-07-02 14:22:31 +02:00

hand_slots.py

fix(viz): wire arkit-full + osc port via config

2026-07-02 14:23:47 +02:00

holistic.py

feat(viz): python+metal data-only visualizer

2026-05-13 09:34:01 +02:00

icp_fusion_worker.py

feat(icp): wire fusion thread behind ICP_FUSION

2026-05-14 12:13:37 +02:00

icp_fusion.py

feat(icp): FusionWorker + State.lidar_points

2026-05-14 12:10:09 +02:00

iphone_osc_listener.py

feat(viz): iphone OSC listener :57128

2026-05-14 12:03:55 +02:00

iphone_usb_source.py

fix(viz): separate hands rotation from skeleton

2026-07-02 14:47:05 +02:00

lidar_calib.py

refactor(viz): remaining consumers read VizConfig

2026-07-02 11:26:57 +02:00

lidar_receiver.py

feat(icp): LiDAR TCP socket reader with reconnect

2026-05-14 11:57:13 +02:00

main.py

fix(viz): wire arkit-full + osc port via config

2026-07-02 14:23:47 +02:00

mesh_rigger.py

feat(av-live): openpos 3D + DINO reid + filter

2026-05-14 00:30:42 +02:00

mesh_topology.py

feat(viz): python+metal data-only visualizer

2026-05-13 09:34:01 +02:00

multi_hmr_scaffold.md

docs(multihmr): final README + scaffold status

2026-05-13 11:25:27 +02:00

multi_hmr_worker.py

fix(viz): remote log vars + avbody host param

2026-07-02 11:40:55 +02:00

multi.py

refactor(viz): consumers read VizConfig

2026-07-02 11:24:19 +02:00

multihmr_coreml.py

refactor(viz): remaining consumers read VizConfig

2026-07-02 11:26:57 +02:00

MULTIHMR_README.md

perf(data-only-viz): swap Multi-HMR to ViT-S 672

2026-05-13 14:27:16 +02:00

multihmr_remote.py

refactor(viz): remaining consumers read VizConfig

2026-07-02 11:26:57 +02:00

nlf_worker.py

fix(nlf): bail out after persistent inference failures

2026-05-13 11:49:59 +02:00

osc_listener.py

docs(osc): document dual /data/pose listeners

2026-05-13 13:42:58 +02:00

pose_bridge.py

refactor(viz): remaining consumers read VizConfig

2026-07-02 11:26:57 +02:00

pose_filter.py

refactor(viz): remaining consumers read VizConfig

2026-07-02 11:26:57 +02:00

pose.py

feat(viz): python+metal data-only visualizer

2026-05-13 09:34:01 +02:00

pyproject.toml

fix(viz): harden iphone-usb source

2026-06-27 15:27:06 +02:00

README.md

feat(data-only): ingest /pose/hands into handFeat

2026-06-26 09:59:34 +02:00

renderer.py

feat(viz): rotate iphone 2d points, hide fingers

2026-07-02 14:36:57 +02:00

smpler_x_scaffold.md

feat(viz): python+metal data-only visualizer

2026-05-13 09:34:01 +02:00

smplx_decoder.py

fix(smplx): cpu fallback when mps unavailable

2026-05-13 13:02:48 +02:00

smplx_osc_sender.py

fix(viz): remote log vars + avbody host param

2026-07-02 11:40:55 +02:00

state.py

feat(viz): hand persistence gate + conf knobs

2026-07-02 10:27:58 +02:00

tracker.py

perf(data-only-viz): better tracking + dedup

2026-05-13 18:53:29 +02:00

uv.lock

fix(viz): harden iphone-usb source

2026-06-27 15:27:06 +02:00

wham_tram_scaffold.md

feat(viz): python+metal data-only visualizer

2026-05-13 09:34:01 +02:00

README.md

data_only_viz

Python + Metal visualiser for the AV-Live data-only patch.

Hand features OSC

/pose/hands [pid=0, lx, ly, lopen, lspeed, rx, ry, ropen, rspeed, dist]

Emitted once per pipeline tick by pose_bridge.send_hands to sclang :57121.
L = leftmost hand on screen, R = rightmost; absent hand -> its 4 floats are 0.
Ranges: positions/openness/dist in [0,1]; speed >= 0 (normalized units/frame).
Consumed by SuperCollider ~handFeat (data_only) and the Metal renderer uniforms.
Multi-person is not yet carried (pid is always 0).