BeyondMimic/ProtoMotions G1 tracker transfers to MuJoCo, but a PhysX-trained AMP "run" actor layered on top does not – has anyone solved hierarchical Isaac→MuJoCo sim-to-sim? #7749
Unanswered
karvachiik-lgtm
asked this question in
Q&A
Replies: 1 comment
|
Artifacts: |
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
TL;DR – I have a Unitree G1 hierarchical controller trained in Isaac Lab (PhysX):
a high-level switcher → 64-D "target-frame" AMP actors (run/jump) → a FROZEN BeyondMimic/ProtoMotions tracker (157-D obs → 29 joint targets, with BeyondMimic PD scaling). Re-implementing this in MuJoCo, the tracker alone matches a reference motion fine, but the combined policy falls in ~1 s. Matched the model, gains, armature, default pose, timing, obs/action conventions exactly and ruled out all the usual suspects. Looking for anyone who has actually transferred an Isaac/PhysX-trained tracker + RL actor stack to MuJoCo (or knows the missing piece).
--- STACK ---
proprio(64) = dof_pos(29) + dof_vel(29) + root_local_ang_vel(3) + proj_gravity(3)
target(64) = rel_anchor_rot6d(6) + dof_vel(29) + proj_gravity(3)
prev(29) = previous processed actions (absolute joint targets)
obs = concatenate(proprio, target, prev) → 157; action → q_target = default_dof_pos + (effort/stiffness)*raw
--- MuJoCo REPRO (what we matched) ---
--- EVIDENCE ---
--- WHAT WE TRIED (no fix) ---
--- CONTEXT / PRIOR ART ---
--- QUESTION ---
--- ARTIFACTS WE CAN SHARE ---
All reactions