Add relation solver geometry to env runner - #990
Conversation
02fb64f to
820b66d
Compare
820b66d to
939aafb
Compare
939aafb to
a8f02f9
Compare
Greptile SummaryThe PR adds an optional placement-geometry overlay to the interactive environment runner and exposes placement-pool geometry needed to construct it.
Confidence Score: 4/5The live-pose conversion must be fixed before merging because enabling the new overlay can terminate the environment runner on its first scene-backed asset. The overlay calls PyTorch-only tensor methods directly on Isaac Lab's Warp-backed root pose values, while established consumers explicitly convert those buffers with warp.to_torch first. Files Needing Attention: isaaclab_arena/visualization/placement_geometry_draw.py Important Files Changed
Sequence DiagramsequenceDiagram
participant Runner as environment_runner
participant Overlay as PlacementGeometryDraw
participant Scene as Isaac Lab scene
participant Draw as Debug draw / USD
Runner->>Overlay: from_env(env)
Overlay->>Runner: overlay
Runner->>Overlay: redraw(env)
Overlay->>Draw: create fixed background curves once
loop Every simulation step
Runner->>Scene: env.step(zero_actions)
Runner->>Overlay: redraw(env)
Overlay->>Scene: read live root pose
Overlay->>Draw: clear transient lines
Overlay->>Draw: draw AABBs and movable meshes
end
Runner->>Overlay: close()
Overlay->>Draw: clear lines and remove static root
Reviews (1): Last reviewed commit: "Harden placement overlay fallback handli..." | Re-trigger Greptile |
🤖 Isaac Lab-Arena Review BotSummaryThis PR adds an opt-in Findings🟡 🔵 🔵 🔵 Test CoverageGood. New pure-Python geometry tests ( VerdictShip it (minor cleanups optional). |
Visualize relation-solver collision geometry in the environment runner and keep the overlay synchronized with live asset poses. Move debug-draw helpers into the visualization package and cover overlay lifecycle and fallback behavior. Signed-off-by: Qian Lin <qianl@nvidia.com>
Persist static AABBs and collision meshes as USD curves so live redraws only update movable assets. Signed-off-by: Qian Lin <qianl@nvidia.com>
Convert Warp-backed scene pose buffers before reading them and simplify overlay entry metadata and static-asset classification. Signed-off-by: Qian Lin <qianl@nvidia.com>
Keep lossy pose collapsing private and draw a missing scene-backed asset only when it has a concrete configured pose. Signed-off-by: Qian Lin <qianl@nvidia.com>
Signed-off-by: Qian Lin <qianl@nvidia.com>
a8f02f9 to
063ff13
Compare
Summary
Visualize relation-placement geometry optionally in environment_runner.py
Detailed description
--show_placement_overlayflag toenvironment_runner.py.Command to run:
python isaaclab_arena/scripts/environment_runner.py --show_placement_overlay --env_graph_spec_yaml isaaclab_arena_environments/kitchen_bench/droid_pick_and_place_lightwheel_kitchen.yaml