[RL] Restore model shard layouts after HF conversion - #4787

[RL] Restore model shard layouts after HF conversion#4787

drisspg wants to merge 1 commit into

drisspg/rl-attention-backend-namepytorch/torchtitan:drisspg/rl-attention-backend-namefrom

drisspg/rl-hf-shard-layout-fixpytorch/torchtitan:drisspg/rl-hf-shard-layout-fixCopy head branch name to clipboard