strands_sglang

slime x Strands-SGLang

This example connects slime with strands-sglang (SGLang extension for the agentic scaffolding strands) for agentic RL training.

Why strands-sglang?

Component	Agent Loop	TITO Support
Strands-Agents	✅ Handles agent loop, custom hooks	❌ text-based, requires retokenization
SGLang	❌ Single generation only	✅ Native input_ids in/out
strands-sglang	✅ Via Strands	✅ Via SGLang's native API

strands-sglang bridges the gap by extending strands with SGLang's native /generate endpoint:

• Captures exact token IDs during generation (no retokenization drift)
• Automatically tracks loss_mask via the Rollout tracker (model.rollout)
• Provides ToolLimiter for clean trajectory truncation

Install Dependencies

1. Pull the slimerl/slime:latest image and enter it
2. Go to slime folder: cd /root/slime
3. Install slime: pip install -e . --no-deps
4. Go to the example folder: cd /root/slime/examples/strands_sglang
5. Install strands-sglang: pip install strands-sglang==0.4.2

NOTE: The execute_python_code tool runs code via subprocess_interpreter.py, a self-contained interpreter vendored from camel-ai so this example does not depend on the full camel-ai package. It runs model-generated code in a local subprocess with no isolation, which is NOT a good practice; it is here only for the convenience of this example. Use a sandboxed interpreter (Docker, e2b, microsandbox, ...) for anything beyond local experimentation.

Prepare Model

# hf checkpoint
hf download Qwen/Qwen3-8B --local-dir /root/models/Qwen/Qwen3-8B

# mcore checkpoint
cd /root/slime
source scripts/models/qwen3-8B.sh
PYTHONPATH=/root/Megatron-LM python tools/convert_hf_to_torch_dist.py \
    ${MODEL_ARGS[@]} \
    --hf-checkpoint /root/models/Qwen/Qwen3-8B \
    --save /root/models/Qwen/Qwen3-8B_torch_dist

Prepare Dataset

Following Retool, we use dapo-math-17k as training data:

from datasets import load_dataset
ds = load_dataset("zhuzilin/dapo-math-17k", split="train")
ds.to_json("/root/data/dapo-math-17k.jsonl", orient="records", lines=True)

and aime-2024 as eval data:

from datasets import load_dataset
ds = load_dataset("zhuzilin/aime-2024", split="train")
ds.to_json("/root/data/aime-2024.jsonl", orient="records", lines=True)

Run Training

cd /root/slime
export WANDB_KEY=$your_wandb_key
bash examples/strands_sglang/strands_qwen3_8b.sh