Repository navigation
Conversation
yufoo1
force-pushed
the
feat/rpent-activevln-navigation
branch
from
November 2, 2026 07:52
1008af4 to
e1b683f
Compare
Signed-off-by: yufoo1 <yufoo1.cs@gmail.com>
Signed-off-by: yufoo1 <yufoo1.cs@gmail.com>
Signed-off-by: yufoo1 <yufoo1.cs@gmail.com>
Signed-off-by: yufoo1 <yufoo1.cs@gmail.com>
Signed-off-by: yufoo1 <yufoo1.cs@gmail.com>
Signed-off-by: yufoo1 <yufoo1.cs@gmail.com>
Signed-off-by: yufoo1 <yufoo1.cs@gmail.com>
Signed-off-by: yufoo1 <yufoo1.cs@gmail.com>
Signed-off-by: yufoo1 <yufoo1.cs@gmail.com>
yufoo1
force-pushed
the
feat/rpent-activevln-navigation
branch
from
November 2, 2026 08:17
e1b683f to
1ffd794
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Add RPent planning above ActiveVLN navigation: event-driven local skills, compact visual feedback, persistent task progress, bounded tool execution, cancellation and a paired Habitat evaluator. Go2 releases its motion lease before planner waits. Local STOP is feedback to the planner, not automatic task success.
Preserve both the explicit Codex planner backend and the experimental shared-model backend. The latter borrows the navigator's resident model, checks model-instance identity, validates tool arguments, and rejects success while saved goals remain. Optional ordered goals and literal task-span tools are included; they do not infer visual completion themselves.
Dependencies and review scope
This PR targets main and includes its Go2 dependency until that PR merges. The original mixed development branch and uncommitted research workspaces are preserved. The vLLM integration is independent and not included.
Verification
git diff --checkand commit policy: passed. RPent implementation and model-service pin are unchanged by the dependency update.No robot motion, planner API calls or fresh GPU experiments were performed while preparing this PR. Shared-model planning quality/latency, optional text CUDA graphs and physical Go2 use remain experimental; this PR does not claim improved task success or a speedup. Existing paired-evaluation results retain their protocol and limitations.
Process boundaries
RPent stays in optional
agents/rpent/navigation, with its dependencies declared there. Habitat metrics remain evaluator-only; inference receives RGB/instructions. Infer owns model execution; Run owns observations, sessions and action execution. No raw videos, checkpoints, credentials or private deployment configuration are included.