Skip to content

feat(rollout): collect complete greedy episodes for ReMax baselines - #109

Open
pty12345 wants to merge 2 commits into
mainfrom
pr/remax-greedy-rollout
Open

pty12345 wants to merge 2 commits into
mainfrom
pr/remax-greedy-rollout

Conversation

@pty12345

Copy link
Copy Markdown
Collaborator

Summary

  • Collect a complete greedy agent episode from an independent environment reset alongside sampled episodes.
  • Pair sampled steps with the greedy episode's undiscounted reward by source UID.
  • Preserve episode termination and truncation metadata, with tests covering rollout collection, environment adapters, reward pairing, and tensor layout.

Scope

This PR provides the rollout-collection foundation for ReMax. It does not yet implement algorithm.adv_estimator=remax, advantage computation, or the ReMax actor update.

Validation

  • 28 tests passed in the full CPU environment.
  • The local test suite passed, with dependency-gated tests skipped where the full training stack is unavailable.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant