Skip to content

[python] Read LeRobot video datasets for training - #9757

Open
XiaoHongbo-Hope wants to merge 9 commits into
apache:masterfrom
XiaoHongbo-Hope:codex/lerobot-video-dataset
Open

[python] Read LeRobot video datasets for training#9757
XiaoHongbo-Hope wants to merge 9 commits into
apache:masterfrom
XiaoHongbo-Hope:codex/lerobot-video-dataset

Conversation

@XiaoHongbo-Hope

@XiaoHongbo-Hope XiaoHongbo-Hope commented Sep 12, 2026

Copy link
Copy Markdown
Contributor

Purpose

Read video-backed LeRobot v3 table groups through PaimonLeRobotDataset.

Changes

  • decode .video frame descriptors with TorchCodec or PyAV
  • reuse bounded decoder caches per DataLoader worker
  • seek PyAV from known keyframes for efficient and correct random rereads
  • support existing Episode, delta-window, padding, transform, and return_uint8 behavior

TorchCodec is preferred; PyAV is the fallback.

Tests

82 LeRobot/video tests passed, including real MP4, partial delta windows, B-frame random rereads, optional-dependency gates, and spawn workers.

@XiaoHongbo-Hope
XiaoHongbo-Hope marked this pull request as ready for review September 12, 2026 14:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant