Skip to content
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
22 changes: 22 additions & 0 deletions docs/docs/pypaimon/multimodal-api.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -562,6 +562,28 @@ keep their compressed bytes.
Only v3 is supported. Video features, `uint64`, and language event structures
are rejected.

For map-style training, reuse the source dataset's `meta/` contract while
reading frames lazily from the imported table:

```python
from torch.utils.data import DataLoader
from pypaimon.multimodal import PaimonLeRobotDataset

dataset = PaimonLeRobotDataset(
conn.get_table("robot_data"),
"/data/lerobot_dataset/meta",
blob_parallelism=8,
)
loader = DataLoader(dataset, batch_size=32, shuffle=True, num_workers=4)
```

The metadata argument supplies the standard info, episodes, tasks, and stats
through `dataset.meta`; the imported table does not persist the complete
`meta/` directory. Payload columns remain lazy. Pass
`index_mapping=dataset.index_mapping` to readers of the same table snapshot to
avoid rescanning the control columns. The first version supports image-backed datasets;
video-backed reads remain a follow-up.

## Overwrite

`overwrite` accepts the same input formats as `add` and replaces existing data
Expand Down
2 changes: 2 additions & 0 deletions paimon-python/pypaimon/multimodal/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -29,6 +29,7 @@
Hdf5File,
Hdf5LoadResult,
)
from pypaimon.multimodal.lerobot.dataset import PaimonLeRobotDataset
from pypaimon.multimodal.table import (
MultimodalTable,
TextRoute,
Expand All @@ -55,6 +56,7 @@
"MultimodalTable",
"NoSuchKey",
"ObjectInfo",
"PaimonLeRobotDataset",
"PutObjectResult",
"TextRoute",
"VectorRoute",
Expand Down
4 changes: 3 additions & 1 deletion paimon-python/pypaimon/multimodal/lerobot/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -14,11 +14,13 @@
# See the License for the specific language governing permissions and
# limitations under the License.

"""One-time LeRobot Dataset v3 import into a multimodal Paimon table."""
"""LeRobot Dataset v3 integration for multimodal Paimon tables."""

from pypaimon.multimodal.lerobot.api import load_from_lerobot
from pypaimon.multimodal.lerobot.dataset import PaimonLeRobotDataset


__all__ = [
"PaimonLeRobotDataset",
"load_from_lerobot",
]
Loading
Loading