FT-LLM-2026-RAMEN/vla_step2_merged
Viewer • Updated • 108 • 24
How to use FT-LLM-2026-RAMEN/v4-8b-nvila-stage3-vla-flow-simplerenv with LeRobot:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
This is a Vision-Language-Action (VLA) policy based on VILA with a Flow Matching action head, trained for robotic manipulation tasks in SimplerEnv.
This policy has been trained and pushed to the Hub using LeRobot. See the full documentation at LeRobot Docs.
For a complete walkthrough, see the training guide. Below is the short version on how to train and run inference/eval:
lerobot-train \
--dataset.repo_id=${HF_USER}/<dataset> \
--policy.type=vila_chunk \
--output_dir=outputs/train/<desired_policy_repo_id> \
--job_name=lerobot_training \
--policy.device=cuda \
--policy.repo_id=${HF_USER}/<desired_policy_repo_id>
--wandb.enable=true
Writes checkpoints to outputs/train/<desired_policy_repo_id>/checkpoints/.
lerobot-record \
--robot.type=so100_follower \
--dataset.repo_id=<hf_user>/eval_<dataset> \
--policy.path=<hf_user>/<desired_policy_repo_id> \
--episodes=10
Prefix the dataset repo with eval_ and supply --policy.path pointing to a local or hub checkpoint.