ZhiyingDu/HiMoE-VLA-Libero-Goal

HiMoE-VLA: Hierarchical Mixture-of-Experts for Generalist Vision-Language-Action Policies

This repository contains the model checkpoint for HiMoE-VLA: Hierarchical Mixture-of-Experts for Generalist Vision-Language-Action Policies (arXiv).

• Paper: HiMoE-VLA: Hierarchical Mixture-of-Experts for Generalist Vision-Language-Action Policies
• Repository: GitHub

Model Description

HiMoE-VLA is a vision–language–action (VLA) framework designed to handle modern heterogeneous robotics datasets. It introduces a Hierarchical Mixture-of-Experts (HiMoE) action module that progressively abstracts away embodiment, action space, sensor, and control frequency differences across layers, enabling unified learning of shared robot behaviors.

Usage

For real-world deployment, you can run inference using the following template from the official repository:

from moevla.policies import policy_config as _policy_config
from moevla.training import config as _config

# Specify these parameters
train_config = ""
dataset_config = ""
checkpoint_dir = ""

policy = _policy_config.create_trained_policy(
    _config.get_training_config(train_config),    
    _config.get_dataset_config(dataset_config), 
    checkpoint_dir, 
    default_prompt=None
)

# Run inference on an example
example = {
    "observation/exterior_image_1_left": ...,
    "observation/wrist_image_left": ...,
    "prompt": "fold clothes"
}

action_chunk = policy.infer(example)["actions"]

Citation

@article{du2025himoe,
  title={HiMoE-VLA: Hierarchical Mixture-of-Experts for Generalist Vision-Language-Action Policies},
  author={Du, Zhiying and Liu, Bei and Liang, Yaobo and Shen, Yichao and Cao, Haidong and Zheng, Xiangyu and Feng, Zhiyuan and Wu, Zuxuan and Yang, Jiaolong and Jiang, Yu-Gang},
  journal={arXiv preprint arXiv:2512.05693},
  year={2025}
}