Add SGLang serving instructions

#11
by MickJ - opened

Add SGLang-Diffusion model card examples and tags for Cosmos3 serving.

NVIDIA org
β€’
edited Jun 10

Hey, we would like to merge your PR (SGLang model cards with code snippets + pointer to cookbook), but it needs few adjustments.

Could you please include the changes from PR !13? I.e.

  • SGLang as part of the Runtime Engine(s) section
  • SGLang as part of the Acceleration Engine section
  • Link to cookbook for advanced options

Also, could you rebase with main? (There are bunch of irrelevant changes in this PR)

NVIDIA org

@MickJ , is it necessary to include sound_tokenizer.ckpt and sound_tokenizer.json?

@kediwu0331 I've removed them, cheers

kediwu0331 changed pull request status to merged

Sign up or log in to comment