vllm compatibility

by lxww301 - opened Apr 16

Apr 16

Is there any plan for vllm compatibility?

BidirLM (Decoder To Encoder) org May 6

Hey, nothing on our end for now. It might be best to check with the vllm community to see if they're interested 🤷‍♂️

Nicolas-BZRD changed discussion status to closed May 6

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment