I want to deploy Qwen2-VL-2B-Instruct to a SageMaker endpoint. I know that the model needs additional requirements such as qwen-vl-utils but also needs the latest version of transformers (4.45.2) to work properly. As this version of transformers is not available in DLC, I added a requirements.txt an…

Unable to deploy Qwen2-VL model on SageMaker

John6666 October 23, 2024, 4:06pm 2

Could it be a bug in SageMaker?

Topic		Replies	Views
Deployment issue on Sagemaker Amazon SageMaker	16	3400	October 4, 2023
Error hosting endpoint when deploying model Amazon SageMaker	2	3108	March 27, 2024
Deploying TheBloke/Luna-AI-Llama2-Uncensored-GGML Amazon SageMaker	0	863	September 11, 2023
Vicuan error on Sagemaker Amazon SageMaker	3	844	October 23, 2024
Mistral AI Sagemaker deployment failing Amazon SageMaker	3	2091	December 29, 2023