Instructions to use prithivMLmods/Qwen3-VisionCaption-2B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use prithivMLmods/Qwen3-VisionCaption-2B with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("image-text-to-text", model="prithivMLmods/Qwen3-VisionCaption-2B") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] pipe(text=messages)# Load model directly from transformers import AutoProcessor, AutoModelForImageTextToText processor = AutoProcessor.from_pretrained("prithivMLmods/Qwen3-VisionCaption-2B") model = AutoModelForImageTextToText.from_pretrained("prithivMLmods/Qwen3-VisionCaption-2B") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] inputs = processor.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps
- vLLM
How to use prithivMLmods/Qwen3-VisionCaption-2B with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "prithivMLmods/Qwen3-VisionCaption-2B" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "prithivMLmods/Qwen3-VisionCaption-2B", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker
docker model run hf.co/prithivMLmods/Qwen3-VisionCaption-2B
- SGLang
How to use prithivMLmods/Qwen3-VisionCaption-2B with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "prithivMLmods/Qwen3-VisionCaption-2B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "prithivMLmods/Qwen3-VisionCaption-2B", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "prithivMLmods/Qwen3-VisionCaption-2B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "prithivMLmods/Qwen3-VisionCaption-2B", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }' - Docker Model Runner
How to use prithivMLmods/Qwen3-VisionCaption-2B with Docker Model Runner:
docker model run hf.co/prithivMLmods/Qwen3-VisionCaption-2B
Qwen3-VisionCaption-2B
Qwen3-VisionCaption-2B is an abliterated v1.0 variant built upon Qwen3-VL-2B-Instruct-abliterated-v1, specifically optimized for seamless, high precision image captioning and uncensored visual analysis. It is engineered for robust caption generation, deep reasoning, and unrestricted descriptive understanding across diverse visual and multimodal contexts.
Key Highlights
- Abliterated and uncensored captioning for descriptive and reasoning rich outputs.
- High fidelity captions for general, artistic, technical, synthetic, abstract, and low context images.
- Consistent performance across wide, tall, square, panoramic, and irregular visual formats.
- Adjustable detail control ranging from brief summaries to fine grained reasoning.
- Built on Qwen3-VL-2B architecture with strong multimodal reasoning and instruction following.
- Multilingual output capability through effective prompt engineering.
Datasets
This model was fine tuned using the following datasets:
- prithivMLmods/blip3o-caption-mini-arrow A high quality curated dataset with multi style captions oriented toward descriptive and reasoning rich visual interpretation.
- prithivMLmods/Caption3o-Opt-v2 Optimized caption dataset targeting precision, context understanding, and descriptive generalization across diverse visual categories.
- Private and unlisted datasets curated for uncensored and domain specific image captioning tasks, focusing on unrestricted visual understanding beyond standard filtered datasets.
The training objective focused on enhancing performance in unconstrained descriptive image captioning, particularly for edge cases and visual categories that are typically filtered out in standard captioning benchmarks.
Quick Start with Transformers
from transformers import Qwen3VLForConditionalGeneration, AutoProcessor
from qwen_vl_utils import process_vision_info
import torch
model = Qwen3VLForConditionalGeneration.from_pretrained(
"prithivMLmods/Qwen3-VisionCaption-2B", torch_dtype="auto", device_map="auto"
)
processor = AutoProcessor.from_pretrained("prithivMLmods/Qwen3-VisionCaption-2B")
messages = [
{
"role": "user",
"content": [
{
"type": "image",
"image": "https://qianwen-res.oss-cn-beijing.aliyuncs.com/Qwen-VL/assets/demo.jpeg",
},
{"type": "text", "text": "Provide a detailed caption and reasoning for this image."},
],
}
]
text = processor.apply_chat_template(
messages, tokenize=False, add_generation_prompt=True
)
image_inputs, video_inputs = process_vision_info(messages)
inputs = processor(
text=[text],
images=image_inputs,
videos=video_inputs,
padding=True,
return_tensors="pt",
)
inputs = inputs.to("cuda")
generated_ids = model.generate(**inputs, max_new_tokens=128)
generated_ids_trimmed = [
out_ids[len(in_ids):] for in_ids, out_ids in zip(inputs.input_ids, generated_ids)
]
output_text = processor.batch_decode(
generated_ids_trimmed, skip_special_tokens=True, clean_up_tokenization_spaces=False
)
print(output_text)
Run with llama.cpp on Jan, Ollama, LM Studio, and other platforms.
Find the Quants (GGUF) here: https://huggingface.co/prithivMLmods/Qwen3-VisionCaption-2B-GGUF
Intended Use
- High precision captioning and reasoning for general purpose or non standard visual data.
- Uncensored analytical captioning for research, red teaming, and moderation evaluation.
- Creative and narrative oriented multimodal tasks.
- Understanding stylized, synthetic, or complex images with challenging aspect ratios.
Limitations
- May produce explicit, sensitive, or offensive descriptions depending on visual content.
- Not recommended for production use where strict safety controls are required.
- Performance may vary for heavily abstract or synthetic content.
- Output tone depends on prompt phrasing and detail level requests.
- Downloads last month
- 11
Model tree for prithivMLmods/Qwen3-VisionCaption-2B
Base model
Qwen/Qwen3-VL-2B-Instruct

