Image-Text-to-Text
Transformers.js
ONNX
florence2
vision
text-generation
text2text-generation
image-to-text
Instructions to use onnx-community/Florence-2-base-ft with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers.js
How to use onnx-community/Florence-2-base-ft with Transformers.js:
// npm i @huggingface/transformers import { pipeline } from '@huggingface/transformers'; // Allocate pipeline const pipe = await pipeline('image-text-to-text', 'onnx-community/Florence-2-base-ft');
Onnx Conversion
#4
by Dragonriders - opened
Can you please share the script you used to convert the model to ONNX, i am trying but facing issues while doing when using optimum or from transformers.
Thank you in advance.
I've got it working with an experimental dev branch of Optimum, as it is certainly non-trivial. I'll try collect it all and submit a PR when I've got it working 100% right.
Here we go :) https://gist.github.com/xenova/d48921875c8178de1dd72443cfb6f7c8
Sorry for the delay! Got busy...