Spaces:
Running on CPU Upgrade
Running on CPU Upgrade
Add EmbeddingGemma-2 evaluation scores
#192
by hschechter - opened
This PR adds evaluation results for EmbeddingGemma 2 (google/embeddinggemma-2) to the MMEB-v2 leaderboard.
Model Summary
- Model:
EmbeddingGemma 2 - Reference: https://huggingface.co/google/embeddinggemma-2
- Parameters: 0.438B (438M)
- Embedding Dimension: 768
- Tasks Evaluated: 78 / 78
Leaderboard Results (MMEB-v2)
- Overall-V2: 59.01
- Image-Overall (V2): 57.28 (Hit@1)
- Video-Overall: 50.67 (Hit@1)
- Visdoc-Overall: 67.84 (NDCG@5)
memray changed pull request status to merged