diff --git a/docs/models/embeddinggemma/model-card-v2.md b/docs/models/embeddinggemma/model-card-v2.md index c159207..3517711 100644 --- a/docs/models/embeddinggemma/model-card-v2.md +++ b/docs/models/embeddinggemma/model-card-v2.md @@ -62,12 +62,12 @@ EmbeddingGemma 2 was evaluated across text, code, vision, visual document, video |---|---|---|---|---| | *Text* | Massive Text Embedding Benchmark (MTEB, multilingual, v2) | Mean(Task), Multiple | 61.36 | 61.15 | | | Massive Text Embedding Benchmark (MTEB, code, v1) | Mean(Task), NDCG@10 | 78.68 | 68.76 | -| *Image* | Massive Image Embedding Benchmark (MIEB, lite) | Mean(TaskType), Multiple | 64.64 | - | +| *Image* | Massive Image Embedding Benchmark (MIEB, lite) | Mean(TaskType), Multiple | 65.67 | - | | | Massive Multimodal Embedding Benchmark (MMEB v2 - Image) | Mean(Task), Hit@1 | 57.28 | - | | | Massive Multimodal Embedding Benchmark (MMEB v2 - VisDoc) | Mean(Task), NDCG@5 | 67.84 | - | | *Video* | Massive Multimodal Embedding Benchmark (MMEB v2 - Video) | Mean(Task), Hit@1 | 50.67 | - | | *Audio* | Massive Sound Embedding Benchmark (MSEB, Retrieval) | Mean(Task), MRR@10 | 69.54 | - | -| | Massive Audio Embedding Benchmark (MAEB) *Hugging Face* | Mean(Task), Multiple | 49.39 | - | +| | Massive Audio Embedding Benchmark (MAEB) *Hugging Face* | Mean(Task), Multiple | 49.87 | - | ### Evaluation Results with Vector Truncation @@ -76,10 +76,10 @@ With this, model users can reduce storage requirements, with minimal quality imp | Output Dimension | Compression Ratio | MTEB *(multilingual, v2) Mean(Task)* | MTEB *(eng, v2) Mean(Task)* | MTEB *(code, v1) Mean(Task)* | MIEB *(lite) Mean(TaskType)* | MMEB (v2) *Overall* | MSEB *(Retrieval) Mean(Task)* | MAEB *Mean(Task)* | |---|---|---|---|---|---|---|---|---| -| 768d (Full) | 1:1 | 61.36 | 68.46 | 78.68 | 64.64 | 59.01 | 69.54 | 49.39 | -| 512d | 1:1.5 | 61.17 | 68.41 | 77.24 | 64.32 | 58.38 | 69.18 | 49.21 | -| 256d | 1:3 | 60.41 | 67.78 | 76.18 | 63.13 | 56.24 | 66.76 | 48.91 | -| 128d | 1:6 | 57.89 | 65.68 | 71.41 | 59.06 | 45.65 | 56.71 | 46.92 | +| 768d (Full) | 1:1 | 61.36 | 68.46 | 78.68 | 65.67 | 59.01 | 69.54 | 49.87 | +| 512d | 1:1.5 | 61.17 | 68.41 | 77.24 | 65.34 | 58.38 | 69.18 | 49.76 | +| 256d | 1:3 | 60.41 | 67.78 | 76.18 | 64.16 | 56.24 | 66.76 | 49.13 | +| 128d | 1:6 | 57.89 | 65.68 | 71.41 | 59.97 | 45.65 | 56.71 | 47.28 | ## Quick Start