EmbeddingGemma 2: an open, lightweight multimodal embedding model
Google DeepMind announced EmbeddingGemma 2, a 740-million-parameter model built on the Gemma 4 architecture and released under the Apache 2.0 license, which maps text, code, images, video, and audio into a unified embedding space for on-device use. It offers modular encoders (as little as 270M parameters for text-only, with optional 170M vision and 300M audio encoders), Matryoshka Representation Learning to truncate vectors from 768 down to 128 dimensions, an 8K token context window, and on a Google Pixel 11 Pro requires as little as ~191MB active RAM for text-only weights and ~567MB for the full multimodal model. The company reports a 9.92-point improvement on MTEB Code (68.76 to 78.68) over EmbeddingGemma and says the model is available on Hugging Face and Kaggle, with support across tools including transformers, vLLM, llama.cpp, Ollama, and Qdrant.
Why it matters: It documents a new open, commercially licensed embedding model with concrete size, memory, and benchmark figures relevant to developers building on-device search and RAG.