iCreatAI News
Back to main site
Skip to content

Technology areas

Multimodal Latest updates

Capabilities beyond text: model and product progress in visual understanding, mixed text-image, and audio-video input and output.

24 条精选Past 30 days: 21 updatesTotal: 137 updates

Updated

精选归档 · 第 2 页

Oct 22Thu 21–24 updates
  1. Google Research65

    Empowering frontline maternal care with AI-assisted ultrasound

    Google researchers evaluated an AI model that estimates gestational age from standardized "blind sweep" ultrasounds performed by novice operators, reporting a mean absolute error of 4.18 days versus 4.48 days for expert sonographers across cohorts in Chicago and Nairobi. The model, minimally tuned on 120 Chicago participants and tested with no Nairobi data, achieved MAEs of 4.10 and 4.27 days respectively, as published in JAMA Network Open.

    Why it matters: It offers a concrete, peer-reviewed data point on whether AI-assisted ultrasound can generalize across hardware and clinical settings without expert sonographers.

Oct 14Wed
  1. Google DeepMind92

    Gemini 4 Argon: Built to solve your hardest problems

    Google announced Gemini 4 Argon, a frontier model now available globally via the Gemini API in AI Studio and the Gemini platform, Google Antigravity, the Gemini app, and AI Mode in Search, priced at $2 per million input tokens and $10 per million output tokens. Google reports Argon ranked #1 on the Vals Index and cites internal and partner uses including a Chrome architectural refactor, a 2.85x inference speedup on Gemma 4 E2B, quantum computing and fusion research, rare disease analysis, enzyme design, and a robotics video-to-sim-to-real pipeline. Google also described safety work including jailbreak defenses, agent misalignment monitoring, and a 0.7% attack success rate on the Gray Swan indirect prompt injection benchmark.

    Why it matters: The post is a detailed launch announcement whose benchmark claims, pricing, and safety figures give readers a concrete picture of a major frontier model release.

Oct 7Wed
  1. Google DeepMind72

    EmbeddingGemma 2: an open, lightweight multimodal embedding model

    Google DeepMind announced EmbeddingGemma 2, a 740-million-parameter model built on the Gemma 4 architecture and released under the Apache 2.0 license, which maps text, code, images, video, and audio into a unified embedding space for on-device use. It offers modular encoders (as little as 270M parameters for text-only, with optional 170M vision and 300M audio encoders), Matryoshka Representation Learning to truncate vectors from 768 down to 128 dimensions, an 8K token context window, and on a Google Pixel 11 Pro requires as little as ~191MB active RAM for text-only weights and ~567MB for the full multimodal model. The company reports a 9.92-point improvement on MTEB Code (68.76 to 78.68) over EmbeddingGemma and says the model is available on Hugging Face and Kaggle, with support across tools including transformers, vLLM, llama.cpp, Ollama, and Qdrant.

    Why it matters: It documents a new open, commercially licensed embedding model with concrete size, memory, and benchmark figures relevant to developers building on-device search and RAG.

Oct 6Tue
  1. Mistral AI83

    Introducing Mistral Large 4

    Mistral launched a public preview of Mistral Large 4, a 1-trillion-parameter natively multimodal model with 52 billion active parameters, trained from scratch on 3,800 NVIDIA Grace Blackwell GPUs in Mistral's own European datacenters, with weights to be released by the end of the month. Mistral reports competitive performance across coding, agentic workflows, multimodal understanding, cybersecurity, science and knowledge work, claiming it outperforms any open-weight model developed in the US or Europe. The preview API is available on Mistral Studio, and the model will serve as the foundation for a new generation of specialized Mistral models.

    Why it matters: Useful for readers tracking open-weight frontier models, European AI sovereignty, and Mistral's claimed benchmarks and release timeline.