iCreatAI News
Back to main site
Skip to content

Technology areas

AI Coding Latest updates

Everything about AI writing code: coding assistants, Vibe Coding, code model evaluation, and changes to development workflows.

22 条精选Past 30 days: 19 updatesTotal: 178 updates

Updated

精选归档 · 第 2 页

Oct 5Mon 21–22 updates
  1. GitHub Blog · AI & ML61

    ReviewBench: An open benchmark for AI code review

    GitHub introduces ReviewBench, an open benchmark for AI code review built from analysis of 103.9 million GitHub pull requests, containing 219 public pull requests across 19 languages with a multi-source golden set labeled for severity and category. It reports grounded and augmented precision, recall, and F1 metrics, uses Claude Sonnet 5 as the LLM grader under a published rubric, and had its ground-truth findings independently re-labeled by senior engineers with 96.6% agreement. GitHub says ReviewBench's offline predictions for a Copilot code review multi-model ensemble matched a later A/B test, which showed an 8.0% rise in addressed rate, 13.6% in recall, 61% in comment volume, and an 8.0% drop in cost per review.

    Why it matters: It offers a concrete, reproducible methodology and public dataset for comparing AI code reviewers, plus evidence on how offline scores tracked a production experiment.

Oct 1Thu
  1. Google DeepMind88

    Gemini 4 Argon: our next era of frontier intelligence

    Google announced Gemini 4 Argon, a frontier model rolling out first to trusted cyber defenders through its Fairwind Program, with an introductory price of $2 per million input tokens and $10 per million output tokens. Google reports state-of-the-art results on DeepSWE v1.1 (77.9%), the Vals Index, LVBench (91.7%), AutomationBench (51.3%), and a tie for first on CWE-bench v1 (68%), alongside internal uses such as C/C++ to Rust migrations and memory optimization. The model raises the output token limit to 1M and is being released in phases with safeguards against misuse, prompt injection, and misalignment before broader availability to paid API customers and Google AI Ultra subscribers.

    Why it matters: The piece is a detailed primary source on a frontier model's claimed benchmarks, pricing, staged release, and safety approach, useful for tracking how leading labs frame capability and rollout.