iCreatAI News
Skip to content

Content types

Paper Research Latest updates

AI papers and research findings worth reading: curated interpretations of architectural innovations, training methods, capability measurement, and theoretical progress.

23 条精选Past 30 days: 21 updatesTotal: 202 updates

Updated

精选归档 · 第 2 页

Oct 8Thu 21–23 updates
  1. Google Research71

    Does better work always mean better workers?

    A three-month field experiment with 133 patent lawyers found that access to a Google Labs AI patent-writing assistant raised drafting scores by 0.34 SD at 10 days and 0.38 SD at 90 days, with gains concentrated in fewer poor scores rather than more excellent ones. On a later redlining task where AI was not allowed, the benefit appeared only for senior lawyers (0.45 SD), while juniors showed no discernible improvement and their scores bifurcated toward more very low and more good results. The authors argue that improving output and building durable professional judgment are different goals that may be in tension for junior professionals.

    Why it matters: Offers a rare blinded, months-long field test that separates AI-assisted output gains from unassisted skill development, with direct implications for how firms train junior professionals.

Oct 5Mon
  1. GitHub Blog · AI & ML61

    ReviewBench: An open benchmark for AI code review

    GitHub introduces ReviewBench, an open benchmark for AI code review built from analysis of 103.9 million GitHub pull requests, containing 219 public pull requests across 19 languages with a multi-source golden set labeled for severity and category. It reports grounded and augmented precision, recall, and F1 metrics, uses Claude Sonnet 5 as the LLM grader under a published rubric, and had its ground-truth findings independently re-labeled by senior engineers with 96.6% agreement. GitHub says ReviewBench's offline predictions for a Copilot code review multi-model ensemble matched a later A/B test, which showed an 8.0% rise in addressed rate, 13.6% in recall, 61% in comment volume, and an 8.0% drop in cost per review.

    Why it matters: It offers a concrete, reproducible methodology and public dataset for comparing AI code reviewers, plus evidence on how offline scores tracked a production experiment.

Jul 29Wed
  1. Berkeley AI Research60

    From CUDA to MLX: How K-Search Brings Decades of Kernel Expertise to Apple Silicon

    IBM Research extended K-Search, an evolutionary LLM-driven kernel search framework from UC Berkeley Sky Lab, with a native MLX backend and a structured CUDA-to-MLX translation layer that maps CUDA primitives, constraints and optimization patterns onto Apple Silicon equivalents. On Apple Silicon the approach reached 0.97x the speed of the native MLX Attention kernel and up to a 20x prefill speedup over the community mlx-lm implementation on the Mamba SSM kernel, attributed largely to adding a parallel scan. The authors say the bottleneck was not the LLM's ability to write Metal code but the quality of context and constraints supplied to it.

    Why it matters: Describes a concrete method for transferring CUDA kernel expertise to non-NVIDIA hardware, with reported benchmark numbers and an open-source reproduction path.