iCreatAI News
Back to main site
Skip to content
Only Products
Oct 21Wed
  1. Latent Space83

    [AINews] DeepSeek DeepInfer: Open Source SOTA Inference running 155T toks/day/cluster making $22m/day at ~80% margin for a 81 day payback

    DeepSeek released DeepInfer, its production inference stack built on vLLM with speculative decoding, SWA Bounded Replay and structured output, reporting 155 trillion tokens/day from one cluster, 96% input-cache hits, 400 ms average time to first token and $38 revenue per accelerator-hour at off-peak prices. The release excludes KV-cache management and load balancing, which remain coupled to internal infrastructure, and vLLM reported decode throughput within 6% of DeepInfer's published results on GB200 under a matched configuration. Community margin estimates of roughly 80% depend on a cache-heavy token mix and omit costs such as SSD cache, networking and idle capacity, so the figures are first-party production claims rather than audited measurements.

    Why it matters: Useful for readers tracking open-source inference economics, since it pairs DeepSeek's production claims with vLLM's comparative benchmark and a careful accounting of what the margin figures do and do not include.

Oct 20Tue
  1. Hugging Face Blog65

    Hugging Face ❤️ TorchTPU: TPUs, Natively

    TorchTPU adds TPU as a native PyTorch backend, letting Transformers, Diffusers and Kernels run on TPU by sending models to "tpu" instead of going through torch_xla or JAX, and Optimum TPU is no longer required. The post shows loading a model with device_map="tpu", running Diffusers pipelines with pipe.to("tpu") plus optional torch.compile, and using Pallas kernels from the Kernels Hub, with reported speedups of 21.5× on Qwen3-30B-A3B and 12.8× on Gemma 4 26B-A4B at batch size 64. It also reports that 96.5% of tests run on TPU pass, with 34 issues filed on the TorchTPU repo and 19 already fixed.

    Why it matters: It documents a new native PyTorch TPU backend and concrete usage patterns for the Hugging Face stack, useful for readers weighing TPU support.

Oct 16Fri
  1. Google DeepMind58

    Accelerating the search for antimicrobial peptides with Google Antigravity

    Google describes how its agentic development platform, Google Antigravity, lets biologists discover, structurally evaluate and prioritize antimicrobial peptide candidates in a single session, using ProtNLM to scan millions of uncharacterized UniProt proteins. A technical walkthrough shows a researcher and agent identifying a novel antimicrobial peptide candidate with predicted activity against respiratory tract infection pathogens, now undergoing wet-lab validation. The post also introduces the Biomolecular Structure Viewer, a 3D visualization tool embedded in Antigravity that shares visual state between researcher and agent.

Oct 15Thu
  1. Google Research75

    Analyzing technical documents with Deep Review

    Google announced the public release of Deep Review, an agentic AI system that provides feedback and technical verification on complex documents, initially for computer science papers and now extended to legal, finance, and other domains. It evolved from the Paper Assistant Tool, which was piloted with STOC 2026, ICML 2026, NeurIPS 2026, and ICLR 2027, offering opt-in pre-submission feedback to authors of more than 16,000 manuscripts. Every user gets two complimentary reviews per week, with higher limits via a Gemini API key, and uploaded documents are not used to train Google models.

    Why it matters: It documents a concrete agentic review pipeline and pilot results, useful for readers weighing AI-assisted verification of technical documents.

Oct 8Thu
  1. GitHub Blog · AI & ML58

    Secret protection must scale with software

    GitHub reports that one in three pull requests now involves an AI agent, up from fewer than one in 10 a year ago, while a new secret appears in public code roughly every two seconds. GitHub introduces a ModernBERT-based classifier built with Microsoft Applied Sciences that extends push protection to unstructured secrets, evaluating candidate batches in under two milliseconds and potentially more than doubling the secrets it can prevent. The feature enters private preview and will be available to organizations with GitHub Secret Protection on Enterprise Cloud and GitHub Teams, and will ship with GitHub Enterprise Server 3.23 in public preview.

  2. Microsoft Research71

    Agent Lightning v1.0: A 3,500-Line Lightweight Agentic RL Framework for Training Agents with Real Harnesses

    Microsoft Research Asia introduces Harnessed Agentic RL, a paradigm in which the same agent harness used in deployment participates directly in reinforcement learning, and open-sources Agent Lightning v1.0, a roughly 3,500-line framework with an API Gateway, Rollout Controller, and Customized Trainer built on verl. Agents run as standard Kubernetes jobs without commercial sandbox services, and Collocated Async RL shares GPUs between rollout and updates, achieving about a 2x end-to-end speedup over synchronous RL. An end-to-end coding agent pipeline raised Qwen3.5-9B from 41.8% to 56.4% Pass@1 on SWE-bench Verified using about 6,000 training samples.

    Why it matters: It offers a concrete, reproducible recipe for training deployed agents in place, with code size, infrastructure, and benchmark numbers stated explicitly.