iCreatAI News
Back to main site
Skip to content
Only First party#Data / training
Oct 28Wed
  1. Databricks Blog22

    BigQuery to Databricks: A Strategic Framework

    This Databricks guide outlines a BigQuery-to-Databricks migration framework across three pillars—Process, Technology, and People—covering estate assessment with the open-source Lakebridge profiler, BI-first or ETL-first entry points, wave-based migration, and dual operation via Lakehouse Federation. It describes moving data into open formats on Google Cloud Storage, migrating SQL logic through rule-based transpilation, LLM-assisted conversion, and engineers, plus three-level validation, and maps BigQuery governance into Unity Catalog. The People pillar covers shared Notebooks, Genie for natural-language code generation, and Databricks Academy training, closing with field lessons such as profiling before planning and defining parity criteria before dual-run starts.

Oct 27Tue
  1. NVIDIA Blog38

    How AI Is Changing the Pace of Discovery for Millions Living With Dementia

    C-BRAIN, a consortium of 18 institutions led by Dr. Randall Bateman and working with NVIDIA, launched in November 2025 to use AI to speed Alzheimer's research by drawing on previously inaccessible "dark data" through a hybrid centralized and federated approach. Its two tools, OpenScientist and InsightEngine, have completed analyses in minutes that scientists estimated would take weeks to months, at under $10 per run. The consortium aims to build a multimodal biological foundation model and, by year three, discover new causal mechanisms of brain aging and Alzheimer's disease.

  2. Sarvam AI Blog48

    Sarvam and HQ IDS establish joint framework for AI adoption across the Army, Navy and Air Force

    Sarvam has signed a Memorandum of Understanding with Headquarters Integrated Defence Staff (HQ IDS), Ministry of Defence, creating an umbrella framework for AI projects across the Indian Army, Navy and Air Force and joint, tri-service and integrated organisations under HQ IDS. Under the MoU, Sarvam will design, develop and deploy AI applications for operational, training and decision-support needs of the three Services, with shared foundation models, agentic infrastructure and geospatial and perception systems, and human oversight retained on operational decisions. The work will be carried out by Sarvam's firewalled division Chanakya, applying its AI stack including foundation models such as Sarvam 105B, built in India and deployed on sovereign infrastructure.

  3. Databricks Blog31

    Unify your productivity and AI data with Lakeflow Connect

    Lakeflow Connect offers fully managed native connectors that ingest data from productivity tools such as Jira, Confluence, Notion, SharePoint, Google Drive, Outlook, Gmail, GitHub, OpenAI and Anthropic into governed Delta tables in Unity Catalog. Unstructured content like files, pages and email bodies lands as tables that can be cleaned up or parsed with ai_parse_document for retrieval and AI agents. Customers including Toyota Finance Australia, VaxCare, M3 Accounting, DigiCert, Orizon and TRegs describe using the connectors for Jira, Confluence, GitHub, SharePoint and Monday.com data.

  4. Databricks Blog20

    How to teach with Databricks Free Edition

    Databricks Free Edition is a perpetually free, browser-based version of the Databricks Data + AI Platform that students and educators can sign up for individually without a cloud contract, credit card, or installation, running on smaller compute under fair-use limits and not for production or commercial use. The article maps common courses—from intro programming and statistics to data engineering, data warehousing, ML, AI agents, and capstones—to platform tools such as notebooks, Apache Spark, Lakeflow, Delta Lake, Databricks SQL, MLflow, Genie Agents, and Databricks Apps, and answers instructor FAQs on distributing assignments and datasets, group work, and compute limits.

  5. AWS Machine Learning Blog34

    Fleet-wide computer vision lifecycle at the edge with SageMaker SDK v3

    This post updates a 2023 MLOps pipeline pattern for visual quality inspection to Amazon SageMaker Python SDK v3, replacing the deprecated SageMaker Edge Manager with SageMaker Neo for edge optimization. It describes a dual-branch SageMaker Pipeline that trains an anomaly detector and a defect classifier per camera, gates models on their exported ONNX artifacts, compiles them with Neo, and registers them with camera metadata, while a Step Functions and DynamoDB semaphore layer paces fleet training. The sample deploys via AWS CDK and a full synthetic-data run costs about $0.07 in compute.

  6. Databricks Blog40

    Building live intelligence: Databricks AI Search supports Streaming Tables, Materialized Views, and Managed tables using Iceberg

    Databricks AI Search now natively supports Streaming Tables, Materialized Views, and Managed tables using Iceberg v3+ in addition to Delta tables, letting users index live events, continuously maintained personalized state, and open-format data directly without separate conversion and synchronization pipelines. Streaming Tables keep indexes fresh as new records arrive, Materialized Views propagate incrementally maintained aggregated or joined state for personalized search, and Managed Iceberg tables serve as sources without conversion or migration. Index creation follows the same Delta Sync index workflow via UI or API, eliminating the intermediate Delta table and custom sync pipeline.

Oct 24Sat
  1. AWS Machine Learning Blog58

    Multi-Turn Reinforcement Learning on Amazon SageMaker AI: A hands-on guide

    This AWS post walks through an end-to-end Multi-Turn Reinforcement Learning pipeline on Amazon SageMaker AI, using a Wordle agent hosted on Amazon Bedrock AgentCore that reports one outcome reward per episode for GRPO training of a LoRA adapter. In the example run, gpt-oss-20b improved from 61% to 84% solve rate on held-out words at default reasoning effort and from 15% to 69% at low effort, for about $339 in training tokens. It also covers IAM roles, dataset preparation, MLflow monitoring, serving-setting evaluation, cleanup, and reward-design mistakes and training failures encountered.

  2. Hugging Face Blog31

    LitPivot: Developing research ideas through dynamic contextualization within the literature landscape

    LitPivot is a system developed with University of Pennsylvania collaborators that organizes retrieved literature around the facet of a research proposal being edited, offers critiques supported by excerpts from selected studies, and suggests revisions researchers can accept, edit, or reject. In a study with 17 researchers, domain experts rated ideas developed with LitPivot as better grounded in the literature than those developed with a text editor and an AI chat tool, and participants perceived their revised ideas as more novel and useful. LitPivot will be presented at UIST 2026 in Detroit.

  3. AWS Machine Learning Blog20

    Visualize points and routes with GeoJSON in Amazon Quick Sight layer maps

    Amazon Quick Sight layer maps now support Point and LineString geometry types from GeoJSON files, letting users plot individual locations and routes joined to a Quick Sight dataset by a shared key. The post explains the required GeoJSON structure and dataset join, compares layer map points with the native point map, and covers advanced techniques for controlling the viewport, layering geometries, and updating GeoJSON files via Amazon S3 and the Quick Sight APIs.

Oct 23Fri
  1. AWS Machine Learning Blog18

    How U.S. Hunger connects leaders and data using Amazon Quick

    U.S. Hunger, which reports delivering more than 250 million meals, uses Amazon Quick to let CEO Rick Whitted explore Full Cart datasets directly and to give 17 colleagues across leadership, technology, finance, and compliance shared Spaces for KPI definitions, financial planning, and research. Data from its Impact Manager platform is refreshed from SQL Server into SPICE nightly at 2 AM ET, and the organization plans a Q4 2026 enterprise KPI framework routing NetSuite, Salesforce, and other systems through Boomi into Amazon Redshift.

  2. AWS Machine Learning Blog34

    Train Qwen3 on AWS Trainium with torchtitan

    This post walks through training Qwen3 three ways on a single trn2.48xlarge using torchtitan-neuron: via Hugging Face Transformers v5 as a modeling backend, via torchtitan's native Qwen3 by changing config.model_spec, and via NKI mixture-of-experts kernels from the torchtitan-neuron recipes, all using the same torchrun launch pattern. It also shows how to load and save published safetensors checkpoints, attach a custom NKI rope_hf kernel through torchtitan's override registry, and scale with data and tensor parallelism across 64 logical NeuronCores.

  3. Hugging Face Blog62

    Turning Database Grading into RL Rewards: Post-Training Agents with ThinkingBox

    Microsoft and Hugging Face describe using ThinkingBox's executable terminal-database-state checks as binary rewards to fine-tune Qwen3.8-27B with GRPO for 50 steps on an offline-selected pool of 187 tasks, raising pass@1 from 51.70% to 60.78% and tasks passing all 20 attempts from 38 to 107 on the 507-task ThinkingBox-Bench, while pass@20 dipped slightly from 453 to 446. The post details offline policy-relative difficulty selection via Jeffreys posteriors, the reward loop, cost-per-dependable-task falling from $24.36 to $8.00, and releases the training stack in microsoft/thinkingbox-training.

    Why it matters: It offers a concrete, reproducible recipe for converting stateful agent grading into RL rewards, plus an honest account of the repeatability-versus-coverage tradeoff.

  4. AWS Machine Learning Blog58

    Announcing new ways to customize models with SageMaker AI, without managing GPUs

    AWS announced the general availability of training sessions in Amazon SageMaker AI serverless model customization, letting customers write and coordinate their own post-training loop, including custom loss functions and reward signals, while SageMaker AI handles GPU allocation, distributed execution, fault recovery, and checkpoint storage. The sessions support techniques such as SFT, DPO, RLVR, RLAIF, and multi-turn RL, with LoRA or full fine-tuning, and are available with support for gpt-oss-20b, gemma-4-31B-it, Qwen3.6-27B, and Qwen3.8-27B. Customers can start via the SageMaker Python SDK and cookbook or in SageMaker Studio, with data kept in their own S3 buckets and IAM, KMS, and VPC controls.

  5. AWS Machine Learning Blog58

    Write your own training loop — without managing GPUs — with Amazon SageMaker training session APIs

    Amazon SageMaker AI introduces training session APIs that let you write a custom training loop in Python on your local machine while SageMaker runs GPU-bound operations such as forward_backward(), optim_step(), and sample() on managed accelerators with your base model and LoRA adapter. The APIs are organized around ServiceClient, TrainingClient, and SamplingClient in the SageMaker Python SDK, and the post walks through a minimal GRPO loop on GSM8K (held-out accuracy rising from 56% to 75% in 10 steps) plus a Code RL recipe on competitive programming problems (held-out accuracy from 40% to 50.5%). A companion cookbook provides ready-to-run SFT and RL recipes.

  6. AWS Machine Learning Blog32

    Stop guessing auto scaling targets for TTS on Amazon SageMaker AI

    This AWS post deploys Kokoro-82M, an 82-million-parameter non-autoregressive TTS model, as a custom container on an Amazon SageMaker AI real-time endpoint via AWS CDK stacks, then replaces a guessed auto scaling target with values derived from two live measurements: Q_max (the highest per-instance concurrency that still meets a 3,000 ms p95 time-to-first-audio SLO, measured at 50) and T_total (end-to-end scale-out time, measured at 260.2 s and planned against 320.2 s). Scaling uses the native ConcurrentRequestsPerModel metric, and a five-command tool chain (drift, qmax, ttotal, plan, validate) computes the scale-out threshold (37.5), scale-in threshold (25.0) and asymmetric cooldowns by arithmetic. The authors note the methodology generalizes to other latency-sensitive, concurrency-bound real-time SageMaker AI endpoints, while the specific numbers hold only for Kokoro-82M on ml.g5.xlarge.

Oct 22Thu
  1. Google DeepMind58

    Beyond tree cover: mapping the world’s forest types

    Google DeepMind and Google Research, with the World Resources Institute and IIASA, released Forest Typology (ForTy) 2020, a global 10-meter-resolution map classifying land into six FAO-based categories: primary forest, naturally regenerating forest, planted forest, plantation forest, tree crops and agroforestry, and other land. An accompanying early time series tracks annual changes from 2017 to 2025, including where natural forests were replaced by plantations or farms. Validated against more than 9,000 expert-reviewed sites, ForTy identified the correct forest type 90% of the time and distinguished forest from non-forest land 95% of the time, and the map and time series are freely available on Google Earth Engine under an open license.

  2. Hugging Face Blog38

    Ensemble forecasting with IBM Granite time-series models

    IBM introduces Granite Timeseries Ensemble, a recipe that combines four pre-trained Granite models (PatchTST-FM-r1, PatchTST-FM-r2, FlowState-r1.1, and TTM-r3) through one extensible forecasting interface to return median and quantile forecasts without retraining or fitted ensemble weights. The default Probabilistic Ensemble pools member quantiles with equal influence, while an adaptive IQR Ensemble weights members by forecast spread; on 97 GIFT-Eval configurations both ensembles beat all four individual members on aggregate MASE and average MASE Rank, with the Probabilistic Ensemble reaching 0.683 MASE versus 0.685 for the best single member. The authors note the MASE margin is small, that PatchTST-FM-r2 retains the lowest aggregate CRPS/MWQL, and that the recipe forecasts channels independently and loads four checkpoints, increasing inference time and memory.

  3. NVIDIA Blog40

    Pioneers Across Europe Deploy NVIDIA Earth-2 Open Models to Power Real-World Weather and Climate Prediction

    NVIDIA Earth-2 offers developers and researchers a family of open AI models and tools, running on NVIDIA computing, for global weather prediction, detailed regional forecasts and environmental research. StormScope EU, a regional short-term forecasting model trained on European weather and climate data, uses EUMETSAT satellite observations to predict cloud conditions across 16 Meteosat channels at 10-minute intervals, and is being shown in a live interactive demo at GTC Berlin built with Earthmover. Organizations including AXA, Vaisala Xweather, the University of Manchester, TotalEnergies and Space42 are adapting Earth-2 models such as FourCastNet 3, CorrDiff and PhysicsNeMo for cyclone risk, lightning-enhanced forecasting, U.K. air quality, solar forecasting and radar-based surface-height estimation.

  4. Hugging Face Blog75

    NVIDIA Kumo Relational Outperforms Supervised Machine Learning on Relational Data, No Training Required

    NVIDIA introduces Kumo Relational, a pre-trained relational foundation model that predicts directly on enterprise databases via in-context learning in a single forward pass, requiring no task-specific training, feature engineering, or table flattening. Across 41 tasks on 15 databases, it beats supervised relational deep learning models and expert-engineered gradient-boosted tree pipelines, and on the SAP SALT benchmark it surpasses AutoGluon ensembles by 8% in mean reciprocal rank (MRR). It scales to databases with 500B+ rows and is available through NVIDIA's open-source structured-data-models and kumo-engine libraries or as an NVIDIA NIM.

    Why it matters: Useful for ML teams weighing whether to replace production XGBoost pipelines with a pre-trained relational model, though the reported gains come from NVIDIA's own paper and benchmarks.

  5. Hugging Face Blog58

    How Specializing the Vocabulary of SLMs Can Cut Inference Cost by 77% in Real Applications

    Dharma-AI describes VocabX, a method that rebuilds a small model's tokenizer around the cost of each token rather than its frequency, combining sub-word merges with multi-word "macro" tokens under a shared cost criterion. In a production Portuguese essay grader built on Qwen3-4B, the approach cut average response length from 350 to 101 tokens and measured inference cost by 77.0% with the same base model and training recipe, while the bench score rose from 0.703 to 0.810. The article previews results from a VocabX paper still under review, noting the numbers may change before publication.

Oct 21Wed
  1. Mistral AI58

    Mistral Advances AI for Engineering with NVIDIA

    Mistral and NVIDIA are collaborating to integrate Mistral Large 4 and Mistral's data generation and physics modeling pipelines with NVIDIA CUDA-X libraries, Warp and Omniverse to accelerate engineering simulation and enable closed-loop workflows connecting simulation, AI model development and design. The partnership will develop public benchmarks and open datasets for evaluating physics models and agentic AI in CAE and EDA, assessing agents' tool use, multistep workflows, technical correctness, execution time and computational cost. The work builds on the companies' prior co-development of Mistral NeMo and their collaboration through the NVIDIA Nemotron Coalition.

  2. NVIDIA Blog73

    NVIDIA Open Models Advance Europe’s Sovereign Intelligence Across Industries

    NVIDIA is expanding its family of open models across language, robotics, biology and quantum computing, including the new Nemotron 3.5 Super VL and Nemotron 3.5 Bolt models, Nemotron Retriever models, the Kumo family for structured business data, Cosmos 3.5 world models, Alpamayo 2 Edge for autonomous vehicles, BioNeMo for healthcare and science, and Ising for quantum computing. The company says the open models give organizations a foundation they can customize with local data and deploy on infrastructure they control, with Nemotron built using data and expertise from the NVIDIA Nemotron Coalition including European partners Black Forest Labs, H-Company and Mistral. Availability details include Nemotron 3.5 Super VL on Hugging Face, ModelScope, OpenRouter and build.nvidia.com, with Nemotron 3.5 Bolt E4B 4GB expected Friday, Oct. 23.

    Why it matters: The piece is a broad product roundup that shows how NVIDIA is positioning open models as a sovereignty-friendly foundation for European enterprises and researchers.

Oct 17Sat
  1. Google Research71

    Grounding AI agents in biological reality: Building blocks for autonomous wet labs

    Google researchers describe three projects aimed at connecting AI agents to real wet-lab experimentation: the VERID framework, a semantic digital twin of a lab workcell that tracks 3D state, runs fast virtual dry runs, blocks unsafe commands and logs synchronized video and actions; closed-loop aptamer design over three design-test cycles that raised on-target hit rates to 33.5% for myoglobin and 42.1% for α-thrombin; and agent-guided epitope excision for de novo binder design against FAP, which accelerated each folding cycle more than eightfold and, in a human–agent comparison at equal compute, nearly doubled the in-silico hit rate of a scientist working alone.

    Why it matters: It offers a concrete, example-rich account of how agents are being tied to physical lab hardware and closed experimental loops, including failure modes and safety safeguards.

Oct 16Fri
  1. Google DeepMind58

    Accelerating the search for antimicrobial peptides with Google Antigravity

    Google describes how its agentic development platform, Google Antigravity, lets biologists discover, structurally evaluate and prioritize antimicrobial peptide candidates in a single session, using ProtNLM to scan millions of uncharacterized UniProt proteins. A technical walkthrough shows a researcher and agent identifying a novel antimicrobial peptide candidate with predicted activity against respiratory tract infection pathogens, now undergoing wet-lab validation. The post also introduces the Biomolecular Structure Viewer, a 3D visualization tool embedded in Antigravity that shares visual state between researcher and agent.

Oct 15Thu
  1. Mistral AI67

    Introducing Timestral

    Mistral releases Timestral, its first family of time-series foundation models in four sizes from 5M to 209M parameters, with the largest ranking first on GIFT-Eval, TIME and fev-bench among pre-trained zero-shot models. Timestral produces probabilistic multivariate forecasts, supports past-only and known-future covariates, and runs on CPU without a GPU. It combines synthetic-first pre-training, covariate-aware attention and decoupled horizon forecasting, and can be fine-tuned on proprietary data through Mistral Forge.

    Why it matters: Useful for teams weighing time-series foundation models, since it reports benchmark standings, a size-versus-accuracy trade-off and CPU latency figures alongside the adaptation options.

  2. Google Research58

    Research@ 2026: 10 ways we're amplifying human ingenuity

    At its Research@ event in Mountain View, Google Research outlined 10 updates, including expanded early access to Google Earth AI's experimental geospatial capabilities, a multi-agent orchestrator for reproducing prior methods, and public access to its Deep Review verification system. Other highlights include the Synaptics Astra SR200 Series chip with Google's co-designed Coral NPU, upcoming integration of TimesFM and TabFM into Gemini for business, and a Lancet study in which 98 patients consulted AMIE ahead of urgent care visits. Google.org is also providing $10 million in funding for crisis resilience and public health work.

Oct 14Wed
  1. GitHub Blog · AI & ML34

    GitHub’s model for secret detection: Finding more secrets with less noise

    GitHub describes a two-stage secret scanning pipeline that uses regex candidate generation followed by a fine-tuned ModernBERT classifier that reads each candidate alongside its file path, variable names, and surrounding code. Compared with its previous LLM-based pipeline, GitHub reports 11.5% higher repository owner-weighted acceptance, 86% lower median post-push scan execution time, and more than 98% lower serving cost, with offline evaluation showing 13% higher precision and 19% higher recall. The efficiency gains made it practical to extend generic secret detection to push protection.

Oct 13Tue
  1. Microsoft Research52

    Simulating student learning for better AI tutoring

    Microsoft Research introduces StudentSim, a research system that trains personalized AI student simulators from publicly available, de-identified learner records to evaluate and improve AI tutors before testing with real learners. The work also presents StudentSimEval, a benchmark spanning chess, second-language English writing, and mathematics that measures behavioral fidelity and guidance responsiveness, with StudentSim outperforming baselines such as GPT-5.4 and Maia2. In a chess tutor reinforcement learning study, a tutor trained with StudentSim feedback reached 90.5% accuracy versus 75.7% for the no-RL baseline and 71.6% for the GPT-5.4 reward condition, as rated by blind human chess experts.

Oct 8Thu
  1. Microsoft Research71

    Agent Lightning v1.0: A 3,500-Line Lightweight Agentic RL Framework for Training Agents with Real Harnesses

    Microsoft Research Asia introduces Harnessed Agentic RL, a paradigm in which the same agent harness used in deployment participates directly in reinforcement learning, and open-sources Agent Lightning v1.0, a roughly 3,500-line framework with an API Gateway, Rollout Controller, and Customized Trainer built on verl. Agents run as standard Kubernetes jobs without commercial sandbox services, and Collocated Async RL shares GPUs between rollout and updates, achieving about a 2x end-to-end speedup over synchronous RL. An end-to-end coding agent pipeline raised Qwen3.5-9B from 41.8% to 56.4% Pass@1 on SWE-bench Verified using about 6,000 training samples.

    Why it matters: It offers a concrete, reproducible recipe for training deployed agents in place, with code size, infrastructure, and benchmark numbers stated explicitly.

Oct 6Tue
  1. Google Research58

    Unlocking Earth AI’s planetary geospatial foundation models for global public health

    Google researchers describe using the Population Dynamics Foundation Model (PDFM), part of Google Earth AI, to turn privacy-preserving search trends, mobility, built-environment and environmental data into monthly location embeddings that can be plugged into existing epidemiological models without task-specific fine-tuning. Independent partner evaluations across five public health challenges — MMR vaccination at the US–Canada border, US cardiovascular disease nowcasting, dengue forecasting in Mexico, postpartum depression risk prediction, and cholera emergence in the DRC — reported matched or improved performance over conventional inputs. The authors note current limitations such as static snapshots and say PDFM embeddings are available in Preview as Population Dynamics Insights, with no-cost access for select academic and public health research.

Oct 1Thu
  1. Microsoft Research40

    Forecasting space weather risks on power grids

    A Microsoft Research intern developed a machine learning pipeline that uses forecast-time solar-wind data, AE and Dst index forecasts, local geology and grid data to produce location-specific geomagnetically induced current risk estimates for 66,935 substations in the continental United States, 30 to 60 minutes ahead. During the 2020-2026 evaluation period the pipeline detected nearly 80% of major space-weather events, with detection rates of 76.5% for events ≥10 nT/min, 81.2% for ≥20 nT/min and 64.1% for ≥50 nT/min, and it produced estimates for all substations in about 333 milliseconds. The authors note that further validation with utilities and operational data would be needed before use in grid operations.

Sep 28Mon
  1. Mistral AI46

    Hallo, Deutschland!

    Mistral has opened a hub in Munich housing research teams focused on Physics AI and Industrial AI alongside applied engineers serving enterprise partners. The company says it will build one gigawatt of European compute capacity by 2030 and points to its open-weight architecture, which lets customers run models on their own infrastructure under European law. Following its May 2026 acquisition of Emmi AI, Mistral says it is working with BMW on crash simulations and engineering AI and with Siemens Energy on industrial AI applications, and has formed a research partnership with the Technical University Munich.

Sep 10Thu
  1. Mistral AI40

    Cloudera and Mistral Partner to Bring Specialized, Sovereign Intelligence to Enterprise Data

    Mistral and Cloudera announced a partnership to integrate Mistral's models with Cloudera's hybrid data platform, enabling enterprises to run inference across private and public cloud, on-prem, and fully air-gapped environments. The collaboration also lets enterprises train custom models on proprietary data within controlled environments while retaining ownership of both data and resulting intelligence. Cloudera cites 30 exabytes of customer-managed data on its platform, and the partnership is positioned around demand for sovereign AI that keeps data, intelligence, compute, and operations under customer control.

Jul 26Sun
  1. Berkeley AI Research38

    Teaching LLMs to Update Beliefs for Efficient Long-Horizon Interaction

    The post introduces ABBEL, a framework that replaces full interaction history with periodically updated natural-language "belief states" and supervises their contents through belief grading, including an autoencoding-inspired reconstruction objective. On CollabBench collaborative coding, reconstruction-based belief grading roughly halved the gap to full-context models and trained in 50 steps instead of 100, while using fewer peak tokens; on Combination Lock and multi-objective QA, domain-knowledge grading and a peak belief length penalty further improved efficiency. The authors argue that isolating and supervising summaries addresses the performance cost of recursive summarization in long-horizon tasks.

Jul 7Tue
  1. Berkeley AI Research38

    Intelligence is Free, Now What? Data Systems for, of, and by Agents

    A Berkeley EPIC Data Lab perspective argues that as inference costs fall toward near-zero, data systems face three challenges: redesigning for agent workloads (e.g., exploiting the 80-90% duplicate sub-queries in agentic speculation), building a substrate for agent swarms (structured memory, concurrent shared-state edits, coordination), and letting agents synthesize custom data systems that can be trusted. It surveys work including Bespoke OLAP, GenDB, and custom key-value store synthesis, and sketches a future where agents and data systems co-evolve and blur together.

May 8Fri
  1. Berkeley AI Research38

    Adaptive Parallel Reasoning: The Next Paradigm in Efficient Inference Scaling

    This post surveys parallel reasoning methods for LLMs, contrasting fixed approaches like self-consistency, Best-of-N, and tree search with adaptive parallel reasoning (APR), where the model itself decides when to parallelize, how many threads to spawn, and how to coordinate them. It describes fork-join inference designs, including engine-modifying KV cache stitching (Multiverse) versus client-side orchestration (ThreadWeaver), and covers training via SFT demonstrations and RL rewards based on critical-path efficiency gated by correctness. It closes with evaluation differences across Multiverse, ThreadWeaver, NPR, and Parallel-R1, plus open questions on stability and whether parallelization mainly helps as a training-time exploration scaffold.

Apr 20Mon
  1. Berkeley AI Research38

    Gradient-based Planning for World Models at Longer Horizons

    The post introduces GRASP (Gradient Relaxed Stochastic Planner), a gradient-based planner for learned world models that lifts trajectories into virtual states for parallel-in-time optimization, adds Gaussian noise to state iterates for exploration, and stops brittle state-input gradients through the model while retaining action gradients. It argues that long-horizon planning with modern world models is fragile due to ill-conditioned rollouts, non-greedy local minima, and adversarial-robustness-style sensitivity of state Jacobians, and reports Push-T results where GRASP outperforms CEM, GD, and LatCo at horizons from 40 to 80. The work is by Michael Psenka with Mike Rabbat, Aditi Krishnapriyan, Yann LeCun, and Amir Bar (arXiv 2602.00475).

Jan 10Sat
  1. Berkeley AI Research34

    Information-Driven Design of Imaging Systems

    Researchers present a framework that estimates mutual information directly from noisy measurements using a known noise model and a learned model of measurement variation, enabling direct evaluation and optimization of imaging systems by information content. In their NeurIPS 2025 paper, information estimates predicted decoder performance across color photography, radio astronomy, lensless imaging, and microscopy, and their IDEAL method optimized encoder parameters via gradient ascent, matching end-to-end optimization on color filter design without requiring a decoder network. The authors suggest the approach could extend to other sensing domains modeled as deterministic encoding with known noise characteristics.