iCreatAI News
Skip to content
Oct 27Tue
  1. AWS Machine Learning Blog34

    Fleet-wide computer vision lifecycle at the edge with SageMaker SDK v3

    This post updates a 2023 MLOps pipeline pattern for visual quality inspection to Amazon SageMaker Python SDK v3, replacing the deprecated SageMaker Edge Manager with SageMaker Neo for edge optimization. It describes a dual-branch SageMaker Pipeline that trains an anomaly detector and a defect classifier per camera, gates models on their exported ONNX artifacts, compiles them with Neo, and registers them with camera metadata, while a Step Functions and DynamoDB semaphore layer paces fleet training. The sample deploys via AWS CDK and a full synthetic-data run costs about $0.07 in compute.

Oct 24Sat
  1. Simon Willison20

    Quick Study

    A prompt to Claude Opus 5.5 High asks it to build an artifact that opens a photo and, within a few seconds, paints a version of that photo using a canvas element and a simulated paintbrush. The post also references a previous experiment in which Claude Fable simulated a watercolor illustration with P5.js.

  2. AWS Machine Learning Blog58

    Multi-Turn Reinforcement Learning on Amazon SageMaker AI: A hands-on guide

    This AWS post walks through an end-to-end Multi-Turn Reinforcement Learning pipeline on Amazon SageMaker AI, using a Wordle agent hosted on Amazon Bedrock AgentCore that reports one outcome reward per episode for GRPO training of a LoRA adapter. In the example run, gpt-oss-20b improved from 61% to 84% solve rate on held-out words at default reasoning effort and from 15% to 69% at low effort, for about $339 in training tokens. It also covers IAM roles, dataset preparation, MLflow monitoring, serving-setting evaluation, cleanup, and reward-design mistakes and training failures encountered.

  3. AWS Machine Learning Blog34

    How Bayer Crop Science built an agentic decision engine on Amazon Bedrock AgentCore with AWS Unified Operations

    Bayer Crop Science built the Agentic Decision Engine (ADE), a multi-agent natural language interface over its Connected Decision Engine, running on Amazon Bedrock AgentCore with LangGraph orchestration and 22 specialist agents. In its first phase, ADE resolves about 80 percent of user questions without an engineer in the loop, and exposing APIs through AgentCore Gateway cut per-API integration overhead by more than 99 percent. The post details five design decisions, production readiness work such as task-level observability and cost attribution, and ongoing operations with AWS Unified Operations.

  4. AWS Machine Learning Blog22

    Orchestrating SageMaker AI endpoint auto scaling with AWS CDK

    Updating a SageMaker AI real-time endpoint configuration fails through CloudFormation or CDK because SageMaker AI requires the scalable target to be deregistered first, and manual deregistration leaves CloudFormation unable to track Application Auto Scaling resources. The post presents a reusable CDK construct that replaces the native scalable target and scaling policy resources with three custom resources—Deregister, Register Scalable Target, and Attach Scaling Policy—ordered with explicit dependencies and driven by a ConfigHash so endpoint and auto scaling changes deploy together. It includes a walkthrough using the sample-sagemaker-endpoint-autoscaling GitHub repository and guidance on integrating the construct into an existing stack.

Oct 23Fri
  1. AWS Machine Learning Blog18

    How U.S. Hunger connects leaders and data using Amazon Quick

    U.S. Hunger, which reports delivering more than 250 million meals, uses Amazon Quick to let CEO Rick Whitted explore Full Cart datasets directly and to give 17 colleagues across leadership, technology, finance, and compliance shared Spaces for KPI definitions, financial planning, and research. Data from its Impact Manager platform is refreshed from SQL Server into SPICE nightly at 2 AM ET, and the organization plans a Q4 2026 enterprise KPI framework routing NetSuite, Salesforce, and other systems through Boomi into Amazon Redshift.

  2. AWS Machine Learning Blog34

    Train Qwen3 on AWS Trainium with torchtitan

    This post walks through training Qwen3 three ways on a single trn2.48xlarge using torchtitan-neuron: via Hugging Face Transformers v5 as a modeling backend, via torchtitan's native Qwen3 by changing config.model_spec, and via NKI mixture-of-experts kernels from the torchtitan-neuron recipes, all using the same torchrun launch pattern. It also shows how to load and save published safetensors checkpoints, attach a custom NKI rope_hf kernel through torchtitan's override registry, and scale with data and tensor parallelism across 64 logical NeuronCores.

  3. AWS Machine Learning Blog38

    Adaptive agentic intelligence framework using Strands Agents

    The Adaptive Agentic Intelligence Framework (AAIF), built on Strands Agents, uses a small local language model (llama3.2:1b) as an orchestrator that routes routine requests to local SLMs via Ollama and complex requests to cloud models through Amazon Bedrock. The post walks through an IoT monitoring reference implementation with tools for device telemetry, local vision analysis, and Bedrock-based expert insights, and describes cloud-only, hybrid, and air-gapped deployment configurations. It also outlines converting tools into MCP servers for distributed tool calling and applying Amazon Bedrock Guardrails to the cloud inference path.

  4. AWS Machine Learning Blog58

    5 production challenges in multi-agent systems and how Deep Insight solved them

    AWS's Solutions Architecture team describes Deep Insight, an open-source multi-agent system (Coordinator, Planner, Supervisor, Coder, Validator, Reporter, Tracker) that turns a CSV file and a natural-language prompt into a validated DOCX analysis report with charts. The post, part one of three, maps five production challenges to a stack: Strands Agents SDK Graph and Agents-as-Tools patterns for execution flow, role-specific Claude models on Amazon Bedrock, Amazon Bedrock AgentCore for managed deployment, AWS Fargate plus Application Load Balancer for isolated code execution, and DynamoDB, Amazon SNS and Amazon Cognito for monitoring. It also cites LG Electronics' ChatInsight and TechRecon as reuse of the same architecture.

  5. AWS Machine Learning Blog20

    Securing Quick access from corporate networks with AWS PrivateLink

    This walkthrough explains how to connect on-premises data sources to Amazon Quick privately using AWS PrivateLink VPC endpoints and Quick VPC connections, so traffic stays off the public internet over Direct Connect or Site-to-Site VPN. It covers endpoint creation for website and API access, DNS resolution via Route 53 private hosted zones, endpoint policies, execution roles, data source VPC endpoints, required external domains, and enforcing VPC endpoint restrictions. It also addresses identity federation with IAM Identity Center and notes that browser sign-in still requires outbound access to public AWS sign-in endpoints.

  6. AWS Machine Learning Blog31

    How IskayPet unified corporate knowledge with Amazon Bedrock Managed Knowledge Bases

    IskayPet, an Iberian pet care company with over 330 stores and 4,500 employees, built a corporate knowledge assistant on Amazon Bedrock Managed Knowledge Bases that answers employee questions across retail operations, veterinary care, people and onboarding, and procurement in four languages and three countries without managing RAG infrastructure. The solution uses the native SharePoint connector with advanced indexing, a dedicated knowledge base per assistant scoped to specific sites or libraries, document-level access control tied to existing SharePoint permissions, and hybrid search with reranking. Built with Kiro and Claude Haiku 4.5, it reportedly cut time to find an operational answer from 3–5 minutes to about 7 seconds in roughly the first two months in production.

  7. AWS Machine Learning Blog34

    Deploy AI in a HIPAA-eligible environment with Amazon Quick

    This AWS post explains how to deploy Amazon Quick, a HIPAA-eligible service, for healthcare workloads that touch protected health information, covering covered entities and business associates, the distinction between HIPAA-eligible and HIPAA-compliant, and the unstructured (knowledge base) and structured (Amazon Quick Sight) PHI data paths. It details the controls Amazon Quick provides—managed infrastructure, encryption, RBAC and SSO, CloudTrail and CloudWatch vended logs—alongside what it does not do, such as de-identification and lake-level governance handled by AWS Glue, Glue DataBrew, and Lake Formation. It closes with a fictional health plan walkthrough, irreversible day-zero decisions (customer managed key, identity model, ACL-aware knowledge bases), and a step-by-step implementation guide.

  8. AWS Machine Learning Blog38

    Stream low-latency speech from AI agents using Kokoro TTS on Amazon SageMaker AI

    This AWS post describes streaming each sentence an agent produces to a hosted Kokoro-82M text-to-speech model on a SageMaker AI real-time endpoint, so synthesis starts on the first sentence instead of waiting for the full response. It covers bidirectional WebSocket handling, an incremental sentence chunker, and two transports for returning audio to the browser, reporting that incremental sending cut mean time to first audio byte from 329.3 ms to 156.7 ms in isolation and made bidi mode 2.4 to 3.5 times faster than batch in a deployed agent.

  9. AWS Machine Learning Blog32

    Stop guessing auto scaling targets for TTS on Amazon SageMaker AI

    This AWS post deploys Kokoro-82M, an 82-million-parameter non-autoregressive TTS model, as a custom container on an Amazon SageMaker AI real-time endpoint via AWS CDK stacks, then replaces a guessed auto scaling target with values derived from two live measurements: Q_max (the highest per-instance concurrency that still meets a 3,000 ms p95 time-to-first-audio SLO, measured at 50) and T_total (end-to-end scale-out time, measured at 260.2 s and planned against 320.2 s). Scaling uses the native ConcurrentRequestsPerModel metric, and a five-command tool chain (drift, qmax, ttotal, plan, validate) computes the scale-out threshold (37.5), scale-in threshold (25.0) and asymmetric cooldowns by arithmetic. The authors note the methodology generalizes to other latency-sensitive, concurrency-bound real-time SageMaker AI endpoints, while the specific numbers hold only for Kokoro-82M on ml.g5.xlarge.

  10. AWS Machine Learning Blog38

    How Rescale built an AI triage agent with Strands Agents and AI-DLC

    Rescale used the open source AI-Driven Development Lifecycle (AI-DLC) framework on AWS to build an agent that classifies and routes nightly end-to-end test failures, going from problem definition to staging in five days and to production within weeks. The agent runs in Rescale's Argo Workflows CI/CD pipeline on Amazon EKS, uses Claude on Amazon Bedrock for classification, retrieves historical failure patterns from a knowledge base, and queries pod logs via MCP, producing structured remediation reports. In production, classification agreement with human triage rose from 44% to 68%, and time blocking production deployment while failures are analyzed fell 20%.

Oct 22Thu
  1. Hugging Face Blog27

    Profiling TorchNeuron (Part 1): System-level profiling on AWS Trainium.

    This post walks through system-level profiling of inference on AWS Trainium using TorchNeuron, its open source native PyTorch backend, starting from scratch with no prior profiling experience. It shows how to configure torch.profiler with NeuronConfig and NeuronProfiler to capture a clean trace, read the key_averages() table to find operations consuming Neuron device time, and follow an operation through Neuron Explorer from framework dispatch to hardware execution. Using three RMSNorm implementations, it reports naive ops at 2,355 µs of Neuron time versus 403 µs for torch.rms_norm and 376 µs for naive plus torch.compile.

Oct 21Wed
  1. Latent Space62

    Claude Mods: Flipping the Harness Inside Out

    The author describes Claude Mods, Claude Code plugins written as TypeScript or JavaScript functions that hook into events like prompts, tool calls and interface renders to customize the CLI and Desktop behavior, framing them as an early "Attention Interface" that users can shape themselves. He highlights the built-in You Should Know mod, which flags uncommitted work the agent might cause you to lose, and his own Next Steps Supervisor from the open-source ModSmith plugin, then compares Claude Mods with OpenAI's ChatGPT Intelligent UI and Cursor's PR Routing & Approval. He also notes downsides—noise (99 of 111 turns triggered his supervisor), token cost of roughly 5–6k input-equivalent tokens per check on a 50k-token session, and the fact that mods run unsandboxed with your permissions.

  2. Simon Willison34

    Battle Drones - a vibe coded RTS with audio-based multiplayer

    Simon Willison describes Battle Drones, a browser-based Command & Conquer-style RTS built largely by coding agents such as Claude Code over 12 major iterations and 321 commits, with 3D models, fog of war, multiple maps and a random map generator, several game modes, and AI personalities. It supports multiplayer between two nearby devices by synchronizing game state over audio, and an online multiplayer mode was later added via a stateless WebSockets relay server on Fly.io. The post also covers agent-vs-agent battles where two LLMs play each other, and lessons such as using a deterministic simulation engine for replays and multiplayer.

  3. GitHub Blog · AI & ML22

    How 3 Java Champions are using GitHub Copilot for increased productivity

    GitHub interviews three Java Champions—Vlad Mihalcea, Patrick Baumgartner, and Frank Delporte—about using GitHub Copilot in production and open source work, including a Hypersistence Optimizer app built in two days, a 900-slide Reveal.js to Marp migration, and diagnosing a Pi4J bug where virtual threads pinned in native poll() calls left a fifth button unresponsive. They emphasize reviewing generated code, defining verification gates, and keeping humans accountable for what ships.

Oct 20Tue
  1. GitHub Blog · AI & ML34

    How to continue a GitHub Copilot app session in VS Code

    This GitHub tutorial explains how to open a GitHub Copilot app session in VS Code so its conversation, diff, and worktree carry over, letting you review changes line by line, edit by hand, run tests locally, and push updates to the session's pull request. It lists prerequisites and walks through each step, including prompting Copilot further from the sidebar and committing with normal Git commands.

Oct 14Wed
  1. GitHub Blog · AI & ML34

    GitHub’s model for secret detection: Finding more secrets with less noise

    GitHub describes a two-stage secret scanning pipeline that uses regex candidate generation followed by a fine-tuned ModernBERT classifier that reads each candidate alongside its file path, variable names, and surrounding code. Compared with its previous LLM-based pipeline, GitHub reports 11.5% higher repository owner-weighted acceptance, 86% lower median post-push scan execution time, and more than 98% lower serving cost, with offline evaluation showing 13% higher precision and 19% higher recall. The efficiency gains made it practical to extend generic secret detection to push protection.

Oct 13Tue
  1. GitHub Blog · AI & ML38

    GitHub Copilot app for Beginners: How to teach Copilot about your codebase

    GitHub's beginner guide explains four ways to give Copilot project context: repository custom instructions in .github/copilot-instructions.md plus path-specific files in .github/instructions, agent skills in .github/skills for repeatable procedures, custom agents in .github/agents for broader specialized tasks, and MCP servers that connect Copilot to external tools and data sources such as Playwright. It suggests starting small by adding one convention you keep explaining to .github/copilot-instructions.md, and points to Awesome Copilot for community-shared examples.

Oct 2Fri
  1. GitHub Blog · AI & ML22

    AI is changing developer work. Here are three skills to strengthen.

    GitHub outlines three skills developers should strengthen as AI reshapes their work: learning to direct AI agents rather than just use them, not trusting AI's first answer and instead having a second model critique it before review, and using time saved on implementation to tackle broader problems like customer needs and architectural tradeoffs. The post illustrates these with examples such as coordinating multiple agents on an authentication flow and a second model critiquing a SQL query. It notes GitHub Copilot's built-in Rubber Duck agent uses a second model to critique plans, code, and tests.

Sep 26Sat
  1. GitHub Blog · AI & ML55

    GitHub Copilot app for Beginners: How to build custom workflows with canvases

    GitHub explains canvases in the GitHub Copilot app: customizable, bidirectional interfaces such as kanban boards, checklists, or dashboards that you create by entering the /create-canvas skill in an agent session and describing the workflow in plain English. The agent builds the interface in the right-side panel, and both you and the agent can update its shared state immediately without a separate sync step. Canvases are saved as extensions for reuse or team sharing, and ready-made ones are available through Awesome Copilot.

Sep 9Wed
  1. Mistral AI58

    Modernizing complex legacy code with AI agents.

    Mistral helped a European energy operator migrate 40,000 lines of Fortran 77 to C++ for a physics-intensive reservoir simulator that had no test suite or centralized documentation. The team built a numerical parity harness before migrating, used agents to document the codebase via a caller-callee tree, and settled on a human-supervised workflow of coder, tester and reviewer agents migrating module by module. The first sprint covered 40,000 of 300,000 lines, and the authors note that migrations depending on external systems or undocumented physics would face additional challenges.