Polymorphic Inference: self-tuning inference for open models

Together AI introduces "Polymorphic Inference," an approach for adapting inference to fast-changing model architectures, traffic shapes, and hardware, contrasted with the older "Static Inference" paradigm. The company announces Together Compiler, an AI-agent-driven "Continuous Compilation" optimization loop already running in production on some serverless endpoints, and previews upcoming work including self-serve compilation, shape-shifting speculative decoding, the ThunderAgent Router, post-training, and TogetherLink workload-aware model routing.