Together AI Blog·· 18 hr agoAI score58
How we make Together AI easy for coding agents to use
How we make Together AI easy for coding agents to use
AI summary
Together AI describes building an agent-evaluation system that runs common developer tasks against baseline, MCP, and skills configurations across three models, using sandboxes, GitHub Actions, a recording proxy, and an LLM judge. The evals surfaced a mislabeled CLI sample and a skill file linking to a marketing page instead of pricing, plus an API error message pointing to a nonexistent route; fixes included two sentences added to the skill and corrected error routing. The company says its unified skill package initially dropped the pass rate to 75% before fixes brought it to 97.2%, and it plans to open-source the eval package next week.
Source: Together AI Blog · together.ai