Hacker News AI· thesnarkitecht·· 1 hr agoAI score20
Ask HN: Can anyone run frontier AI models at usable speeds?
Ask HN: Can anyone run frontier AI models at usable speeds?
AI summary
An Ask HN post notes that eight months ago EXO labs promised fast inference on local hardware, but it is not fast enough: getting a response through hermes using Kimi K2.6 takes a minute and a half. The poster asks whether there is hardware a developer can buy that can actually offset cloud bills.
Source: Hacker News AI · news.ycombinator.com