iCreatAI News
Skip to content
Hacker News AI· thesnarkitecht·· 1 hr agoAI score20

Ask HN: Can anyone run frontier AI models at usable speeds?

Ask HN: Can anyone run frontier AI models at usable speeds?

AI summary

An Ask HN post notes that eight months ago EXO labs promised fast inference on local hardware, but it is not fast enough: getting a response through hermes using Kimi K2.6 takes a minute and a half. The poster asks whether there is hardware a developer can buy that can actually offset cloud bills.

Source: Hacker News AI · news.ycombinator.com