Imagine 10 billion tokens per second even if we make no further improvement in f... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

dyauspitr 15 days ago | parent | context | favorite | on: MicroGPT-C in pure C hits 10M TPS on Apple M5

Imagine 10 billion tokens per second even if we make no further improvement in frontier LLMs than what we have today that would be paradigm changing.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact