> It seems that custom inference silicon is a huge part of the AI game. Is there... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

nomel 7 months ago | parent | context | favorite | on: TinyTinyTPU: 2×2 systolic-array TPU-style matrix-m...

> It seems that custom inference silicon is a huge part of the AI game.

Is there any public info about % inference on custom vs GPU, for these companies?

mrinterweb 7 months ago [–]

Gemini is likely the most widely used gen AI model in the world considering search, Android integration, and countless other integrations into the Google ecosystem. Gemini runs on their custom TPU chips. So I would say a large portion of inference is already using ASIC. https://cloud.google.com/tpu

Consider applying for YC's Fall 2026 batch! Applications are open till July 27.
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact