I heard that Google was actually late to the game on this, not realizing the val... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		seanmcdirmid on July 27, 2018 \| parent \| context \| favorite \| on: Jeff Dean’s ML System Architecture Blueprint I heard that Google was actually late to the game on this, not realizing the value of GPUs over (just) distributed computing when the DNN trend started. Now they even have custom silicon...

daviddumenil on July 28, 2018 [–]

I think it was more a case that Google had a large existing investment in CPU-based compute.

A lot of Dean's initial work was getting models effectively training on that kind of hardware using distributed SGD.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact