I knew someone in the early 90s who was making a neural network on a chip for his PhD. The chip fitted 1 neuron. Yes he might have used float16 to cram more in but those techniques were not known at the time.

There really wasn't the compute power around at the time, and as others have pointed out there wasn't the training data, or the cameras.