There is evidence that each neuron performs calculations equivalent to a small neural net: https://www.sciencedirect.com/science/article/abs/pii/S08966....