> There is also an epistemological assumption that prevails, and that is that we understand (or we think we understand) how our brain/mind works.

It's good that it doesn't matter. Stochastic gradient descent works (or doesn't work) regardless of whether we know how the brain does its thing.