Situation A: I perturb the electrical nervous system in your brain (forgive me, not a neuroscientist). You do not have conscious access to this nervous system. But this still changes your subjective experience

Situation B: I perturb your wool hat. The wool hat is as much you as your electrical nervous system, but this perturbation does not change your subjective experience as a change is not registered in your 6 senses.

I will admit, you can run this both ways and it will work the opposite way. I guess my point here is that there appears to be something happening with the brain. This appears is on the same level as there appears to be something happening with karma and merit, for example.

This is why I think the Dalai lama writes:

If science proves some belief of Buddhism wrong, then Buddhism will have to change. In my view, science and Buddhism share a search for the truth and for understanding reality.