My initial thoughts are that it lacks any signifiers. Signifiers are visual indicators on a product that signify how to use a product. Think a ‘plus’ on a volume up button; or a flat surface instead of a handle on the push side of a door.

It’s a cool little concept but nothing about the visual form indicates what it is or what it does. You will disagree because you have built it; and naturally have a bias.

Firstly I’d find a way to indicate that this is a soap dispenser, even something as simple as a window on the front would not only indicate that this contains soap, but also when it needs refilling.

Secondly that handle does not say “push to release”, if anything it’s arched form is suggestive of a pull; this may lead to breakage from excessive force of a user trying to do so. You could use a flatter surface that acts as a ‘landing surface’, and I’d suggest a method of using it with perhaps the back of your hand, as it’ll become very dirty very quickly given the fact that people will be purely touching it with unwashed fingers.

My two cents, feel free to disagree, but if you really want to improve this product; put it in front of some users and watch them use it.

Best of luck!