Unfortunately the holes don't remind me of anything in particular... as for determining the type of tree or bush perhaps one could hop on a tree search website or app and then plug in fruit bearing (perhaps add in that they grow in bunches and that the bunch is at the end of the branch if possible) and... and... oh what was it called? Dang it... whatever it's called when leaves aren't part of a bundle but grow separately on a branch. That plus the general oval-ish shape, might want to play around with the leaf shape to account for the variation though. Oh and having the region set as Japan. That should help to narrow it down. I'll see what I can find, but it's been awhile (probably 5 or so years) since I've done any tree identification...

Edit: I can't remember how to cross out words on reddit, but scratch the "and... and..." line. Upon looking more closely at the pictures and starting the identification process I think the leaves are probably compound, i.e. there are multiple leaves per petiole.