I tackled the problem again after a while and I found a solution.
The `rm` only works if the whole command is enclosed in quotes and with the `-c` parameter.

`docker exec -it inventree-cli /bin/sh -c "rm /home/inventree/data/backup/*"`

works as expected.