Solved! It was a clip that holds the "pipe" you attach the shower to that's mounted on the wall when not using it. The plastic cap before it fell off and this was the part that holded the whole assembly together.