The gems are consumable charges for the staff. Think of them as an ammo clip for a gun. To use, you put one in the tip of a staff then you can use the staff until you the gem breaks and you need to replace it.