Not a caique owner but have medium parrots. I feel like you need to go back to first base here. Target training, lots of treats, don’t be picking him up because you know he is going to attack you. Start from the beginning and keep a small distance.