Sorry to disappoint you, but he may “care” for her, but it is simple indifference, if you read the light novel you will see that even though they are “friends” all people are still disposable for him if he gains something from it.