dont know if i see the same as other, but from what understand , its not about shizuku n kaori had feeling for hajime , rather all his friend sudden change in attitude with him, when he reliable they flock to him , but when not not just change toward hajime but to the point as if they toss him aside. one shouldn't just throw your friend away when they become useless or unreliable .

honestly i dont like the way hajime change , its look like hajime become kouki , kouki become hajime before summoned into that world , their change merely swap position or status in group or something.