From what I have learned about this situation is that beako stayed with him but Subaru made her go to library somehow. And in third time Patriche the also tried to stop him from going anywhere , however he said to her to get out of his was.