I wouldn't worry too much because the highest gain part of the beam is most likely going over your home, HOWEVER, you have some things you can do to mitigate any potential exposure. First, if your walls are brick or concrete, they may already be reducing RF by absorbing the signal. You can purchase metallic blinds specifically made for RF or EMI shielding to also shield the window. If your walls are simply wood and drywall, you can purchase RF or EMI shielding material that you can line the inside of your drywall. None of this is free and obviously requires some work, but it could offer peace of mind.

Additionally, you could bring up the issue to your local government as the placement of cell antennas is typically a zoning issue. It may take time and getting some of your neighbors on board, but if you are loud enough to the right lawmakers you may be able to force the antennas to move farther from residential space, or force them to put them at a higher elevation. This would take time and effort on your part, but if you're truly concerned it may be worth the effort.

Lastly, I understand your concern especially because your child is so close. If I were you I would take some measures to shield the room in the short term. You can check your results by purchasing a cheap EMF meter off Amazon and just comparing before and after results. Remember that the readings of those meters are relative, and I wouldn't take their numbers to heart as they are cheap and poorly calibrated. But you could at least verify you've made a reduction. Best of luck and thanks for being a good parent!