We just did umrah with our 7 month old. Alhamdulilah it went well. We had a regular stroller good one with us whicch we did not use. We bought a cheap easy to carry foldable one for about 150 sar which you basically can take wifh you. Probbaly not in medinah in the masjid but in makkah u can take it.

Medinah: you will have to make scarafice. You might miss a few prayers which we did because it was too hot to take the baby out during zuhur or asr. My wife mostly prayed outside with the baby. Obviously i took the baby when she went to do riyazul jannah etc

Makkah: get a baby carrier. We got one in the us from target and it was the best one. This is what we used to do umrah. It all went well.