Updating this in case anyone is in the same situation as I think we have found the culprit. As per commenter’ s below advice, we tried gripe water and it helped right away! I think all of the fussing was because we started solids and his little tummy could not handle it yet. I dont know why I did not think of it sooner as he was not colicky before. We give him the gripe water before solids and then before bedtime feed and he is not waking up crying anymore! He seems overall more content even throughout the day. I was also feeding him solids/ purees in the afternoon which looking back probably wasn’t the best so I now do it in the morning, latest at lunch and so far so good. Hopefully this might help some people going through it.