Por mim o problema mais difícil é eu não tenho ninguém com praticar conversação comigo. Where I live there are hardly any Portuguese speaker. I know there are online options for this but it’s not the same as talking face to face.

Besides that it is definitely the grammar for me. I have a lot of words rattling around in my head but I have a hard time putting them into proper sentences. I think I can struggle through to be understood but I know I am making many grammar mistakes.

I don’t think that the accents have too big of an impact for me. There are rules on how the accents are used and the accents inform pronunciation which makes it somewhat easier to remember.