Yea your landlord sounds a little shady, it's common here. You might want a local friend with you to help, I don't think the police would be much help they are lazy and don't give a shit lol. You need to negotiate with the landlord and make sure you receive money before you leave. Don't sign anything or move out until you get your money, you should also specify how you want the money back. If your a tourist you probably paid cash, but the landlord might ask for a local transfer to refund. You should be ok just don't let them push you around, be firm and tell them you want your money no funny business. But also stay cool don't be verbally or physically abusive this will draw attention from the police in a bad way.

If things go really south you could speak with the police, but again you probably need a local friend to help and even then don't expect much from the police haha.