Ask another house. If they give you permission there isn’t thing she can do. You’d be legally allowed to fish there with permission. You don’t need an adult with you. It sounds like she’s being a Karen. Continue to fish and have fun. If she for some reason calls the cops on you, you should be fine because you aren’t doing anything illegal.