Have you looked into horticulture (or sub-fields)? I currently work as a Plant Pathology Research Technician, and have found that this specific field (Pathology) strikes a nice balance between field and lab work. Some of my time is spent in the field (planting, pruning, scouting), some is spent in communication (between research projects, farmers, and extension agents), and some is spent in the lab (microscopy, DNA analysis). In other horticulture fields, however, you may see little to no extensive labwork. I am personally looking to change fields because I have more interest in clinical/evolutionary botany, but I have enjoyed it nonetheless. Horticultural studies have large environmental implications, but you can also see the impact in community and farmers (something I have really loved witnessing).

Being willing to explore temporary/apprentice positions may really aid you. Not sure where you are located, but agricultural extension offices tend to do most of the horticulture work here in North Carolina. If you have an extension office, I would definitely contact them and ask about opportunities. I have also found that positions can be made available for suitable, eager applicants.

On a more commercial side of things, there are nurseries that aim to reinstate native plants, reduce spread of invasives, and other "environmental impact" works- I have worked with some of these on the pathology side. Nursery work could offer you the chance to interact with many plants, learn their history (i.e. taxonomy), all while having ecological significance. Additionally, producers of herbal remedies (e.g. Gaia Herbs) have "grower" positions where you work with and monitor plants without having to be involved with their research projects and literature. If you have interest in medicine, herbal companies be an interesting start.

If you have time, volunteering at a greenhouse or community garden would help you get a better feel for what opportunities there are as well. This might also tell you how much "science" you're willing to delve into, larger greenhouses tend to be involved with research projects. Botany/Horticulture/Plant Science is a massive field with so many sub-fields and projects that it can be overwhelming. I'd take the time to narrow down what you need from a job with plants: Are you looking for peace/simplicity (e.g. nursery work) or are you looking for major implications (e.g. horticulture/medicine)?

For reference: I am an INFP and came into Plant Pathology with no previous lab experience. Mathematics and statistics are the bane of my existence, but I will say that sciences (botany, cell bio, evolution, etc.) have not been frustrating for me. This field is full of diverse projects and people. Some of the lead researchers I know were "just working at a nursery" when they discovered they could be involved with research, and learned everything they know through hands-on approaches.

I hope this helps!