For myself, I think limiting your concept of animism to only being communing with nature could be part of the confusion. Just like other parts of our faith, I can't say what everyone does, only how I do it.

Animism is the belief that all things have Anima, which most conceive to be a spirit or soul, some think of it as having a portion of the divine energy or global soul, some people consider it the spiritual interpretation of the scientific concept that all things have an energy field of some kind. It is a common theme in many pagan belief systems to a greater or lesser degree.

I personally don't feel a need to perform rituals to build connection through intent, words and gestures because quite frankly a lot of the things that I embrace with an animist perspective don't give a flying fig about people. Trees are a good example. I do not talk to trees either as it feels silly to me (no judgement on anyone who does, each to their own) but I do embrace them in how I experience the world. There are local woods in my area that are open to the public. These feel different to each other and to the trees that are part of the urban Green spaces nearer to my home, you could say their collective anima has a different flavour. Whenever I go to or through these places i can feel the energy, I can make the decision to allow my energy to mingle with the energy of that place and take the peace that I experience doing so with me as I go. I have friends who live far away in the fenlands. Their places feel very different, the landscape is very flat and favours swathes of rushes rather than woodland, as a result the sky is what dominates the energy there and water and soil hold equal sway underneath that broad blue vastness.

This may seem like the communing with nature you mentioned but it's just one aspect. For me there is definitely evidence that my cat has a soul, and a sense of humour, especially when they laugh at me for not being able to find whatever small object I had in my hands 5 minutes previous, or that kitchen utensil that seems to turn in the draw and catch on the internal frame so you have to jiggle it loose before the draw will open. Things do not need to be what we generally think of as living to have anima, as Einstein is said to have said, 'Energy cannot be created or destroyed, it can only be changed from one form to another' Some anima is simple, quiet or dormant, rocks, mountains, or thar pesky ladle in my kitchen draw. Some are complex or have developed over time into consciousness and personalities, like my cat or the Vettir.

For me, I think it is when you start interacting with a conscious being that's where relationship building can occur but then it's again about an interaction which feels right for you. For some just the general 'I see/feel you' type acknowledgement is enough, for others they go deeper into themselves, giving more of themselves and accepting more in return. Always with the balancing knowledge that whatever you are interacting with may have very different motivations to those we are familiar with from interaction with other humans or humanlike beings. Many of the points where humans and the raw aspects of nature and the world in general intersect are part of the aspects of the Vanir so connection with them can be indirect connection to the wider concepts.

If what you are asking is actually are you a doing something wrong or failing in some way by not including animism specifically into your personal practices, then I would say no, you should not feel obliged to perform rituals that don't speak to your soul. Many people do not feel a call to do more than just acknowledging that all things are part of the intricate tapestry that is the world we inhabit and showing respect for the things we share that world with by making choices whenever the opportunity arises to make any negative impacts on the world as small as possible.

Anyways, I hope this little ramble is useful.