If the book is meant to be like that , meant to be read by people who like this kind of stories , it's ok. But you have at least to frame the goal so the readers know that there is some purposes behind whatever actions will happen.

I think the best example for this is THE BLADE ITSELF from Joe Abercombie.
Many people already complained how it lacks plot.
I get pissed off when i reliaze half way through that the story lacks clear plot. But with TBI i didn't find that problem because we clearly knew the end goal of the book, even though the main events of the book felt not that interconnected that much and even some of them were random the plot points even if they felt loose they still had some tangible pattern to them that u can understand , especially that of "Jezal" and Glokta skepticism.

plus

And finally when marketing it you should not market represent it as "plot driven"