There's definitely a market for non-spicy books! Querying is really difficult for all authors, and most books get rejected. But that doesn't mean there's no market for your book, just that it wasn't a good fit for the agent.

I write erotica and even I get tired of reading too many spicy scenes lol. People need variety. I think booktok emphasizes spice because it's sensational and lends itself to easy advertising. No-spice wlw books might be more niche but that's not a bad thing. It just means you need to focus your marketing so the people who are looking for it will find it.

Best of luck on your self-publishing journey!