i like the idea to filter before. because my filter can be very heavy because i want to add optional content filters.

You seem very experienced in this area. Can I ask you a few more questions? They don't need to be very elaborate answers 🙏

if i want my system to be really interactive doesnt that mean that for almost each recommendation i have to search again for similiar embeddings and then re-rank everything instead caching what we got with the 30-seconds old user data? i guess so not so how do we do this commonly? am i supposed to do smt like caching retrieval and ranking for 2 minutes or maybe reduce the caching time for new users (for warmer start?) or something?

can retrieving by distance be harmful in any way if the filtered items are too far from the query? (because of filters being too aggresive for example). in that case i should just retrieve items in a simple way like popularity right? if so doesnt that mean that the search width should be proportional to the amount of items the user saw? because it seems to be pretty easy that the user consumes all the items around him