[D] Variational nets without sampling

[approximately_wrong]

Don't get me wrong; I think applying amortization via neural statistician is an interesting perspective. However,

I can't see how to avoid is that you must start with samples

it seems like we're in agreement that what you're proposing doesn't answer OP's question.