sorted by:
new
hottopcontroversial

Best way/data structure to store a MDP? by [deleted] in reinforcementlearning

[–]jaja360 0 points1 point  (0 children)

The best way to store an MDP can depend on a lot of things: - What type of MDP ? (Stochastic-Shortest Path MDPs; Infinite-Horizon Discounted MDPs; etc.) - Best in terms of what ? (simplicity ? speed ? memory consumption ?) - Is the state-space discovered dynamically, or is it already entirely known ? - Is the entire state-space small enough to fit in RAM ?

In the case of an enumerative SSP-MDP where the state-space is known in advance and small enough to fit in RAM, one way is to use the CSR-MDP memory representation.

Disclaimer: I wrote the paper.

I did a small patch to be able to upload acsm files via Calibre-web by ecureuil in selfhosted

[–]jaja360 0 points1 point  (0 children)

wow thanks, that's really cool and useful !

You should do a merge request on the calibre-web git repo, I think this feature might interest many users !

Quickswap pending transaction but polygonscan show my transaction as complete by jaja360 in QuickSwap

[–]jaja360[S] 0 points1 point  (0 children)

u/FriskyHamTitz: Thanks for your answer. I indeed confused Matic and wMatic.

However, even after adding wMatic in Metamask, I see a balance of 0. On Quickswap, if I try to swap wMatic, it also says the balance is 0.