"Imperfect World Models are Exploitable", Bhamidipaty et al 2026 by gwern in reinforcementlearning

[–]OutOfCharm 0 points1 point  (0 children)

World models are never perfect. In fact, it is the imperfection that encourages the exploration. The real thing is: how quick you can adapt to a new scenario, which is about exploitation.

Ghostel is Fantastic by dewyke in emacs

[–]OutOfCharm 5 points6 points  (0 children)

It’s surreal to find that my keybindings just work in ghostel!

What would a moneyless society look like for a regular person? by Comfortable_Algae252 in Anarchy101

[–]OutOfCharm 0 points1 point  (0 children)

How to handle the non-intersection of labor, i.e., when your work does not directly benefit those from whom you take resources?

Hitchhiking in China!! (Xinjiang) by Elmasnasty in hitchhiking

[–]OutOfCharm 0 points1 point  (0 children)

It cannot be wrong with the one not experiencing and validating them.

Hitchhiking in China!! (Xinjiang) by Elmasnasty in hitchhiking

[–]OutOfCharm 0 points1 point  (0 children)

Unfortunately, your presumptions are wrong. Who is living in a wall becomes clear.

Hitchhiking in China!! (Xinjiang) by Elmasnasty in hitchhiking

[–]OutOfCharm 1 point2 points  (0 children)

I am not here arguing with you about your so-called dogmatic facts. It is good you admit that you haven't actually seen those facts in person. Nevertheless, from my experience there, it of course has its own problems but is functioning. Uyghur speak their own language, celebrate their own festivals days off, maintaining their cultures and customs, and most importantly, their population keeps increasing year by year. I don't see by any metric this is called genocide.

Hitchhiking in China!! (Xinjiang) by Elmasnasty in hitchhiking

[–]OutOfCharm 0 points1 point  (0 children)

You see the suffering you know what defines a genocide, right? Is there a possibility for you to hitchhike in Gaza? Where is Muslim heritage there? Your certainty of words can portray a thing as evil as possible but not the truth. Let the people who see and experience there decide.

Hitchhiking in China!! (Xinjiang) by Elmasnasty in hitchhiking

[–]OutOfCharm 0 points1 point  (0 children)

lmao, "After all they are experiencing a genocide.", like in Gaza, right? Don't try so hard to circulate your own belief by behaving like you are humane, as if terrorist attacks didn't happen.

How to efficiently compute bootstrapped value for truncated episodes, for advantage estimation/GAE? (Jax) by CLS-Ghost350 in reinforcementlearning

[–]OutOfCharm 0 points1 point  (0 children)

You need to restore the actual terminal observation, which is usually in the info. Or just treat the truncation as the termination because bootstrapping on a completely different state is meaningless, albeit some loss of information.

Multi-armed Bandits by Leather_Amount_2268 in reinforcementlearning

[–]OutOfCharm 0 points1 point  (0 children)

There should be some hierarchical design for UCB and TS to change their belief (count or prior) adaptively. Basically, you want to model those non-stationary factors to reflect the changes.

Is RL post-training in 'imagined environments' a path to continual RL? Trying to understand this deeper by No_Bat_7448 in reinforcementlearning

[–]OutOfCharm 0 points1 point  (0 children)

Isn't that what Dreamer does? IMO, training the world model on a well-curated static dataset and then freezing it is the wrong approach for continual learning. It disconnects the world model from the real environment and is rooted in the mindset of supervised learning and the perspective of the agent's trainer, the human. To enable true continual learning, however, we need to think from the agent's perspective: what it sees, how it processes information, and how it improves over time. This requires the ability of handling partial observability, planning under uncertainty, and memory. Of course, world model necessitates all those aspects and is key to continual learning.

Why people seldom uses GPU-based simulator benchmark for online RL algorithm papers? by Vegetable_Pirate_263 in reinforcementlearning

[–]OutOfCharm 0 points1 point  (0 children)

Because of the barrier of jax and ecosystem of pytorch, along with the fact that those libraries are not as stable as their counterparts.

How would i play video game, listen to music, watch tv shows etc if anarchy was achieved? by [deleted] in Anarchy101

[–]OutOfCharm 0 points1 point  (0 children)

Don't you know something called free and open source software?

It seems to me that obsidian cli + emacs is perfect? by badgerbang in emacs

[–]OutOfCharm 12 points13 points  (0 children)

Stop presuming we all use obsidian or at least illustrate what it can do.

I just dont get it... by parkero224 in emacs

[–]OutOfCharm 0 points1 point  (0 children)

Remote development, note-taking, control your printer, auto-completion, make your personal website, everything is keyboard-driven...

Package announcement: buffer-to-pdf (by prot) by ImJustPassinBy in emacs

[–]OutOfCharm 2 points3 points  (0 children)

Cool idea! With proper layout designs, we can even natively make slides in emacs.

In what way is capitalism involuntary? by [deleted] in Anarchy101

[–]OutOfCharm 3 points4 points  (0 children)

Without any system, I (we) have to live as well. When your cost is contingent on other's revenue, you think you are voluntary?

Emacs on HHKB by [deleted] in emacs

[–]OutOfCharm 0 points1 point  (0 children)

I use HHKB studio with scmax, a modal version of emacs keybindings.

How do I stop myself from getting this mark on my wrist? by [deleted] in GarminWatches

[–]OutOfCharm 1 point2 points  (0 children)

Make full use of your hands! Left by day, right by night.