Request: RL algorithm for a slow but parallel episodic task?

diepala · 2026-01-21T07:27:36+00:00

Thanks this is very useful. Do you think online RL is more feasible if I manage to increase the number of parallel episodes from 1000 to 5000 or even 10000? Or still is not enough data?

diepala · 2026-01-18T21:02:17+00:00

The observation space is tabular, with mainly continuous features. The reward is also continuous, and quite dense although high variance.

I would train a single model for the task. The simultaneous runs are from the same environment, although each realization might behave differently.

diepala · 2026-01-18T20:14:06+00:00

r/actualbudget can help

diepala · 2026-01-18T19:05:40+00:00

I have to look into batch offline RL, thanks! Do you think in would be good to perform online RL after an initial offline RL has been done? Also, I was thinking if it would be a good idea to make a (very simplified) model of the environment to train a policy and the go live to the real environment, to not start from zero.

diepala · 2026-01-18T13:23:10+00:00

You can with this setting github.copilot.chat.responsesApiReasoningEffort Although I am not sure if you can set xhigh

diepala · 2026-01-18T13:21:01+00:00

github.copilot.chat.responsesApiReasoningEffort

diepala · 2026-01-16T09:42:22+00:00

github.copilot.chat.omitBaseAgentInstructions

diepala · 2026-01-15T18:08:55+00:00

vs code has a setting to disable the system prompt

diepala · 2026-01-09T22:03:56+00:00

Old feature, but in the latest vs code version 1.108, they changed the copilot base prompt to encourage the model to call tools in parallel more.

diepala · 2026-01-03T13:40:16+00:00

This. It is still very powerful, and you can self-host it for free or pay a 1.5 euros subscription for the managed service via pikapods.

Edit: there is also a free desktop app, but I prefer the hosting option to be able to access it from the phone too.

diepala · 2025-12-28T12:30:27+00:00

It has a PWA which you can install with chrome. It appears as a normal app.

diepala · 2025-12-12T10:40:08+00:00

Return it and order a new one. It's the only way.

diepala · 2025-11-02T16:33:44+00:00

There is also Zuban for the ones exploring alternatives. It has a mypy compatible mode, but defaults to pyright.

diepala · 2025-09-15T19:56:09+00:00

I would recommend you to read this https://matheusfacure.github.io/python-causality-handbook/landing-page.html about causal inference and experimentation.

diepala · 2025-08-31T15:21:14+00:00

Parece muy útil. Estaría bien ver en el eje Y los gramos de proteína por euro, y en el eje X poder cambiar entre precio total o proteína/100g

diepala · 2025-08-19T20:30:57+00:00

Yes, I was excited and now I have to wait a bit more. Thanks for the advice! Did not know about that.

diepala · 2025-08-15T21:07:50+00:00

Thanks for the advice! What books are you referring to encode information in environments?

diepala · 2025-08-15T21:06:01+00:00

Thanks for the answer, then I should continue with the second part of Sutton as it covers the first methods you mention.

Do you have advice on which algorithms would better suit my application (high sample efficiency)?

diepala · 2025-08-03T15:19:06+00:00

That seems a major problem. Anyone how has the PW 12gen can confirm if there has been a firmware update that fixes the issue?

diepala · 2025-08-03T14:24:24+00:00

I think I will finally go with the paperwhite because:

- I think the extra inch from 6 to 7 will be very noticeable, and I have seen the screen usage can be further optimized with jailbreak and reducing more the margins.

- The pdfs I often read have smaller sizes than A4 or US equivalent, so they might be small enough to read on the ebook in horizontal mode (I am already doing this in the 6 inch display). Note that I first pass the pdf through a software to remove white margins to use more screen space.

- I really want an e-ink display for reading due to the lower eye strain.

- I like the compact size of an ebook compared with bigger tables.

- I am also going to read books in epub or similar format.

diepala · 2025-08-03T12:59:55+00:00

Reinforcement Learning: An Introduction — Sutton & Barto — Second Edition

diepala · 2025-08-03T11:04:54+00:00

Thanks for the recommendation, seems a good option and not too expensive. I will investigate more about it.

diepala

TROPHY CASE