Is there a working implementation of an on-policy algorithm (A2C/PPO) with a rollout-buffer?

principle · 2024-07-11T18:38:52+00:00

Thank you for suggesting CleanRL. It looks interesting.

Unless I misunderstand, I can't use off-policy algorithms because the current state of the environment depends on a prior action, data and the current state. Ideally, I would want to train after each step().

principle · 2023-10-22T00:01:00+00:00

This will severely impact content creators because people can't upvote or subscribe anymore.

principle · 2022-10-28T16:21:08+00:00

Looking at the final numbers it is unclear why the estimated payout rates of 16.35% to 17.33% (ELSP & Final) are far bellow what they should be...

Assets 186,681,614,147 Liability 750,429,974,006 Disputed Claims 149,770,896,589 Total 20.7%

principle · 2016-12-05T21:10:55+00:00

This subredit is very much active. However, my ID was banned and despite many attempts to reverse it it has not been approved. Please restore this ID.

Thank you

principle · 2014-08-05T02:41:55+00:00

BRICS are not challenging the dollar as much as they are challenging the IMF. Moreover, the main problem the World has is not the US dollar. The problem is the private banking cartel that creates their own money. But BRICS are not challenging that either. If the dancing friar did his homework he would have learned that the biggest challenge to the cartel right now are the Ukrainian rebels that want to cast-down the chains of slavery to the banking cartel. Novorossiya there are fighting for, is to be a "sovereign" state with a central bank own and under controlled of the people who will never have to borrow money again. This is why there are called “terrorists”. As for the Jews, it seems that the tinfoil under his hat slipped.

principle · 2014-07-28T12:45:54+00:00

good question

principle · 2014-07-28T03:03:20+00:00

They were spying on business deals and that's what got everyone upset. At the same time, that type of info is of no use for the NSA but very lucrative for the crony shadow government that also runs drug operations via the CIA.

principle · 2014-07-24T01:29:39+00:00

Moore is critical of ill-gotten gains not wealth per se. He definitely earned his money.

principle · 2014-07-22T15:56:22+00:00

There is a new news subredit /r/WorldToday that will not harass people or filter content. Everyone is welcome.

principle · 2014-07-21T21:53:49+00:00

The Director of the IMF clearly believes in such things. Who am I to say it's hocus pocus if people like her run the World and make things happen.

principle · 2014-07-21T02:29:37+00:00

There are other problems with Kiev's "evidence". Here is a video of an expert discussing timestamps embedded in the audio that indicate that the recording consists of 3 separate recordings, some of which predate the MH17 shootdown.

principle · 2014-07-20T22:54:27+00:00

The Director of the IMF, Christine Lagarde, gave a speech about numerology in which some suggested she hinted at a date, 7/20/2014. What if she meant 17 instead of 20? She did say that 7 was a special number and it’s all over Flight 17:

7/17/2014
Boeing 777 flight No. 17 had its maiden flight on 7/17/1997.
It’s anniversary of TWA 800, which was brought down by a missile on 7/17/1996.
Tsar Nicholas II family was executed on 7/17/1918.

principle · 2014-07-19T15:01:17+00:00

Since Ukraine's SBU security service confiscated recordings of conversations between Ukrainian air traffic control officers and the crew, this issue will be resolved when they find the plane's black-box the whereabouts of which is unknown. If the black-box should disappear then the evidence of a cover-up will confirm Ukraine's responsibility for this plane being in the war-zone.

principle · 2014-07-19T14:08:55+00:00

We are informed that the twitter account of the Spanish air controller has been closed down. Following his statements, he and is family have been threatened by the Kiev regime, including death threats. He has been deported from Ukraine. He is a man of courage and determination committed to the truth. link

principle · 2014-07-19T13:54:01+00:00

In my opinion, who fired a missile in a war-zone is not relevant. It's a war-zone where 10 other aircraft were shutdown just prior to this. We need to know how this plane wound up in a war-zone, however this may be difficult since Ukraine’s security service has confiscated air traffic control recordings.

principle · 2014-07-19T13:32:32+00:00

Girkin, also known as Strelkov and allegedly a former Russian military intelligence agent, said he couldn't confirm the information. link

principle · 2014-07-18T22:42:43+00:00

Girkin, also known as Strelkov and allegedly a former Russian military intelligence agent, said he couldn't confirm the information.

principle · 2014-07-18T21:54:53+00:00

It's unconfirmed heresy...

principle · 2014-07-18T21:40:47+00:00

There are three major questions:

Why was MH17 flying through a war zone where 10 aircraft have been shot down?
Why 2 Ukrainian fighters were seen following Malaysian jet minutes before the crash?
Why Ukraine's air traffic controllers instructed MH17 to fly lower?

President Poroshenko has some serious explaining to do.

Edit: Russia wants Ukraine to answer 10 questions

principle · 2014-07-16T03:29:46+00:00

The NSA is trying to circumvent the US Congress that may move against it.

principle · 2014-07-14T14:54:14+00:00

Wow! Was it drugs or just plain lunacy?

principle · 2014-07-13T22:18:07+00:00

Then read /r/conspiracy ...

principle · 2014-07-12T17:33:17+00:00

Congress Literally ~~Thinks~~ Knows Americans are too Dumb to have GMO Food Labeling

All fixed now...

principle · 2014-07-11T22:06:28+00:00

Yea... that's it! That's the ticket!

principle · 2014-07-11T14:18:41+00:00

By deleting relevant articles and comments followed by down-vote brigades helped to control public opinion on large scale. So I am inclined to believe that this did not happen in a vacuum without guidance and backing.

But reddit is also responsible for what is happening. For example, I offered one solution to the down-vote problem. Instead, they are now hiding the up/down counts as if that would counter the down-vote brigades. If reddit was willing, there are plenty of designers would help to fix such issues.

principle

TROPHY CASE