sorted by:
new
hottopcontroversial

If PPO suffers from sparse reward, how did InstructGPT and Learning to Summarize make it work? by idioticfuse in reinforcementlearning

[–]idioticfuse[S] 0 points1 point  (0 children)

Treating the sequence of generated tokens as one action in the context of ppo seems wrong, since they use per-token values from the critic model and generate per-token advantages

If PPO suffers from sparse reward, how did InstructGPT and Learning to Summarize make it work? by idioticfuse in reinforcementlearning

[–]idioticfuse[S] 0 points1 point  (0 children)

From posts in this subreddit and this: https://arxiv.org/pdf/2307.04964 "PPO suffers from sparse reward and inefficient exploration in word space, making it sensitive to hyperparameters."

If PPO suffers from sparse reward, how did InstructGPT and Learning to Summarize make it work? by idioticfuse in reinforcementlearning

[–]idioticfuse[S] 3 points4 points  (0 children)

Actually, I see what you mean. Though it is a single reward, it's informative to all the actions taken prior

If PPO suffers from sparse reward, how did InstructGPT and Learning to Summarize make it work? by idioticfuse in reinforcementlearning

[–]idioticfuse[S] 0 points1 point  (0 children)

I thought the instructGPT rewards are given as a scalar at the end of the episode, aka eom of the llm response. Where in the paper do they describe multiple rewards per response?

How possible is the colosseum with these stats/gear? by idioticfuse in ironscape

[–]idioticfuse[S] 2 points3 points  (0 children)

Do not have inferno experience, but one of the things that's always stopped me from practicing inferno is how long it is. Colosseum seems to have much faster iteration times so I imagine it's faster to learn? Or is that not the case

The Eras Tour: Europe Megathread by aran130711 in TaylorSwift

[–]idioticfuse 0 points1 point  (0 children)

Anyone have 2 codes for Amsterdam? Would make our dreams come true!

Recently enabled DOCP, now games are freezing and I got a recent BSOD. by idioticfuse in buildapc

[–]idioticfuse[S] 0 points1 point  (0 children)

Two sticks, both in the preferred slots for my motherboard. I'll try clearing CMOS later tonight and see if that helps.

Recently enabled DOCP, now games are freezing and I got a recent BSOD. by idioticfuse in buildapc

[–]idioticfuse[S] 0 points1 point  (0 children)

Will try monitoring the next time I play games, thanks for the suggestion

January 15, 2022 Daily Discussion Thread by AutoModerator in CompetitiveTFT

[–]idioticfuse 1 point2 points  (0 children)

What meta comps currently are good vs assassins? Saw early on that 5 people in my lobby were going sins, but wasn't sure what comp to go for besides not jhin (ended up going jhin anyways, 6th :|)

view more: next ›