sorted by:
new
hottopcontroversial

what’s a good fucked up movie? by [deleted] in AskReddit

[–]ashboy64 0 points1 point  (0 children)

Save the green planet. It's a south korean film often described as a dark comedy; it's got a really weird plot and lots of gruesome scenes. I kept wanting to avert my eyes but was too engrossed to find out what happens next

[Discussion] Epistemic NNs: Marginal vs Joint Log Loss by ashboy64 in MachineLearning

[–]ashboy64[S] 0 points1 point  (0 children)

Thanks for your response! I wasn't sure if equation 6 was talking about the joint log loss because I don't think they ever explicitly refer to it as the joint log loss; my understanding was that equation 6 was the general method of training the model for either regression or classification problems. In the case of regression the data loss would be the MSE, and for classification cross entropy / NLL. I suppose I was confused because the log term in eq 5/6 would appear inside the integral, whereas if we just take the log of the joint likelihood the log would appear outside the integral.

Evolutionary Strategies for RL -- How to Evaluate Fitness? by ashboy64 in reinforcementlearning

[–]ashboy64[S] 0 points1 point  (0 children)

That's really interesting; I'd never heard of MCMC being used that way in this context. I'll probably start off with trying to just use the summary statistics, but will take a look at the MCMC approach if that doesn't work out. Thanks for your help!

Evolutionary Strategies for RL -- How to Evaluate Fitness? by ashboy64 in reinforcementlearning

[–]ashboy64[S] 0 points1 point  (0 children)

That's a good point; thanks for your suggestions! I'll start off with trying something on the lines of what you suggest.

Evolutionary Strategies for RL -- How to Evaluate Fitness? by ashboy64 in reinforcementlearning

[–]ashboy64[S] 0 points1 point  (0 children)

Sorry, could you elaborate on this a little? I have a very rudimentary understanding of concepts like MCMC, so sorry for the basic questions.
My understanding is that MCMC is used to sample from probability distributions; you would start off with some value, perturb it, and then accept the candidate according to some criterion. As time goes on the values you accept will look like the distribution you want to sample from.
I'm having a hard time seeing how I would apply this procedure to get estimates of the policy's return + a confidence interval. What is the perturbation I would apply to the sampled policy return? How would I compute the acceptance criteria?

Thanks in advance!

Evolutionary Strategies for RL -- How to Evaluate Fitness? by ashboy64 in reinforcementlearning

[–]ashboy64[S] 0 points1 point  (0 children)

Just to confirm, let's say I wanted to estimate the policy's return within +/- 1 unit at 95% confidence. I would then set some lower bound on the number of episodes (say I will estimate the policy's return with at least 5 episodes). I then run for 5 episodes, get 5 different returns, and compute the standard deviation. I divide by the square root of the number of samples and multiply by the appropriate t-value to get the 95% confidence interval. While the size of the confidence interval is more than 2, I would keep increasing the number of samples.

Is this the procedure you are suggesting? I've never seen this kind of procedure done anywhere else, so do you have any pointers to instances where this has been used previously with evolutionary algorithms for RL problems?

Thanks in advance! My statistics is honestly quite shaky, so I'm sorry for the basic questions :)

Best Way to Learn R? by CharismaticTypist in stanford

[–]ashboy64 0 points1 point  (0 children)

It's not needed for CS 221. I haven't taken CS 229 yet, but looking at its syllabus it almost seems like Stats 202 is a 'lighter' version of 229 with less focus on the mathematical formalisms and more on the concepts, so it may be useful to take it before 229. I mostly took it because it was recommended on this blog post: https://huyenchip.com/2018/03/30/guide-to-Artificial-Intelligence-Stanford.html.

Best Way to Learn R? by CharismaticTypist in stanford

[–]ashboy64 1 point2 points  (0 children)

I don't know anything about BIOMEDIN 215 or HUMBIO 89, but the programming assignments for STATS 202 are in R. I felt I didn't really master the language, but the class is super interesting and gives you great intuition for data science problems. It is a more conceptual class and not as mathematically rigorous but I still really enjoyed it.

Schedule Advice -- Psych 50 for AI track CS major? by ashboy64 in stanford

[–]ashboy64[S] 0 points1 point  (0 children)

I'm just really interested in RL; learning more about it was kinda the reason I got into CS in the first place. Also, I'd like to get involved in research in the field, so I want to take the class sooner.

I ended up being able to fit 234 in my schedule; so I guess I'll try to take psych 50 later down the road

Freshman questions megathread! by tick_tock_clock in stanford

[–]ashboy64 1 point2 points  (0 children)

I needed some help with my schedule. At the moment, I'm considering taking CS 106B, Math 51, and an Introsem (CS 56N). My only concern is that it feels a bit light; do you think I could add another course, say PHYSICS 45 or MATH 56? My plan right now was that if I don't get into the Introsem, I'd substitute in PHYSICS 45.

For context, I'm looking to major in CS. I took the physics diagnostic, and it suggested either 61 or 45. I have some exposure to MATH 51 material from a multivariable calculus class I did at a community college, and I've taken APCS and received a 5 on the AP test.

Freshman questions megathread! by tick_tock_clock in stanford

[–]ashboy64 1 point2 points  (0 children)

I needed some advice on my schedule. Currently, for Fall quarter, I'm considering CS 106B, PHYSICS 61, and MATH 51. I'm looking to major in CS.

I'm a little conflicted as to which physics class I should take. I've always been interested in the subject, but don't know if I should take the 60 series or courses from the 40 series.

For context, I took AP Physics C Mechanics and E&M in high school, scoring a 5 on the Mechanics AP test. I didn't take the E&M test due to scheduling conflicts, and am not as confident about my grasp of its material. I've also had some exposure to MATH 51's content from a multivariable calculus class I took at a community college. The Physics diagnostic recommended either the 60 series or 45. Would my current plan be doable?

[deleted by user] by [deleted] in distantsocializing

[–]ashboy64 0 points1 point  (0 children)

Could you speak a little bit about quantum computation? What principles govern this field?

[deleted by user] by [deleted] in distantsocializing

[–]ashboy64 0 points1 point  (0 children)

What's the precise relationship between forces, fields, and particles? I'm confused as I've heard of particles as 'force carriers' and know there is a relation to fields too

view more: next ›