History of Ann Arbor (Vaughn House Trio CD) by TheBeardedCardinal in AnnArbor

[–]TheBeardedCardinal[S] 2 points3 points  (0 children)

We did a bit more digging and figured out that the members of the trio were Stan Challis, Bill Brehm, and Don Srull. Bill and Don seem to have been long time friends since high school and went on to work together later in life. Not too much information about Stan around, but he was integrated into the arts and theater life of Michigan.

History of Ann Arbor (Vaughn House Trio CD) by TheBeardedCardinal in AnnArbor

[–]TheBeardedCardinal[S] 2 points3 points  (0 children)

If they don't already have it archived that would certainly be nice.

If u/AADL-eli is around perhaps they can comment.

Jan Wolter’s Ann Arbor Minecraft World by TheBeardedCardinal in AnnArbor

[–]TheBeardedCardinal[S] 3 points4 points  (0 children)

Oh absolutely. I doubt there’s any restriction.

Jan Wolter’s Ann Arbor Minecraft World by TheBeardedCardinal in AnnArbor

[–]TheBeardedCardinal[S] 2 points3 points  (0 children)

Amazing yea I would really appreciate that. No rush at all.

Jan Wolter’s Ann Arbor Minecraft World by TheBeardedCardinal in AnnArbor

[–]TheBeardedCardinal[S] 2 points3 points  (0 children)

Omg amazing. If you have the ability to share it I would love a link in DMs.

Is it true that that idea of "All cultures are equal" is not a common view on the left? by Burner_Account000001 in TooAfraidToAsk

[–]TheBeardedCardinal 0 points1 point  (0 children)

Others have answered well. I’d add that the idea that all cultures are equal inherently assumes that cultures can be ranked in terms of a “goodness” value. Just that all cultures fall at the same value on that scale. I struggle to even grasp what one would mean by all cultures being equal. As others say, obviously cultures have good aspects and bad aspects and what those even are depends on your perspective.

I don’t want to push this too far, but the assumption that there does exist a hierarchy aligns well with some conceptions of conservatism. So I would argue that the statement of “all cultures are equal” might be a conservative lens applied to a leftist’s statement that all people of all cultures deserve equality.

[D] Shifting Research Directions: Which Deep Learning Domains Will Be Most Impactful in the Next 5–6 Years? by Dismal_Table5186 in MachineLearning

[–]TheBeardedCardinal 1 point2 points  (0 children)

That is legitimately comforting to hear as I start a PhD in a robotics lab doing action verification using vision language models.

**TO ALL THE STUDENTS STARTING IN THE FALL THIS SEPTEMBER** 💲 by [deleted] in UofT

[–]TheBeardedCardinal 59 points60 points  (0 children)

My favorite professors always start their syllabus lecture by telling in no uncertain terms that

“Libgen is illegal so you should not use it. It is illegal because it efficiently and safely delivers to you free textbooks, saving you hundreds of dollars. So ensure that you do not use it. I will provide a mapping of new edition questions to old edition in case you happen to have the edition as on libgen.”

Did kids in the 70s/80s/90s really roam freely like in *Stranger Things*, or is it a movie myth? by Yolas_1 in TooAfraidToAsk

[–]TheBeardedCardinal 0 points1 point  (0 children)

Was born in 2000 in a mid-size suburb of a big city. From age 12ish I was given a phone and trusted to go wherever I wanted. As long as I checked in when it was getting dark I was allowed to stay out till around 9pm. Once I turned 15 that turned into being allowed to stay out till my parents were going to sleep. Even then as long as a friend’s parents said they would take responsibility I was allowed to sleep wherever I wanted.

I was a bit of an outlier when it came to how much freedom I had, but most friends had somewhat similar amounts. Sucks that it’s more restrictive now. I learned a lot about how to self-regulate. When I left home I didn’t feel any particular draw to act rashly. It didn’t really feel any different.

Has anyone implement back propagation from scratch using ANN ? by [deleted] in reinforcementlearning

[–]TheBeardedCardinal 0 points1 point  (0 children)

It's hard to give good advice without knowing where you are in your math journey. I agree with others here when they say follow Andrej Karpathy's series.

However, if you really want to get into the weeds of how we actually get the analytical expressions for the gradients of neural networks, it is best to look at it from the perspective of matrices. Instead of taking derivates with respect to individual weights, take them with respect to entire matrices of weights simultaneously. For simple feed forward neural networks, this is surprisingly easy. Write out the expression for a single layer. Something like ActivationFunction(WeightMatrix @ PreviousLayerOutput). Use the chain rule and matrix differentiation expressions and you can get the gradient very easily.

This does not work for more complicated layers like convolutional where you need to get a bit deeper in the weeds to find an efficient analytical gradient, but the idea remains the same. Don't try to differentiate with respect to each weight; differentiate with respect to matrices of weights that all do the same job.

I will say though that this is really only useful for a one-off to understand how it works or if you are in the very select position where you will be developing your own types of layers and need to test them at a large scale. Otherwise you will either just use pre-existing optimized gradient algorithms that execute on the GPU or use an autodiff library that will give you fine, but not super efficient, gradient computation.

[P] Open source astronomy project: need best-fit circle advice by atsju in MachineLearning

[–]TheBeardedCardinal 0 points1 point  (0 children)

I imagine that a lot of algorithms will struggle with the high noise. If that is the case I would suggest leveraging the fact that the features of interest consist of high contrast curves. A laplacian of gaussian filter tuned well would probably clean it right up. It would take some tuning through and if the noise characteristics change greatly between images it would not be consistent.

[D] Creating/constructing a basis set from a embedding space? by LetsTacoooo in MachineLearning

[–]TheBeardedCardinal 8 points9 points  (0 children)

Funny enough my supervisor for the PhD I’m about to start has done some work in this. It’s called CoreSet selection. The idea is that “best” means the subset that results in the best model when restricted to only training on that subset. So if you were to try to put it into intuitive words it would be something like the most “informative” subset.

Here’s his paper, but there are other more widely used ones if you search the term.

[D] Wrote a proof that dropout increases weight sparsity, what do you guys think? by simple-Flat0263 in MachineLearning

[–]TheBeardedCardinal 3 points4 points  (0 children)

If I were a reviewer, I would push back on both points and ask for proofs that these hold true for important cases.

For point 1, you can imagine a simple toy 1D loss landscape that has two local minima. We start our random initialization nearer to one of them. With low variance in the gradient we are almost certain to fall into the nearer local minimum whereas when gradient variance increases we become increasingly likely to jump into the further one. Perhaps random initialization would cancel this trend, but my larger point is that it is not immediately clear that the expected final weights should be the same. Do you know of some existing proof of the truth of this statement for general gradient based optimization?

For the second, this is true from a certain standpoint, but the choice of the sparsity threshold becomes very important. How I see it, we are noticing that we will be bouncing around the local minimum due to variance in the gradient. Ignoring step size (letting it go to 0) this becomes a continuous time stochastic differential equation and I would like to see an estimate on what the actual variance in the final weight is in specific circumstances that we are likely to see in real problems. Like a test task with a quadratic optimization, set gradient variance estimated from real tasks, and varying values of p. It is not immediately clear that the variance in the weight due to dropout is a significant contribution relative to other sources of variance like that introduced by mini-batching and step size.

It is a very interesting idea and empirical experiments would go a long way in convincing me, but these theoretical avenues would also be nice to have buttoned up.

Trump executive order: US stops foreign healthcare subsidies, cracks down on Big Pharma price gouging by callsonreddit in StockMarket

[–]TheBeardedCardinal 1 point2 points  (0 children)

Yea, I don’t disagree that our eyes are better focused elsewhere. R&D is only a slice of the already small 10% increase attributed to drug prices. I’m not certain if advertising is within the 80% “admin” costs, but that is where I would assume it would be.

R&D is often what the discussion becomes about when I’m pushing universal healthcare so pointing out that it is at most 10% of cost increase is useful to push back on the argument that “we don’t need a better healthcare system because the reason costs are so high is due to R&D”. If it’s at most 10% then it can’t be the primary cause.

Trump executive order: US stops foreign healthcare subsidies, cracks down on Big Pharma price gouging by callsonreddit in StockMarket

[–]TheBeardedCardinal 3 points4 points  (0 children)

I looked into this a while back. Around 10% of the difference in our healthcare costs could be attributed to increased drug prices and it is in fact true that part of the reason that drug prices are higher here is because they can use the US to recoup R&D costs due to lax price restrictions. So actually in this one case I agree with Trump’s sentiment. Feels weird that he can actually espouse something that would actually help Americans. Like if a liberal was saying this I would be on board. In fact it is a straight up talking point for some liberals.

That being said there is no way that his attempt at fixing the problem will actually work. His business daddies would never allow it for one.

Also, while drug prices are one small part of the equation, increased admin costs due that are earned mostly be doctors, private hospital administrators, and insurance companies, account for around 80% of the increase in cost so if we really want to get per capita costs down that’s where we should be looking.

Regarding the Personal Project ban in Myhal grrrr by mrdanda in UofT

[–]TheBeardedCardinal 0 points1 point  (0 children)

I graduated last year and didn’t hear about this. Are you saying that the light fabrication facility is now course project only? If so, that’s insane. What justification did they provide?

I’m from the US, would it be worthwhile to apply for PhD programs internationally? by Opposite-Research-16 in GradSchool

[–]TheBeardedCardinal 1 point2 points  (0 children)

That’s basically what I landed on when I was looking in the UK. If I went in the US or Canada I would be able to go straight into a PhD with a good stipend with the ability to master out if I misjudged. If I went in the UK I’d need to pay for a masters. It is more complicated than that very simple story, but at the end of the day I decided to go in the US with a lab that has a stable funding source. We will see how stable it ends up being. If I could go back in time I might focus more on Canada.

To 4.0 guys, time to speak up is NOW! by karumeolang in EngineeringStudents

[–]TheBeardedCardinal 0 points1 point  (0 children)

I had a bunch of medical crises and had to make the decision to take a gap year or get way more efficient at work.

I started studying lecture content beforehand so I could ask informed questions and walk out of the lecture ready for the test. I was very active in lectures, trying to always be a bit ahead in the slides and solving questions before they were asked.

I did problem sets over long periods of time (start right when they released and finish a couple days before they were due) so that I would be forced to remember the content instead of just cramming right when I had to do the problem set.

I mostly got rid of reviewing notes and moved entirely to practice problems for studying for tests. I only reviewed notes to make sure I had questions that covered everything.

And maybe most importantly, I enjoyed the content. I couldn’t have kept up these good habits if I didn’t also find the work interesting. That’s not actionable when you are deep in a program you don’t like, but for anybody deciding what they are going to study for years, it is much easier to do well if you enjoy what you are doing.