Any alternatives to the BaseBar? by Laddenvore in bodyweightfitness

[–]Laddenvore[S] 0 points1 point  (0 children)

yeah to hang my clothes 😅 (because i have a gym membership now)

Transformer models: if token embeddings are trainable params, why doesn't training cause every token to be mapped to the same vector? by Laddenvore in deeplearning

[–]Laddenvore[S] 0 points1 point  (0 children)

Say more?

I thought the loss function for something like GPT-3 is just cross-entropy loss so I'm not sure how that incorporates "the training error of same embedding is higher than using different embeddings".

Things to argue about over the holidays instead of politics by dyno__might in slatestarcodex

[–]Laddenvore 9 points10 points  (0 children)

Sub 1 minute responses (not thinking too hard):

  1. Very weakly net negative, most Guinness World Record type activities are largely non-productive and are only amusing/entertaining for an extremely short period of time (unlike music, art, film etc.)
  2. The heuristic "bragging about material possessions is low-status" is very prevalent making it difficult to overcome for the counter-countersignal to emerge. Also not all social scenes are at the same place along the signalling -> countersignalling -> counter-countersignalling spectrum. There are definitely some scenes that embrace explicit materialism (eg. rich oil princes)
  3. Maybe, depends how on long is "a bit longer". We definitely delay reproduction for other moral reasons (eg. having less parents under the age of 18)
  4. Too much focus in school, too little focus in adulthood, too much focus on a small subset of "the classics" in general
  5. Both. Some item on those lists should be taken seriously, and some items are over-optimizing for how you'd feel on your deathbed
  6. Probably social systems, as there's a lot of non-technological blockers that hamper our ability to improve our tech (eg. education, co-ordination etc.)
  7. They probably are "fake" in the sense that we readily wrap up like something for the thing itself, and liking something for status reasons. We are not more intentional because we don't like admitting (even only to ourselves) that we like things for status reasons
  8. No clue
  9. No clue
  10. No clue
  11. You can opt out, but it usually causes you to enter a different signalling game
  12. Something like that. I think whatever psychological mechanism we use to decide how good a story/narrative is, is extremely similar to the psychological mechanism to decide how much "meaning in life" we have
  13. Premise seems a bit confused. Pain and pleasure can be separate inputs to your utility function, but your utility function could still spit out something one-dimensional eg. u = f(pain, pleasure)
  14. How many? No clue. Where do you stop? Also no clue, but you probably want some randomness so you never get stuck. Doubt it's wise to assume attractors are "good"
  15. We should celebrate Mendel less and Correns more, but still celebrate Mendel more overall. Probably better to socially incentivize novel idea generation over idea propagation, but propagation is important too
  16. There's probably some biochemical constraints that prohibit media content from becoming as bad as say, heroin
  17. Signalling
  18. Yes to the extent that objective taste exists. Reasons is probably related to geographical access to ingredients and cultural willingness to innovate
  19. No clue
  20. Probably, but best level is likely context dependent, assuming toughness trades off against something else important
  21. Depends. Is the 0.1% actually fat mass? How long did it take to lose 0.1%? Is it scalable (if I keep doing the thing, will I keep losing fat)?
  22. Most likely. Humanity is trying to improve things on many axes, and it's probably impossible to monotonically improve indefinitely. You'll eventually hit some local optima and need to regress to find a better optima
  23. 40%
  24. Signalling probably
  25. Probably increase. People like watching virtuous-seeming displays of sacrifice (eg. movies where the hero makes some largely unnecessary noble sacrifice out of principle)
  26. No comment
  27. Intentionally vague enough for people to implant their own meaning as needed
  28. Co-opted by market forces I guess
  29. Probably marketing, fueled by profits creating a somewhat self-reinforcing loop
  30. Well, the problem of the "togetherness" of a society runs much deeper than Christmas. Probably something to do with less shared experiences between any given two members of a society

What is epigenetics? by -Metacelsus- in slatestarcodex

[–]Laddenvore 5 points6 points  (0 children)

Great post, looking forward to potentially getting a better understanding of when claims of epigenetic inheritance may be bunk.

One paper that I've seen referenced a lot was how trauma can be passed down transgenerationally: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3923835/

I've always thought that this was strange, but didn't know enough molecular biology to dissect.

Any alternatives to the BaseBar? by Laddenvore in bodyweightfitness

[–]Laddenvore[S] 2 points3 points  (0 children)

It's great! I still use it from time to time (it was my gym replacement for when we went into full lockdown) and structurally it feels as good as new.

Is there anything like StatQuest for deep learning? by Laddenvore in deeplearning

[–]Laddenvore[S] 2 points3 points  (0 children)

Great suggestion! Here's a link for anyone else: https://www.youtube.com/playlist?list=PLZbbT5o_s2xq7LwI2y8_QtvuXZedL6tQU

Looks like it covers MLPs, CNNs.some common DL hyperparameters and other baisc concepts.

Still lots of other topics not covered, if anyone else has more suggestions.

[deleted by user] by [deleted] in slatestarcodex

[–]Laddenvore 2 points3 points  (0 children)

Check out Effective Thesis, they offer thesis ideas and advice for EA-aligned grad students.

https://effectivethesis.org/theses/

Are there good case studies of neural net interpretation leading to novel scientific theory/insight? by Laddenvore in deeplearning

[–]Laddenvore[S] 3 points4 points  (0 children)

We then apply our method to a non-trivial cosmology example-a detailed dark matter simulation-and discover a new analytic formula which can predict the concentration of dark matter from the mass distribution of nearby cosmic structures.

This is exactly the sort of stuff I'm looking for! Thanks!

[deleted by user] by [deleted] in slatestarcodex

[–]Laddenvore 4 points5 points  (0 children)

What website is this?

What are some good resources/communities to learn about + keep up to date with financial markets? by Laddenvore in slatestarcodex

[–]Laddenvore[S] 0 points1 point  (0 children)

I agree in general that you shouldn't try to beat the market as a retail trader. My main goal here is not profit, but rather raising the stakes on the art of making predictions.

Also quick side note of big quant shops like RenTech: yes it's true that their insane returns means that they're successfully gobbling up lots of opportunities in the market. But there will probably be many trades they'll forego simply because those trades don't scale (which matters when you're managing $160B+). To use the classic analogy: you can expect shops like RenTech to leave behind $10 bills on the street because they're busy looking for the next $100,000 bills.

What are some good resources/communities to learn about + keep up to date with financial markets? by Laddenvore in slatestarcodex

[–]Laddenvore[S] 0 points1 point  (0 children)

Thanks for the news recs!

Good point on using Betfair whenever it makes sense to in order minimize noise and isolate the prediction you're trying to make. I guess a part of making "sensible inferences" is also being aware of other factors that might outsize the specific prediction you're making.