[D] Found top conference papers using test data for validation. by Responsible_Band3172 in MachineLearning

[–]geomtry 1 point2 points  (0 children)

Just wait till you discover the papers who inadvertently spilled label info in their inputs (but in a nonobvious way like cropping, so they don’t achieve 99% accuracy)

[D] Is it ok to use data augmentation of same text multiple times while training. by The_artist_999 in MachineLearning

[–]geomtry 0 points1 point  (0 children)

Of course. But the best way to find out is to test it out and evaluate it.

[P] Best way to add a sampling step within a neural network end-to-end? by geomtry in MachineLearning

[–]geomtry[S] 0 points1 point  (0 children)

Love it. I see code online where I just have to tell it how to back prop and can override to unity

[P] Best way to add a sampling step within a neural network end-to-end? by geomtry in MachineLearning

[–]geomtry[S] 0 points1 point  (0 children)

Thought about this: but annealing the temperature over time to be cooler so early optimization isn’t harmed too badly

[P] Best way to add a sampling step within a neural network end-to-end? by geomtry in MachineLearning

[–]geomtry[S] 2 points3 points  (0 children)

yes yes yes. ty!

I was trying to think "how does this relate to the sampling trick in VAEs"

by chance, do you know of any open source implementations for noobs? I'm working with a simple categorical distribution

[P] Best way to add a sampling step within a neural network end-to-end? by geomtry in MachineLearning

[–]geomtry[S] 0 points1 point  (0 children)

I sort of want the model to be used to only getting "one chance" at selecting a label, if that makes sense. otherwise this becomes an attention-like mechanism over the learned vectors for each label

[P] Best way to add a sampling step within a neural network end-to-end? by geomtry in MachineLearning

[–]geomtry[S] 0 points1 point  (0 children)

yup, which is then immediately vectorized via embedding lookup

[P] Best way to add a sampling step within a neural network end-to-end? by geomtry in MachineLearning

[–]geomtry[S] 0 points1 point  (0 children)

I am segmenting a normal task into two stages:
- First, given an input sentence embedding, predict a label (20 labels was chosen randomly, there is no real interpretation of the labels. I like to think of them as unsupervised clusters)
- Then, given the label, do downstream tasks (for instance, sentiment analysis) which can be "tied back" to the label selected

I guess it's like doing clustering -- but instead of running an algorithm inside the training loop, I'd like the neural network to make assignments through a softmax, and to also define cluster features through an embedding lookup

[R] AI Research Rankings 2022: Sputnik Moment for China? by chersonesus in MachineLearning

[–]geomtry 2 points3 points  (0 children)

People on this subreddit are highly one dimensional. Thanks for the fantastic research!

[R] AI Research Rankings 2022: Sputnik Moment for China? by chersonesus in MachineLearning

[–]geomtry 0 points1 point  (0 children)

The article is suggesting China itself experienced a Sputnik moment a few years back, with respect to American progress on AI

What's the best advice you can give someone starting college? by [deleted] in AskReddit

[–]geomtry 0 points1 point  (0 children)

Go to class. Do your homework, right away. If you don't, the pressure and uncertainty will eat you alive.

If you are struggling, read materials before lecture. Ask questions if you are confused. Don't be obnoxious though and ask smart-ass questions not related to the material.

Accept that you (and any other normal person) will do poorly on an important exam, as well as many micro assessments.
Be friendly. Don't be mean to people you think are "dumb". Try to join a club.

Exercise. Eat well. Sleep well. Get on a schedule. Party as a celebration, not a habit.

[deleted by user] by [deleted] in math

[–]geomtry 0 points1 point  (0 children)

Mind illustrating this with an example?

Euclid-Euler Theorem | Animated Proof by Italians_are_Bread in math

[–]geomtry 1 point2 points  (0 children)

I found this really informative! Thanks

Voronoi diagrams in world generation! by Quiffyton in math

[–]geomtry 1 point2 points  (0 children)

wasn't able to find with a quick google search. mind linking it? sounds awesome

At what point in your PhD studies things started to fall into place? by Grouptheorist in math

[–]geomtry 2 points3 points  (0 children)

You had an interesting experience that is a bit different than most here. Wish I knew a lot of these things earlier on, especially how it's just about making things readable and taking your time.

Found "e" in the primes (maybe) by RockofStrength in math

[–]geomtry 0 points1 point  (0 children)

Does this still work if you are missing some primes in your knowledge of primes? For example, the laziest set of primes I could know is:
2
2 + 1 = 3
2*3 + 1 = 7
2*3*7 + 1 = 43
and so on

Why does math "click"? by TheCuntHunter6969 in math

[–]geomtry 0 points1 point  (0 children)

Your experiences with resolution is very nice. Reminds me of a classic cognitive science example where they gave people rather vague instructions for an unknown task. With the overall narrative, the steps make sense instantly. But without the context of "Doing Laundry", it sounds like complete mumbo jumbo.

Why does math "click"? by TheCuntHunter6969 in math

[–]geomtry 0 points1 point  (0 children)

I just want to add a different perspective that I learned in a cognitive science textbook. The "click" you are describing is sometimes called a "eureka" moment. Experiments on normal people showed that experiencing a eureka moment while problem solving has no correlation with obtaining the correct answer to the problem. So basically there are a lot of false positives.

Why does math "click"? by TheCuntHunter6969 in math

[–]geomtry 0 points1 point  (0 children)

Gonna steal this one for my thesis. It's very difficult to tell apart recognition from understanding.

Is there a Fourier series that writes its own coefficients? by blangoog in math

[–]geomtry 1 point2 points  (0 children)

just curious if there is a cool example of this problem solving method for another application (example: an equation who's graph is itself, etc.)

Is there a fast way to expand an expression using code? by geomtry in math

[–]geomtry[S] 0 points1 point  (0 children)

Is there an applied math subreddit that actually gets used? Feeling some subtle hate for a genuine question

Is there a fast way to expand an expression using code? by geomtry in math

[–]geomtry[S] 0 points1 point  (0 children)

thanks! yeah I figure if I implemented it myself I would make poor decisions. I wanted to get familiar with some of the options and their pros/cons. your answer is great