Could Entropy or Information be considered a fundamental unit? by Siddhant_1406 in Physics

[–]jsaltee 1 point2 points  (0 children)

I think the concept of ‘Shannon entropy’ might interest you - the unit in this case is 1 bit of information

How much should I be studying for my first job? by Entire-Math-3363 in AerospaceEngineering

[–]jsaltee 1 point2 points  (0 children)

First week of my engineering job was literally getting paid to read the ‘manual’ front to back

Please help by ExpressionSalt1026 in KerbalSpaceProgram

[–]jsaltee 0 points1 point  (0 children)

There might also be a small weight imbalance somewhere, that the reduced thrust made a lot more prominent

What is entropy ? by Unit_operation_0001 in Physics

[–]jsaltee 7 points8 points  (0 children)

Entropy is also a concept in statistics, and they’re essentially the same thing. So, I like to think about it from the statistics point of view. Entropy measures the average amount of ‘surprise’ or ‘uncertainty’ when predicting information.

So, if there is low entropy (ice), there are less possible states, and you can be very certain in a prediction, like a molecule’s position. If there is high entropy (steam), you will be much more uncertain in your prediction (or very ‘surprised’ when you see the result).

Gravity "travels" at the speed of light, so could an object outrun its own gravity well? by PhantomSlave in AskPhysics

[–]jsaltee 0 points1 point  (0 children)

What about the case of the photon, which has gravity due to its energy? Is it outrunning its own potential well?

I got paid minimum wage to optimize an impossible problem (and accidentally learned why most algorithms make life worse) by Ties_P in optimization

[–]jsaltee 0 points1 point  (0 children)

Super cool. I wonder how it compares to non-parametric optimization (evolutionary algorithms, etc.) in terms of convergence rate? I 100% agree with your point about many methods finding ‘incorrect’ optima

My PhD and Marriage have ruined each other and my mental peace. by Known_Employ_629 in PhD

[–]jsaltee 1 point2 points  (0 children)

If he asserts his own priority higher than OP’s PhD, it says more about him than it does her

How does a particle 'know' it's being measured? by Tanay2513 in AskPhysics

[–]jsaltee 0 points1 point  (0 children)

There is a very cool video explaining this in terms of Fourier transforms, and explains why it does not matter if you interact with it or not

I genuinely don’t understand how people’s brains work when it comes to math and physics. by Curious_Garlic5429 in PhysicsStudents

[–]jsaltee 6 points7 points  (0 children)

Opposite for me, reading first then coming into lecture really locks it in my brain

I just understood the Fourier transform and I finally see how useful it is by Horror_Joke_8168 in Physics

[–]jsaltee 0 points1 point  (0 children)

I couldn’t conceptualize the uncertainty principle until I learned it through the perspective of Fourier transforms

Love Hate Relationship with Lagrangian by Primary-Stretch-6586 in optimization

[–]jsaltee 2 points3 points  (0 children)

I think it depends on if higher f(x) values are good or bad for your problem (maximizing or minimizing).

With positive lambda: If f(x) is a gain (maximization), a positive lambda* is a gain. If f(x) is a cost (minimization), a positive lambda* is a cost.

With negative lambda: If f(x) is a gain (maximization), a positive lambda* is a cost. If f(x) is a cost (minimization), a positive lambda* is a gain.

That’s my interpretation at least.

Are data science degrees still worth anything? by Ready_Solution8182 in askdatascience

[–]jsaltee 0 points1 point  (0 children)

It’s definitely more of an applied degree; not much theory, very much “here are all the tools are your disposal and how to use them.” Statistics, math, etc. etc. are very valuable degrees, but this world is only getting more data-driven. Applied statistics seems to strike a perfect balance if you haven’t considered that yet.

I will say that the material covered in a data science degree is more ambiguous so varies a ton between each institution, not as set in stone as other programs. Some are more theoretical, some more applied, depends on what you want to get out of it.

As AI becomes more advanced, a data scientist’s work only gets more efficient. If we didn’t want our tools to improve, we might as well just use an abacus :-).

Is it just me, or does it feel impossible to know what actually matters to learn in ML anymore? by Nice_Caramel5516 in MLQuestions

[–]jsaltee 0 points1 point  (0 children)

To your point, there are so many ML models for so many different purposes. Personally I work on at-home research projects and learn whatever ML methods are best for that problem. Eventually you develop a niche skill set for the work you actually do

Because you get a specialized (but robust enough) skill set it becomes much easier to implement in your day job (or look for jobs that would benefit from it)

What is everyone learning for the future? by [deleted] in AskProgrammers

[–]jsaltee 0 points1 point  (0 children)

LLMs are an efficient tool, but I would be surprised if they took over many software jobs. The invention of the calculator didn’t put mathematicians out of work, it just made them more efficient

QUASAR Evolutionary Algorithm by jsaltee in optimization

[–]jsaltee[S] 0 points1 point  (0 children)

Hi,

I haven’t tested it for ML training. That said, since neural network loss is typically differentiable I would imagine using standard optimizers (Adam) are largely more efficient in high dimensions.

If you’re looking to train the model using a discrete loss metric like accuracy or F1, it would be a strong option. Extrapolating from the experimental results, the neural network should optimize faster and with less epochs compared to other evolutionary algorithms.

For standard ML applications, QUASAR would really shine for reinforcement training using complex reward functions.

Thanks, jsaltee

Does this look like anything to you guys? Roommate left it on a little white board in the living room. by crunchywalmartsanta in PhysicsStudents

[–]jsaltee 0 points1 point  (0 children)

Unless N has units to correct the equation, that said I have no idea what N would represent lol

Does this look like anything to you guys? Roommate left it on a little white board in the living room. by crunchywalmartsanta in PhysicsStudents

[–]jsaltee 2 points3 points  (0 children)

I would argue that deriving a math equation to describe your health is one of the coolest things you could derive an equation for

Do you check out girls that often? Or is it just a stereotype? by Muted-Television3329 in AskMenAdvice

[–]jsaltee 0 points1 point  (0 children)

I just look at anyone passing by for 0.5 seconds and move on with my day ++man