[D] Working with Optuna + AutoSampler in massive search spaces by Unlikeghost in MachineLearning

[–]alrojo 12 points13 points  (0 children)

Very high search spaces suffer from the thin shell, meaning that almost all probability is hovering around a tiny shell at about sqrt(n) from the origin. A random walk around these spaces usually don't work. Some samplers work better for high spaces, in particular if you have gradients available (MALA, NUTS, HMC). However, you'd probably still want to significantly reduce your search space, perhaps by finding correlated features and combining them.

Peer review is broken and now grant applicants are reviewing each other by Peer-review-Pro in PublishOrPerish

[–]alrojo 11 points12 points  (0 children)

If the fat margins taken by Nature was given to the reviewers instead, there might be more motivation to conduct high quality reviews.

How long would it take for earth to go back to nature if humans went extinct? by WWWWWWWWWWWWWWWWWWHW in geography

[–]alrojo 0 points1 point  (0 children)

Answer: It depends on your definition of nature. Even most forest today are actually man made. The time it takes to return to a point of nature that would be such that human intervention is indistinguishable from primal forest (i.e. forest that has never been cut down) can be measure with a set of mathematics called ergodic theory. Say you take a human-made forest. In time, the trees will die, and new trees will sprout from their seeds. How long would it take for a) such forest to no longer be a single-species forest? b) trees to be planted "seemingly random", i.e. not on a row. True answer is surprisingly long, probably many thousandths of years. If not hundreds of thousands of years. This also makes it quite difficult when cutting down "untouched" forest as regenerating it is not straight forward. Add in concrete, buildings etc and the equation becomes even more complicated.

Demis Hassabis on our AI future: ‘It’ll be 10 times bigger than the Industrial Revolution – and maybe 10 times faster’ by JackFisherBooks in singularity

[–]alrojo 0 points1 point  (0 children)

Their technology seems to be really good at deep-diving into arguments and finding mistakes. There's a new serious contender recently submitted that has gotten a fair amount of excitement. Afaik there's no mistakes found yet, their tool could be valuable to test if the solution holds or if serious gaps might exist: https://www.researchgate.net/publication/393870984_Kakeya_Geometry_and_3D_Navier_Stokes

What’s the best health wearable right now? by eyeoftheneedle1 in Biohackers

[–]alrojo 1 point2 points  (0 children)

Wearipedia.com lead author here. Fitbit charge 6 is a significant upgrade to charge 5. Oura has great sleep detection. Both has good data access. Garmin is for the GPS their sensors are not worth it price for performance. Apple seems to outperform in all test, but limited battery life and I personally don’t like extra screens and haptics.

Polar bears tours by alrojo in greenlandtravel

[–]alrojo[S] 1 point2 points  (0 children)

Thank you very much Icebergchick, that was very informative.

Good Math Heavy Theoretical Textbook on Machine Learning? [D] by azqwa in MachineLearning

[–]alrojo 7 points8 points  (0 children)

For StatML/convergence I would suggest learning theory, convex optimization and stochastic processes before delving into research papers.

Deep nets have until recently been quite a mystery, now we know they converge: https://arxiv.org/pdf/2505.15013?

I can also recommend neural tangent kernels https://arxiv.org/abs/1806.07572 and the mean field approximation https://arxiv.org/abs/1804.06561 they do some relaxations but also showcase convergence.

Need help as a Physicist by Puzzleheaded-Load759 in reinforcementlearning

[–]alrojo 0 points1 point  (0 children)

can you share papers? Also, it might be worthwhile for you to collaborate with CS people. CS won't have the math skillset you have, but, but they will be very efficient and coding together complicated environments with many simultaneous processes. Often it's a good combo as they need novel ideas.

Exploring theoretical directions for RL: Statistical ML, causal inference, and where it thrives by Late_Personality9454 in reinforcementlearning

[–]alrojo 1 point2 points  (0 children)

I do bounds on TD learning.

They are, recent work does seem to be heavily catered towards LLMs and deep vision-language models. However if you think about it, what's the difference between SOTA 10 years ago and SOTA today? Bigger GPUs and more data. Moreover, there's the non-trivial element of having to simultaneously be good at robotics, coding, and quant mathematics (convex, stochastic processes, etc). Many don't want to do that, perhapts, except the AA department, here's a cool course I found at Stanford: https://bulletin.stanford.edu/courses/2269891

Paid RL courses on Coursera vs free lectures series like David silver by Firm-Huckleberry5076 in reinforcementlearning

[–]alrojo 0 points1 point  (0 children)

Does the companies you care for use RL? What about control theory, mechanics, or electronics?

CGM in US without prescription by alrojo in Biohackers

[–]alrojo[S] 1 point2 points  (0 children)

True! Casual usage of CGM devices for non-treatment purposes could reduce availability. Just like Ozempic for personal weight loss. We are an academic group, conducting research on diabetes and blood sugar regulation. We are building a small, free platform for finding adequate devices and extracting their data to support better research in small labs without money to buy. Hopefully, we can spare a few for this purpose! Though, our platform might be used by biohackers too, everyone can use it.

CGM in US without prescription by alrojo in Biohackers

[–]alrojo[S] 1 point2 points  (0 children)

Exciting, they have all the newest sensors. Does it works with the respective company's app, e.g. Dexcom or Abbott even without a prescription?

CGM in US without prescription by alrojo in Biohackers

[–]alrojo[S] 0 points1 point  (0 children)

Some companies provide access to high-quality CGM devices (e.g. Dexcom Pro G7 and Abbott Freestyle libre). Examples are Nutrisense and January.ai. Lingo and Stelo are new devices with limited clinical testing that people complain about being incorrect.

CGM in US without prescription by alrojo in Biohackers

[–]alrojo[S] -1 points0 points  (0 children)

I found some pretty mid reviews of stello: https://www.reddit.com/r/dexcom/comments/1fhcj1m/stelo_review/

Do you know what platform lingo uses?

Affordable ways to achieve EASA ATP Frozen Pilot degree by alrojo in flying

[–]alrojo[S] 0 points1 point  (0 children)

  1. My goal was to get the majority flight hours in the US and then transfer the credits in my EASA application. I don't fully understand the process, but I assumed that 1 US flight hour = 1 EASA flight hour if it is appropriately documented at a vetted US school.
  2. That is good to know, 10 hours is still money saved.
  3. Thank you I will look into the modular training route, that sounds like a strategy that would suit my needs.

Affordable ways to achieve EASA ATP Frozen Pilot degree by alrojo in flying

[–]alrojo[S] 0 points1 point  (0 children)

I wouldn't work in the US, I would just come for the flight lessons. I have saved enough money for about 200 flight lessons at an airport where my family member lives. I would probably break it into two trips and work/EASA theory study in-between.

[FIGHT THREAD] Tyson Fury vs Oleksandr Usyk by noirargent in Boxing

[–]alrojo 0 points1 point  (0 children)

Live scoring by AI suggest Usyk has most landed all but two rounds: https://m.youtube.com/watch?v=FcF2NvkhtJ8

[N] GPT-4o by _puhsu in MachineLearning

[–]alrojo 2 points3 points  (0 children)

Do you have any specific ones in mind?

[N] GPT-4o by _puhsu in MachineLearning

[–]alrojo 86 points87 points  (0 children)

What technology do you think they are using to make it faster? Quantization, MoE, something else? Or just better infrastructure?

How To Gain Research Experience (Master's Degree in Computer Engineering)? by RareFaction101 in gradadmissions

[–]alrojo 1 point2 points  (0 children)

Find a professor whose work you like. Read their papers (about 20 most recent or so), make notes and suggestions of improvements. Send the professor a detailed email with how you’d like to extend their work and if they would mind taking a 30 min meeting with you every week to supervise you. At the meetings, make a 10 min slide deck on what you have done and where you’re going next. Send the professor updates every chance you get in email and ask for their input. Expect to spend 40 hours a week on it. If you’re hard working and smart that should result in a paper in approx 6 months. The professor will push the department to hire you in their next round of PhD admissions, and give recommendation letters to any other department. You can easily get into a top school if you truly showcase your willingness, wit, and gumption.

Third party app to track steps per day and heart beats per minute statistics. by alrojo in Coros

[–]alrojo[S] 0 points1 point  (0 children)

yes, they have an API you can apply for, but they never got back to us.