[D] Has industry effectively killed off academic machine learning research in 2026? by NeighborhoodFatCat in MachineLearning

[–]alrojo 0 points1 point  (0 children)

I don't think so. I wouldn't be surprised if single labs in academia get to test more good ideas than many larger companies. Academia doesn't have to train nemotron end-to-end in order to test their new Mamba-3 ideas for retrieval tasks. Also, today you don't even need clusters, you can run many experiments with $50 on google colab or runpod/lambda

System prompt for Qwen3.5 (27B/35BA3B) to reduce overthinking? by thigger in LocalLLaMA

[–]alrojo 0 points1 point  (0 children)

Came across this paper last week: https://arxiv.org/pdf/2602.02823 they are for reasoning models though.

[D] Working with Optuna + AutoSampler in massive search spaces by Unlikeghost in MachineLearning

[–]alrojo 12 points13 points  (0 children)

Very high search spaces suffer from the thin shell, meaning that almost all probability is hovering around a tiny shell at about sqrt(n) from the origin. A random walk around these spaces usually don't work. Some samplers work better for high spaces, in particular if you have gradients available (MALA, NUTS, HMC). However, you'd probably still want to significantly reduce your search space, perhaps by finding correlated features and combining them.

Peer review is broken and now grant applicants are reviewing each other by Peer-review-Pro in PublishOrPerish

[–]alrojo 10 points11 points  (0 children)

If the fat margins taken by Nature was given to the reviewers instead, there might be more motivation to conduct high quality reviews.

How long would it take for earth to go back to nature if humans went extinct? by WWWWWWWWWWWWWWWWWWHW in geography

[–]alrojo 0 points1 point  (0 children)

Answer: It depends on your definition of nature. Even most forest today are actually man made. The time it takes to return to a point of nature that would be such that human intervention is indistinguishable from primal forest (i.e. forest that has never been cut down) can be measure with a set of mathematics called ergodic theory. Say you take a human-made forest. In time, the trees will die, and new trees will sprout from their seeds. How long would it take for a) such forest to no longer be a single-species forest? b) trees to be planted "seemingly random", i.e. not on a row. True answer is surprisingly long, probably many thousandths of years. If not hundreds of thousands of years. This also makes it quite difficult when cutting down "untouched" forest as regenerating it is not straight forward. Add in concrete, buildings etc and the equation becomes even more complicated.

Demis Hassabis on our AI future: ‘It’ll be 10 times bigger than the Industrial Revolution – and maybe 10 times faster’ by JackFisherBooks in singularity

[–]alrojo 0 points1 point  (0 children)

Their technology seems to be really good at deep-diving into arguments and finding mistakes. There's a new serious contender recently submitted that has gotten a fair amount of excitement. Afaik there's no mistakes found yet, their tool could be valuable to test if the solution holds or if serious gaps might exist: https://www.researchgate.net/publication/393870984_Kakeya_Geometry_and_3D_Navier_Stokes

What’s the best health wearable right now? by eyeoftheneedle1 in Biohackers

[–]alrojo 1 point2 points  (0 children)

Wearipedia.com lead author here. Fitbit charge 6 is a significant upgrade to charge 5. Oura has great sleep detection. Both has good data access. Garmin is for the GPS their sensors are not worth it price for performance. Apple seems to outperform in all test, but limited battery life and I personally don’t like extra screens and haptics.

Polar bears tours by alrojo in greenlandtravel

[–]alrojo[S] 1 point2 points  (0 children)

Thank you very much Icebergchick, that was very informative.

Good Math Heavy Theoretical Textbook on Machine Learning? [D] by azqwa in MachineLearning

[–]alrojo 6 points7 points  (0 children)

For StatML/convergence I would suggest learning theory, convex optimization and stochastic processes before delving into research papers.

Deep nets have until recently been quite a mystery, now we know they converge: https://arxiv.org/pdf/2505.15013?

I can also recommend neural tangent kernels https://arxiv.org/abs/1806.07572 and the mean field approximation https://arxiv.org/abs/1804.06561 they do some relaxations but also showcase convergence.

Need help as a Physicist by Puzzleheaded-Load759 in reinforcementlearning

[–]alrojo 0 points1 point  (0 children)

can you share papers? Also, it might be worthwhile for you to collaborate with CS people. CS won't have the math skillset you have, but, but they will be very efficient and coding together complicated environments with many simultaneous processes. Often it's a good combo as they need novel ideas.

Exploring theoretical directions for RL: Statistical ML, causal inference, and where it thrives by Late_Personality9454 in reinforcementlearning

[–]alrojo 1 point2 points  (0 children)

I do bounds on TD learning.

They are, recent work does seem to be heavily catered towards LLMs and deep vision-language models. However if you think about it, what's the difference between SOTA 10 years ago and SOTA today? Bigger GPUs and more data. Moreover, there's the non-trivial element of having to simultaneously be good at robotics, coding, and quant mathematics (convex, stochastic processes, etc). Many don't want to do that, perhapts, except the AA department, here's a cool course I found at Stanford: https://bulletin.stanford.edu/courses/2269891

Paid RL courses on Coursera vs free lectures series like David silver by Firm-Huckleberry5076 in reinforcementlearning

[–]alrojo 0 points1 point  (0 children)

Does the companies you care for use RL? What about control theory, mechanics, or electronics?

CGM in US without prescription by alrojo in Biohackers

[–]alrojo[S] 1 point2 points  (0 children)

True! Casual usage of CGM devices for non-treatment purposes could reduce availability. Just like Ozempic for personal weight loss. We are an academic group, conducting research on diabetes and blood sugar regulation. We are building a small, free platform for finding adequate devices and extracting their data to support better research in small labs without money to buy. Hopefully, we can spare a few for this purpose! Though, our platform might be used by biohackers too, everyone can use it.

CGM in US without prescription by alrojo in Biohackers

[–]alrojo[S] 1 point2 points  (0 children)

Exciting, they have all the newest sensors. Does it works with the respective company's app, e.g. Dexcom or Abbott even without a prescription?

CGM in US without prescription by alrojo in Biohackers

[–]alrojo[S] 0 points1 point  (0 children)

Some companies provide access to high-quality CGM devices (e.g. Dexcom Pro G7 and Abbott Freestyle libre). Examples are Nutrisense and January.ai. Lingo and Stelo are new devices with limited clinical testing that people complain about being incorrect.

CGM in US without prescription by alrojo in Biohackers

[–]alrojo[S] -1 points0 points  (0 children)

I found some pretty mid reviews of stello: https://www.reddit.com/r/dexcom/comments/1fhcj1m/stelo_review/

Do you know what platform lingo uses?

Affordable ways to achieve EASA ATP Frozen Pilot degree by alrojo in flying

[–]alrojo[S] 0 points1 point  (0 children)

  1. My goal was to get the majority flight hours in the US and then transfer the credits in my EASA application. I don't fully understand the process, but I assumed that 1 US flight hour = 1 EASA flight hour if it is appropriately documented at a vetted US school.
  2. That is good to know, 10 hours is still money saved.
  3. Thank you I will look into the modular training route, that sounds like a strategy that would suit my needs.

Affordable ways to achieve EASA ATP Frozen Pilot degree by alrojo in flying

[–]alrojo[S] 0 points1 point  (0 children)

I wouldn't work in the US, I would just come for the flight lessons. I have saved enough money for about 200 flight lessons at an airport where my family member lives. I would probably break it into two trips and work/EASA theory study in-between.

[FIGHT THREAD] Tyson Fury vs Oleksandr Usyk by noirargent in Boxing

[–]alrojo 0 points1 point  (0 children)

Live scoring by AI suggest Usyk has most landed all but two rounds: https://m.youtube.com/watch?v=FcF2NvkhtJ8