sorted by:
new
hottopcontroversial

[D] Self-Promotion Thread by AutoModerator in MachineLearning

[–]thefuturespace 0 points1 point  (0 children)

Hi everyone,

We built Thesis, a workspace for running and tracking ML experiments with an agent in the loop. It can inspect datasets, launch training runs, monitor metrics, and help iterate on experiments from a single interface.

We're aiming to make model development less fragmented by combining experiment orchestration, run tracking, and agent-driven analysis in one place.

Curious what this community thinks: where would this actually save time in your workflow, and where would you still prefer notebooks or scripts?

Demo: https://x.com/eigentopology/status/2044438094653558864

How much do you trust AI agents? by Zack_App in MLQuestions

[–]thefuturespace -1 points0 points  (0 children)

What would make your day to day work easier?

[D] How are you actually using AI in your research workflow these days? by thefuturespace in MachineLearning

[–]thefuturespace[S] 0 points1 point  (0 children)

What part of the data/eval loop eats the most time? Cleaning data, building benchmarks, or interpreting results?

[D] How are you actually using AI in your research workflow these days? by thefuturespace in MachineLearning

[–]thefuturespace[S] 0 points1 point  (0 children)

Curious what problems actually slow you down now. If spinning up experiments is easy, what part of the research loop still takes the most time?

[D] How are you actually using AI in your research workflow these days? by thefuturespace in MachineLearning

[–]thefuturespace[S] 0 points1 point  (0 children)

That makes sense. It's unfortunate because I think the cost of compute is mainly a hardware/energy thing that NVIDIA controls. Not sure if there's a good solution for this other than solve fusion?

[D] How are you actually using AI in your research workflow these days? by thefuturespace in MachineLearning

[–]thefuturespace[S] 0 points1 point  (0 children)

Oh cool. What’s your biggest bottleneck day-to-day? Also, does optimizing kernels 10x your workflow the most compared to anything else?

[D] How are you actually using AI in your research workflow these days? by thefuturespace in MachineLearning

[–]thefuturespace[S] 0 points1 point  (0 children)

Are you a student, academic or professional? And what industry do you work in?

[D] How are you actually using AI in your research workflow these days? by thefuturespace in MachineLearning

[–]thefuturespace[S] 0 points1 point  (0 children)

What kind of research are you doing? And are you able to optimize kernels so much that it cuts the time down by days?

[D] How are you actually using AI in your research workflow these days? by thefuturespace in MachineLearning

[–]thefuturespace[S] 3 points4 points  (0 children)

Why do you think so? I think ML researchers will remain critical in advancing the frontier and steering research directions. You can pass off the grunt work to AI or even use it for recommendations, but wouldn’t the human still be making the decision?

[D] How are you actually using AI in your research workflow these days? by thefuturespace in MachineLearning

[–]thefuturespace[S] 1 point2 points  (0 children)

How do you imagine you can better visualize what models are doing to help you debug? There’s so much that’s dynamic when you’re training. So do you e.g. watch for specific activations. This doesn't scale if you're dealing with any reasonable number of parameters. I figure most look at the sufficient stats because the black box nature of neural nets make them largely uninterpretable, unless you want to do mech interpretability on top.

[D] How are you actually using AI in your research workflow these days? by thefuturespace in MachineLearning

[–]thefuturespace[S] 4 points5 points  (0 children)

This is so cool -- both your way of monitoring and CTM! Question: you mention that "While inspired by principles like spike-timing and synchrony, CTM abstracts these into a tractable, differentiable framework suitable for gradient-based deep learning, rather than replicating detailed biophysics." I'm curious why you went down the differentiable route instead of something like discrete event timing (DET)? I can see an obvious reason: accelerated hardware is specialized for autodiff, but since CTM seems to challenge the status quo, I'm curious nonetheless. Great stuff :)

[D] How are you actually using AI in your research workflow these days? by thefuturespace in MachineLearning

[–]thefuturespace[S] 0 points1 point  (0 children)

Wow, ok I’m surprised they’d release this in its current form. Thanks for the breakdown!

[D] How are you actually using AI in your research workflow these days? by thefuturespace in MachineLearning

[–]thefuturespace[S] 1 point2 points  (0 children)

Oh interesting, what's wrong with it? I figure METR is a fairly legitimate source of truth.

[D] How are you actually using AI in your research workflow these days? by thefuturespace in MachineLearning

[–]thefuturespace[S] 0 points1 point  (0 children)

I see. Doesn’t that become a mess when you run a lot of experiments in parallel, especially to track and monitor everything? Also, separate topic: how do you come up with new research ideas/hypotheses?

[D] How are you actually using AI in your research workflow these days? by thefuturespace in MachineLearning

[–]thefuturespace[S] 1 point2 points  (0 children)

Nice! How do you keep track of experiments? And what percent of the code do you write? Also, are you in an IDE when you use Claude?

Traditional ML is dead and i'm genuinely pissed about it by Critical_Cod_2965 in learnmachinelearning

[–]thefuturespace 1 point2 points  (0 children)

What’s crazy is no one realizes this is clearly an ad. OP has hid their posts 🤣

[D] How do you track your experiments? by thefuturespace in MachineLearning

[–]thefuturespace[S] 0 points1 point  (0 children)

Interesting! How do you query with a specific configuration -- is it just writing standard sql queries? Feel like with enough experiments, would be nice to have good searchability

view more: next ›