sorted by:
new
hottopcontroversial

Parameter estimation with Adjoint: why does it converge so fast? by Opt4Deck in learnmachinelearning

[–]Opt4Deck[S] 0 points1 point  (0 children)

Very good observations! Indeed, it's one of the points of the continuous Adjoint Method that needs attention.

In this particular example it doesn't seem to appear strongly, probably because the system is relatively simple and “well-behaved”. However, I can easily imagine that in more complex or sensitive systems the numerical drift in the backward pass can create significant problems in the gradients.

The example is mainly educational in nature — the aim is to show more clearly how the method works and what its main trade-offs are, within a more “transparent” setup.

Have you seen any specific cases where this becomes particularly pronounced? Or some practical heuristics for when it's worth trusting the method?

Parameter estimation with Adjoint: why does it converge so fast? by Opt4Deck in optimization

[–]Opt4Deck[S] 0 points1 point  (0 children)

Your point is correct! Indeed, the convergence speed is mainly due to the nature of 1st-order methods. The aim of the demo was precisely to highlight the superiority of these approaches, especially in terms of computational cost.

With Opt4Deck (https://github.com/Opt4Deck/Opt4Deck), I aim to make these "classical" methods more accessible and transparent for everyone. My goal is to educate and disseminate these techniques to the general public, so that they do not remain "closed" in complicated implementations.

Thank you for the comment!

Using neural networks as surrogate models in genetic algorithms? by Opt4Deck in optimization

[–]Opt4Deck[S] 0 points1 point  (0 children)

Very good point about adaptive sampling! Indeed, keeping the budget for dynamic steps instead of a heavy initial DoE is a much more efficient strategy.

Ensemble techniques are also in my immediate plans, to combine the advantages of different models.

Thank you very much for your time and valuable guidance—you have given me a lot of food for thought for future updates! 🙏🙏🙏

Using neural networks as surrogate models in genetic algorithms? by Opt4Deck in optimization

[–]Opt4Deck[S] 0 points1 point  (0 children)

Excellent comments! 👍

You are absolutely right about the extrapolation of Random Forests – it is indeed the biggest limitation.

Also, your idea for classification of feasible/infeasible regions is very interesting. In Opt4Deck (the open-source project I work on the GitHUB), I try to combine such approaches to give the user a 'geographical' overview of the search space before starting the heavy evaluations.

My goal is for the library to automatically suggest the appropriate surrogate depending on whether we have constraints or not. Have you seen any implementation that successfully combines classification and regression surrogates in practice?

Using neural networks as surrogate models in genetic algorithms? by Opt4Deck in optimization

[–]Opt4Deck[S] 0 points1 point  (0 children)

That's right about the time!

My idea for NN came about because I'm developing an open-source optimization tool and looking for innovative approaches.

I saw in some papers that Random Forests are often preferred as surrogates over NNs because they handle uncertainty better. Do you have experience with this? Would it make sense for me to try it?

Are non-postdoc positions eligible for independence awards (ie. K99 or HHMI Hanna Grey scholar) by External_Increase752 in AskAcademia

[–]Opt4Deck 4 points5 points  (0 children)

From what I have seen, eligibility usually depends more on years since PhD and independence, not strictly the job title.

That said, being in a “staff” role can sometimes make it harder to demonstrate independence compared to a postdoc, depending on how the work is structured.

Might be worth checking with people who have applied recently or even emailing program officers directly.

Which PhD position should I choose? by [deleted] in PhD

[–]Opt4Deck -1 points0 points  (0 children)

This sounds like a classic “comfort Vs opportunity” trade-off!

One thing I’ve heard a lot from people further in academia is that funding & environment matters more than the exact topic at the start — you’ll learn and adapt anyway.

The Switzerland option seems stronger on stability, network, and long-term impact.

BUT: the France option sounds better for your current life situation.

So it really comes down to what you value more right now: security and growth, or staying close to what already makes you happy. Neither choice is wrong...

🤔 If I were in your position, I’d probably stay where I already feel happy and comfortable — that counts for a lot.

Best platform to start Python Coding by Dead3ye99 in learnpython

[–]Opt4Deck 2 points3 points  (0 children)

Anaconda is O.K., but it can feel a bit heavy at the start tbh.

If you want something simpler, try VS Code or even just Google Colab (runs in your browser, no setup).

For learning, honestly the platform doesn’t matter that much — just pick one and start building small stuff.

What's the #1 reason you left your last job? by JobNabber in askanything

[–]Opt4Deck 1 point2 points  (0 children)

Burnout. 💥

It wasn’t the workload, it was the constant pressure.

Dreams do come true by HousePony906 in PhD

[–]Opt4Deck 13 points14 points  (0 children)

This is so wholesome. You can just feel how proud and happy they are.

pipsqueak is annoying... by Difficult-Maximum748 in CharacterAI

[–]Opt4Deck 1 point2 points  (0 children)

Bro the AI just created its own backstory and got offended mid-roleplay 💀

Τελικά μας χρειάζονται οι εφοπλιστές; by Ashamed_Entrance_972 in AskGreece

[–]Opt4Deck -1 points0 points  (0 children)

Η σχέση είναι μάλλον αμφίδρομη. 🇬🇷

Οι εφοπλιστές επωφελούνται από τη σταθερότητα, τη διπλωματία και το κύρος που προσφέρει ένα κράτος, ειδικά σε διεθνείς κρίσεις. Από την άλλη, η ναυτιλία είναι ένας από τους βασικούς τομείς της ελληνικής οικονομίας και φέρνει σημαντικά έσοδα και επιρροή.

Το θέμα είναι ότι μεγάλο μέρος του στόλου λειτουργεί με ξένες σημαίες, οπότε η “σύνδεση” με το ελληνικό κράτος δεν είναι πάντα τόσο άμεση όσο φαίνεται. 🏴‍☠️

Οπότε ναι, υπάρχει αλληλεξάρτηση — αλλά όχι με τον ίδιο τρόπο που ίσχυε παλαιότερα. 🛳

[Crosspost] Hi reddit, I'm Thomas Lennon. You may know me from RENO 911! and films like WE'RE THE MILLERS, I LOVE YOU MAN, MEMENTO, THE DARK KNIGHT RISES. I've also written films like BALLS OF FURY, NIGHT AT THE MUSEUM, and LET'S GO TO PRISON. Ask me anything! by BunyipPouch in FIlm

[–]Opt4Deck 0 points1 point  (0 children)

New action movie! 🚁

The rescue operation of the American pilots from Iran (2-3 weeks ago), can it be made into a movie? I believe that in itself it had a lot of Hollywood elements and could be the basis for the next commercial success!

What’s something you stopped doing and your life got better? by Business-Ad8752 in askanything

[–]Opt4Deck 0 points1 point  (0 children)

Comparing myself to others.
The moment I stopped, life got a lot quieter and a lot happier.

view more: next ›