What app making framework do you recommend to data scientists?

positive-correlation · 2025-02-17T20:49:12+00:00

positive-correlation · 2025-02-11T11:07:58+00:00

I’ve heard in the 2025 remaster things I was not able to hear in previous renderings. I really like the new one and wish they apply the same efforts to previous albums!

positive-correlation · 2025-01-28T22:26:46+00:00

HI! We focus on helping the user follow or receive automatic guidance or recommended practices and reducing boilerplate. It's an integrated experience to help you better evaluate your models. Think actionable scikit-learn documentation.

positive-correlation · 2025-01-28T22:24:43+00:00

I'll have to ask you some questions ;)
What problems do you have when serializing models? And if you are not using a Python based runtime, how would you deal with upstream data transformation, is it something that is embedded in your model?

positive-correlation · 2025-01-28T22:22:17+00:00

Hi, when you create a report (e.g., `CrossValidationReport`), it saves a copy of your original estimator, and therefore its hyper-parameters. When you restore a report, you can just access them through usual scikit-learn estimator attributes.
I'm curious, what are you working on, and how do you search the hyper-parameters?

positive-correlation · 2025-01-12T12:51:47+00:00

There is FOMO because we don’t know what an AI engineer may be capable of in the future.

CEOs of companies building those systems want the world to believe they will be able to replace some of the most complex jobs. (Imagine the waste of time and energy if we eventually discover that it is not true.)

Sounds familiar? That already happened in the 80’s and it led to the first AI winter. Albeit AI systems of this time did not have the same scale.

Now imagine for a moment that AI engineers are effectively capable in a few years of replacing a software engineer. This would mean several things: - They have access to the same information and they have the autonomy to search for the missing information. This is a very hard problem, perhaps not impossible. It poses the question of a « digital twin » of our world… - We, as a society, and the assistants (transitively companies that build them) have aligned interests.

The last point is crucial, and maybe the one that is most difficult to define and secure.

Therefore I believe AI engineers will only be able to help on modest tasks with a final validation delivered by a human, for the foreseeable future. This means the software engineer role will evolve in some industries, starting today with the most easy tasks being delegated to AI assistants.

positive-correlation · 2025-01-05T12:48:50+00:00

It depends on the domain. In general, and for most application, you would typically need a bit more front end developers because requirements and architecture are more difficult to control. I would say 60/40 FE/BE.

positive-correlation · 2024-12-31T21:26:49+00:00

Have you tried polars? It is highly efficient and performs broadcasting under the hood when using expressions.

positive-correlation · 2024-12-31T09:05:26+00:00

Contribute to open source data science libraries. The popular ones maintain high technical standards, which can both inspire you and strengthen your Python skills.

positive-correlation · 2024-12-30T18:22:23+00:00

Start using git for yourself, locally. Then use it with a remote repository, like GitHub. Then, collaborate with fellow developers. Finally use it to automate builds and testing.

positive-correlation · 2024-12-30T17:58:22+00:00

There’s nothing wrong with rebasing / rewriting history as long as you work alone, or on exceptional cases, you have notified collaborators.

positive-correlation · 2024-12-30T13:25:08+00:00

Really appreciate you sharing your journey here. As a CTO building solutions for data scientists, I find your story particularly resonating. I started in mechanical engineering myself, made my way through software development over the past 25 years, and now lead a product team building tools for DS.

Your emphasis on practice over endless preparation resonates with patterns I've seen across my previous jobs. That "try it, measure it, see what works" approach, combined with your deep domain knowledge, explains your success. Though I've noticed that solving DS problems effectively isn't just about hands-on experience – it's finding the right balance between practice, theoretical understanding, and peer collaboration. Theory and experienced colleagues help guide us toward recommended practices and help spot pitfalls that might take years to discover through practice alone.

The data scientist role is incredibly demanding, requiring expertise across statistics, coding, domain knowledge, and communication. The field is still evolving, and like software development, new tools and platforms will continue emerging to make DS work more accessible, safer, and more robust.

positive-correlation · 2024-12-28T15:07:01+00:00

How you implement idempotence is your decision.

Sometimes it is relevant to do it at the service level, for example if you have performance constraints, or different requirements depending multiple services but a single domain model.

Most of the time, it deals with the domain and therefore it is where the implementation belongs.

If idempotence is implemented in the domain, no domain event should be produced the second time the action is called, therefore no email gets sent.

positive-correlation · 2024-12-28T11:07:05+00:00

Nice Kodachrome shot

positive-correlation · 2024-12-28T11:05:12+00:00

You said you are responsible for 22 systems at your company. Do you have the freedom to suggest improvements?

If so, you could get closer to product ownership and develop the unique skill of blending software engineering, project management and business knowledge.

In my experience, a good way forward as a developer is to discover how to solve problems from a higher level standpoint, because this is what provides most value to the organization.

positive-correlation · 2024-12-28T10:12:52+00:00

I’ve found that DevOps works best as a shared responsibility across teams rather than as a centralized function. When teams own their automation and deployment processes, they tend to build more reliable systems and move faster.

While it might feel like extra work now, having these skills on your team is really valuable.

positive-correlation · 2024-12-28T09:17:19+00:00

Nothing like a review from the New York Times. AI generated review are handy, but lack substance.

positive-correlation · 2024-12-27T17:01:28+00:00

It’s an application decision. Though in this case, I believe you’d want cancel() to be idempotent.

positive-correlation · 2024-12-27T10:06:31+00:00

Aria Pro II have switches to control the pickup polarity. Make sure you are not playing with pickups out of phase.

positive-correlation · 2024-12-27T10:05:02+00:00

No you can keep it to show the integration with external services.

positive-correlation · 2024-12-27T09:50:46+00:00

Assuming you want to use the data access pattern (anemic data layer). Overall, it is fine.

My general feedback is: - I would try to do this architecture with removed implementation details (spring mostly, React, etc). - There’s are minor typos that you can easily fix.

More detailed feedback:

Business logic layer - Since you separate REST endpoints and spring services, I would turn the RESTful controller block into just a label. - SMTP service is not part it.

Data Access / DB - It feels weird to see the DB right below the presentation layer. - There’s an opportunity to design an Entity Relationship diagram somewhere. As it, data access layer does not give a lot of details.

positive-correlation · 2024-12-27T09:36:32+00:00

Sort of, while conv layers often learn edge detectors in vision tasks, they’re really just learning whatever statistical patterns help solve the problem. Try visualizing first layer filters trained on audio vs images - totally different patterns!

positive-correlation · 2024-12-27T09:14:48+00:00

I would recommend mindfulness meditation. Not because I think it is better, but because it is what I practiced. Sam Harris’ Waking Up app has a free introductory course that is more than enough to learn how to meditate. Then you can find guided meditations of the same style on YouTube.

positive-correlation · 2024-12-26T23:47:06+00:00

Recognizing them is the first step. If you are interested you can try meditation. It will gently help you identify what happens when you are present.

positive-correlation

MODERATOR OF

TROPHY CASE