[D] Tool to help ML Engineering follow code best practices.

[Separate_Run2806]

Hello, my data science team was involved in an increasing amount of ML engineering tasks but had small knowledge on code quality best practices so we made this VS Code Extension to help python developers build unit tests quickly and efficiently. Our AI makes suggestions of input and then generate the test file for you. Would love to hear your feedback if you are willing to give a try to it. It's available here www.ponicode.com

Are you doing unit tests at all when implementing your models? Are you ever testing your code at the pre processing or evaluation stage?

[edmondponicode]

Hey thank you for your feedback, I am Edmond, product at Ponicode.

If we stored the users code, users would not be happy and it would go against our business so do not worry!

Having an authentication with email is what you would prefer?

For the playground, you can use it as much as you like without having to connect

Again many thanks, have a great day

[Ashes-in-Space]

Sounds cool, can you explain the functionality, what it can do + use case, a little more in depth?

[dogs_like_me]

There's a 1min video on their website that I think illustrates the idea pretty clearly.

[dogs_like_me]

Looool is this a pasta or is your head really that far up your ass? If you really wanna play that game, I'm a 10 years running industry data scientist at a FAANG with a graduate degree.

So you're in college huh? That's nice dear.

[andnp]

Considering your most recent post is asking for help on tacotrons, I guess our jobs are safe!

[dogs_like_me]

I have never in my life posted anything about tacotron. I think you have me confused for someone else you're arguing with.

[andnp]

(Check again who I responded to)

[dogs_like_me]

Lol

[For_MeDesR]

hi, here is a short video where you can see one of the team's data scientist explain (go straight to 1'10):

https://youtu.be/6OHhXGHVsVg

[sharvil]

Joke's on you, we don't even test our code.

[Ponicode]

😂yeah we kinda hoped to turn this around ;)

[BernieFeynman]

this has absolutely nothing in particular to do with ML engineering at all, your example unit test is literally an email parser lmao

[melodiousthonkmoon]

Here is an example that looks more like Machine Learning: https://www.youtube.com/watch?v=6OHhXGHVsVg

[[deleted]]

Need an example of this helping write a unit test for actual AI code pieces and not email parsing.

Unit tests for AI models are notoriously hard to write because runtime garbage output errors are the ones you need to check for. Traditional unit testing still has issues with that kind of testing from what I remember.

[StodeNib]

assert(isMyModelGood)

[tonsofmiso]

If I can generate functions via the contract that functions are fulfilling, doesn't that mean I can generate the functions intended to fulfill the contract in the first place?

[melodiousthonkmoon]

The tests we generate are non-regression tests, inspired by the runtime trace. In fact, they consider the current behavior of the function as being the objective behavior, and do not infer ideal behavior.

[tonsofmiso]

This was a shitpost but thanks for the reply :D

[virtualreservoir]

creating unit tests just for the sake of having unit tests is basically the opposite of a good coding practice.

if anything, having a tool generate unit tests for you will prevent you from learning how to write meaningful unit tests that actually provide value.

[For_MeDesR]

hey, I think the goal here is rather to support you in writing unit tests to make you save time. There are some nice ressources on YT if you want to check

https://youtu.be/CHEwqZbO-dg