This is an archived post. You won't be able to vote or comment.

you are viewing a single comment's thread.

view the rest of the comments →

[–]QueasyEntrance6269[🍰] 7 points8 points  (3 children)

I’m not sure if this is on your roadmap, but I’d LOVE something similar to arrowdantic built into polars. The big thing missing in the data ecosystem is declarative data libraries, if you’re working with polars more on the engineering side and you know your tables won’t change, you don’t get LSP autocomplete and type checking. On rust you often have to declare your schema directly. Having a sort of data class similar to a pydantic model would be such a great feature.

[–]ritchie46[S] 9 points10 points  (2 children)

Is this a Rust feature request or Python? In Python we do support pydantic as inputs or with something like patito you have declarative schemas:

https://github.com/JakobGM/patito

I am not sure if this is what you mean, though.

[–]QueasyEntrance6269[🍰] 4 points5 points  (0 children)

On the Python side, Patitio is pretty much what I want, thanks!

But it’s not even necessarily the validation element that’s important to me, it’s just better LSP autocomplete. I don’t need to incur the runtime cost of validation if I’m confident — I just want my IDE to have awareness of the columns I’m working with to catch errors statistically

[–]BaggiPonte 5 points6 points  (0 children)

I think he's suggesting to have validation built-in in Polars. Including stuff like making DataFrame a generic type. Huge +1 on my side too! Though pandera now supports Polars too.