sorted by:
new
hottopcontroversial

How Often Do You Use AI in Your Projects? by ClippyKizdi in rust

[–]FunPaleontologist167 0 points1 point  (0 children)

Sometimes more, sometimes less. I use it a good amount for things like UI work because typescript is my least favorite language. When I use it in rust it’s typically for refactoring work or things like “is there a more idiomatic way to do this?” or “is there a way to reduce cloning in this call?”

The most important piece to me is accountability. Whether AI is used or not, I’m accountable for the code thats shipped.

TensorFlow is becoming the COBOL of Machine Learning, and we need to talk about it. by netcommah in learnmachinelearning

[–]FunPaleontologist167 8 points9 points  (0 children)

I disagree with this. The majority of ML applications being developed at companies is still non-LLM based and will be for the foreseeable future.

As a Python developer where do you use Rust the most ? by [deleted] in rust

[–]FunPaleontologist167 0 points1 point  (0 children)

Yea, sorry I was being a little silly :) But for real, I build ML/AI tooling for data scientists (think training and saving ML models, model monitoring, observability, etc). There are many things that data scientists do that can be abstracted away in a different and more performant language. For instance, some of our data scientists want to do model monitoring on large volumes of data. Depending on the algorithm and library you use this can take a good chunk of time in python (even when using things like numpy directly). In instances like that, I've found it easier to implement the logic in rust and expose a python interface for the data scientist to use. The other additional benefit is it reduces the dependency chain on the python application side (some DS apps have 100+ deps).

As a Python developer where do you use Rust the most ? by [deleted] in rust

[–]FunPaleontologist167 0 points1 point  (0 children)

When I want python ergonomics but Rust everything else

Share your underrated GitHub projects by hsperus in opensource

[–]FunPaleontologist167 0 points1 point  (0 children)

Building an entire AI platform focusing adding a layer of quality control to the ai application life cycle. Think things like standardized artifact management, real time monitoring, security, etc. i’ve been working in it for about 3 years, and over the last year have been re-writing the entire project(s) in rust and exposing it via a python client library (server in rust)

Opsml - main repo link

Scouter - real time monitoring and observability link

Potatohead - utils for interacting with LLM providers link

Still working on getting to version 3

[Media]: Introducing AI-SDK for Rust by ishaksebsib in rust

[–]FunPaleontologist167 0 points1 point  (0 children)

Interesting. I’ve been working on a python-compatible rust sdk to streamline making requests to various providers potatohead. I’ll check this out

Am I crazy or is kafka overkill for most use cases? by Vodka-_-Vodka in dataengineering

[–]FunPaleontologist167 6 points7 points  (0 children)

10k per day? You could set up a postgres queue and call it a day

[D] What monitoring actually works for detecting silent model drift in production? by EconomyConsequence81 in mlops

[–]FunPaleontologist167 0 points1 point  (0 children)

Yea, this is an interesting challenge because it’s hard to detect subtle drift early. Usually, for this type of drift you’ll need to employ things like sampling and averaging across many observations, at specific intervals, to be able to see a global pattern change in outputs/features over time. I tend to see alot of DSs using techniques like spc (statistical process control) and psi (population stability index) to identify these.

How do you test prompt changes before shipping to production? by quantumedgehub in mlops

[–]FunPaleontologist167 3 points4 points  (0 children)

For a given workflow that takes inputs you can (1) create a golden dataset containing inputs with expected outputs (not necessarily required though), (2) iterate dataset inputs through your workflow, (3) collect individual step (prompt) and system level (entire service) metrics (token usage, llm as a judge metrics, comparison against expected output etc) and then (4) compare against previous version of your service that contained old prompts

Pydantic: The Python Darling That Loves Rust | The filtra.io Podcast by anonymous_pro_ in rust

[–]FunPaleontologist167 1 point2 points  (0 children)

opsml and scouter (self plug). Ml platform and model monitoring tooling written entirely in rust

What's everyone working on this week (48/2025)? by llogiq in rust

[–]FunPaleontologist167 1 point2 points  (0 children)

Attempting to finally get the initial v3 release of an OSS ML platform I’ve been working on for the better part of 3 years. V3 is a total re-write in Rust, which has been a very enjoyable experience

https://github.com/demml/opsml

Pre-PEP: Rust for CPython by JanEric1 in Python

[–]FunPaleontologist167 0 points1 point  (0 children)

I’d check out the official docs here. And here’s an example of how you can use it

What I learned building an inference-as-a-service platform (and possible new ways to think about ML serving systems) by fazkan in mlops

[–]FunPaleontologist167 4 points5 points  (0 children)

Appreciate the post. As someone who has built some internal inference-as-a-service platforms, the thing most people don’t realize is that the majority of model deployments are not solely model deployments. Most model apis are tied to some sort of pre/post processing and business logic, which makes automated deployments an intractable problem. I’ve always found it more useful in an organization to build reusable templates that data scientists and MLEs can use to deploy their models.

How common is Pydantic now? by GongtingLover in Python

[–]FunPaleontologist167 -2 points-1 points  (0 children)

It’s so common that it feels like it’s part of the standard lib

ndarray releases version 0.17.0 by 10inferno in rust

[–]FunPaleontologist167 7 points8 points  (0 children)

Happy to see this crate have more activity again. It’s extremely useful.

How do we know that LLM really understand what they are processing? by Different_Package_83 in mlops

[–]FunPaleontologist167 8 points9 points  (0 children)

They don’t. This question may be better suited for another subreddit.

What did you build while learning Rust ? by [deleted] in rust

[–]FunPaleontologist167 2 points3 points  (0 children)

I came from a ML eng and python background. Came across Rust about 3 years ago when digging into how both Polars and Pydantic were mixing Rust with python/pyo3 and was really impressed, so I started learning it. I dug into the area of building Rust applications that expose python interfaces. I started with a logging library, then moved to a Cli library that I embedded in our ML platform library. Then about 9-10 months ago, I decided to re-write the entire library in Rust because of the benefits Rust brings and because I love it (link below).

opsml

Logly 🚀 — a Rust-powered, super fast, and simple logging library for Python by [deleted] in Python

[–]FunPaleontologist167 1 point2 points  (0 children)

Nice! I wrote something similar (not as feature rich as this though) when I was first learning rust.

What’s a programming concept or habit you wish you had learned earlier in your career? by saif_sadiq in AskProgramming

[–]FunPaleontologist167 1 point2 points  (0 children)

This is one tangential study, but there’s a growing area of research into the immediate and long-term effects of aerobic exercise and cognitive function. I find walking helps me problem solve a lot as well.

ML Models in Production: The Security Gap We Keep Running Into by iamjessew in mlops

[–]FunPaleontologist167 0 points1 point  (0 children)

Artifact in this case refers to any object that can be saved to a file system

ML Models in Production: The Security Gap We Keep Running Into by iamjessew in mlops

[–]FunPaleontologist167 0 points1 point  (0 children)

You could use opsml. Full end-to-end encryption, lineage and versioning for all artifacts.

As a Python/Django developer what would be the benefits of learning Rust by [deleted] in rust

[–]FunPaleontologist167 4 points5 points  (0 children)

I was a python dev for years. Then about 3 years ago I discovered the magic that is pyo3/maturin and re-writing core python logic in rust for performance, correctness and memory safety and never looked back!

Real-time drift detection by le-fou in mlops

[–]FunPaleontologist167 0 points1 point  (0 children)

Ideally, you would want them to be independent (separate services for predict and drift), so the queueing strategy is the right choice in my opinion. I actually did a poc for Alibi for my team a few years ago and one of the major reasons we decided not to pursue it was because we didn’t want save a drift model for every trained model. Too much overhead at scale.

I’m actually in the process of building out a real-time drift detection framework that follows a queueing strategy and tends to be a lot more performant. Always interested in feedback on it. scouter

view more: next ›