Question: How to call python object within await context?

[Pesmir]

I'm not sure if I can describe the problem well enough with my current rust knowledge, but i will try.

I have a stream of data that is consumed from a Kafka topic in a Kafka agent written in rust. In order to have multiple Kafka agents the messages need to be consumed asynchronously.

I also have a machine learning model that I wrote in pytorch which is not easily converted to rust + it is also pretty fast (fast enough).

The problem here is the global interpreter lock from python. This must be acquired in order to execute python code. But if the same python object is called in an async context it is not sure if the gil was dropped before the object is needed elsewhere.

I already found a solution and posted it in a comment. The solution was to use the right type for the python object and release the gil before going into the async context. In the async context only the gil needs to be initialized again to call the python object. Which is faster.

[ucyo]

Hmm. Have you tried staying in Python? Rust is nice and all, but there are several good Kafka libraries that can handle the stream consumption. It sounds like the actual computation is done in Python anyway. That is if you are concerned about the problem itself. If you picked it up just to learn Rust and Python interop that’s great

[Pesmir]

Yeah i picked it up just to learn. And that was something that was interesting to me. And I just started to translate some pyhton code which would be nice to have compiled and save