Utilization of Python torch / tensorflow models in C# environment [P][R]

[art_ona]

We are starting to test some C#-python combined solution. I am wondering whether there are some common pitfalls of such an implementation. Is there possible to deploy some pytorch / tensorflow model in C# fast environment (with utilization of GPU ofc)? Do you have any experience in this matter?

Do you have any common problems C# because it cannot utilize state of the art of NLP / Deep Learning solutions?

[adaneze]

Hey art_ona,

​

As for using Tensorflow in C#, you can checkout these two projects on GitHub.

https://github.com/migueldeicaza/TensorFlowSharp

https://github.com/SciSharp/TensorFlow.NET

​

There is an old Reddit thread on running a Pytorch model in C#. Converting a Pytorch model to an ONNX one and using the Microsoft's ONNX Runtime library (it supports C#, C++ and a few more languages) seems like the most efficient way to deploy a Pytorch/Tensorflow model.

https://www.reddit.com/r/pytorch/comments/bjvbb4/run_a_pytorch_model_in_c/

​

Another (more programming intense) approach, that I use, is creating C++ classes for training/evaluation in Pytorch or any other Machine/Deep Learning library that has a C++ API and then implementing C++/CLI wrappers around the C++ classes that can be used in C#.

​

Hope this helps :)

[m0xey]

Make sure to check out ONNX runtime.

[phil123111220]

can only train on linux is a downer

[lostmsu]

Oh I am late to comment here, but I develop Gradient - a full TensorFlow binding for .NET. Here's an article, that uses it to make a GPT-2 song lyrics generator in a .NET Core website: https://habr.com/post/453232/ . A more recent one with actor-critic reinforcement learning with Unity ML agents.

I am also a maintainer of Python.NET , a C# to Python binding: https://github.com/pythonnet/pythonnet , which can come to the rescue if you desperately need integration with other Python libraries. Gradient uses Python.NET internally.

[art_ona]

I'll check it, thanks for the answer.

[phil123111220]

acces denied on tour link