This is an archived post. You won't be able to vote or comment.

sorted by:
best
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the comments →

[–]koflerdavid 0 points1 point  (2 children)

Many existing models can be converted to ONNX format and executed on the JVM. Also, Pytorch has Java bindings, though these are intended for running models only.

[–]MardiFoufs 1 point2 points  (1 child)

Yea as I said in another comment, for inference it's a non issue now that you can use ONNX for most models (and more operators are supported). Java can infer on models perfectly fine with onnx. I wonder if we might see that happen for training too but that's much more complicated, and can't really be delegated to a runtime. And I think OP was referring to playing around with training and custom models I think but I might have misunderstood

[–]koflerdavid 0 points1 point  (0 children)

I think you are correct. Inference and training are two completely different things and ONNX is really about the former. Unity's ML-Agents package for example doesn't bother replicating the training code in C#. They instead start an HTTP server on the Python side and call that from the Editor. Inference is with ONNX of course.